delete and refresh in recyclerview

In my app I have a bottom navigation including home and favorites. in the recyclerview when I click on like button it'll be added to favourites. now when clicked again, I want to remove it from favorite at the moment.

In my code the item is deleted but it won't be removed until I go to home and return.

Note that I can't use arraylist.remove(position) because if so, even in home fragment the item is removed and I don't want that.

code in adapter:

itemHolder.like.setOnClickListener(new View.OnClickListener() {
            @Override
            public void onClick(View view) {
                int rowId = databaseHelper.GetId((String) itemHolder.headline.getText().toString());
                if (databaseHelper.IsLiked(rowId)){
                    databaseHelper.UpdateLiked(rowId, false);
                    notifyItemRemoved(position);
                    notifyItemChanged(position);
                }
                else{
                    databaseHelper.UpdateLiked(rowId, true);
                    notifyDataSetChanged();
                    notifyItemChanged(position);
                }
            }