When I use the name "Frodo" I am referring to the hobbit, not to the word "Frodo" or my idea of Frodo. Realism is not required for words to refer to more than just our words and our ideas.
Yes, it's about the apples. But how does one talk about the apples? By talking (and understanding), nothing more. The point I am trying to make is that realism is not required to talk about the apples. We can talk about things that aren't words and aren't experiences and aren't ideas even if anti-realism holds.