Adverbialism and truth If we see something blurred as opposed to clearly, or as you suggest through a filter of some kind, I admit there is a good deal of motivation - independently of any apriori convictions about materialism/idealism - for thinking that the difference is not in the "objects of vision" but rather the viewing equipment. So there is certainly something in what you say. However, in regards to afterimages, I'm not so sure that this motivation applies, or even if it does, that it trumps the "act-object" view of what is going on. After all, you mention that to get someone to see an afterimage we might ask them to look at the same wall they were looking at earlier, but now there is an overlay, okay - so what's "an overlay" other than an object of vision distinct from the wall? Adverbialism, as I understand it - and admittedly, I'm perhaps not being very charitable - is simply an attempt to brush overt commitments to such strange "mind-dependent" objects of vision under a carpet of language, in the hope that no-one tries to flatten out the bumps. I suppose the point I am advocating is that it fails phenomenologically, and because it fails phenomenologically, that gives us some evidence for supposing that it is false. Suppose, for instance, you track an afterimage across a room, on the analysis you are proposing, it would seem we would no longer be keeping an eye on one thing, it would have to be interpreted as seeing a lot of different things modified in similar ways, but splitting it up like that might in the end fail to do justice to the phenomenology of tracking.
Anyway, perhaps there is a more basic/general question to address before asking questions about afterimages specifically, and that is "what are the objects of vision?". Berkeley and others after him (realists and materialsits alike) took the basic building blocks of perceptual objects to be instances of visible properties - specifically colour and shape. If that is right, the question would be "when we see afterimages are there instances of visible properties that are objects of vision or not"? If there is an instance of redness when I see a red afterimage - regardless of the logical form we finally give to afterimage statements - then I think questions with consequences for realism / directness/indirectness of perception would still have to be answered about those instances.