What evidence could we have that things really are as they seem when that's all evidence is? Lots to address here. I’ll try and cover what I can.
Science relies heavily on removing extraneous circumstantial evidence. All experience, in this light, is evidence. Evidence for what is discovered through investigation.
Science and philosophy rely on logical principles. The ‘evidence’ is what we work with by sorting and ordering (logical principles). In this respect a book like ‘Logical Investigations’ by Husserl could be of some interest to you.
So for me when you say experience isn’t evidence then I can only ask you to ask yourself how you distinguish the two, what they have in common, whether or not they are essentially the same thing and merely separated by a habit of language use, and whether or not you think it is more likely that either ‘evidence’ is a kind of ‘experience’ or ‘experience’ is a kind of ‘evidence’ (take your pick).
Word can often be misleading if they’re not analysed carefully - hence what I believe to be one of, if not THE, importance of ‘philosophy’.
As for what is ‘right’ or ‘wrong’ I believe you meant ‘correct’ or ‘incorrect’? The former are more laden with ethical thought in the lexicon of philosophical jargon. For ‘correct’ or ‘incorrect’ it is merely a matter of sets of rules - Wittgenstein’s ‘Philosophical Investigations’ would probably be of interest to you in this particular area. For example if we’re playing chess and both know the rules of chess there are definitively ‘correct’ and ‘incorrect’ moves. The problem is that if we’re not focused enough on the game it is possible one of us could’ve made an ‘Incorrect’ move unintentionally and neither of us noticed - here in lies the conundrum of whether or not we were ‘playing chess’ or not if we’ve made a mistake. We can argue that we were both under the impression we made no ‘incorrect’ moves therefore we were still ‘playing chess’ yet if someone was to watch a video of the game and pointed out our mistake they could see our error and tell us ... but that doesn’t change our belief that we had a game of chess, only that we made an unnoticed mistake.
In short, this comes down to accuracy of play and error margins. Undoubtedly someone learning to play chess will make some errors, and they are more likely to make errors than a grandmaster whose error rate would be as good as zero. ‘As good as’ in this sense could be equated to mathematical impossibility and basic entropy - it is ‘Possible’ that the wind will blow in such a manner as to for a perfect sandcastle on a beach somewhere on Earth, but the ‘Probability’ of this happening during the span of the Earth’s lifetime is so incredibly minuscule that we say it is ‘Impossible’. Claude Shannon may interest you in this particular area.