Do we genuinely feel things
Our senses and understanding are fallible. Our senses give us experience due to the energies or objects of the physical world creating alterations to our body, thus informing bodily consciousness; for it is through the body we come to know an apparent reality. Our apparent reality is made up of reactions to these outer energies or objects, telling us more about our sensory experience than about the energies or objects in and of themselves. So, apparent reality is a biological readout, as much dependent upon the energies/objects of our outer world as it is on the perceptions of their alterations to our bodies.
So, our apparent reality is not what is out there in and of itself, the ultimate reality; it is the mixture of energies and their effects upon us. Other individuals are part of our outer world as objects themselves and they, like yourself are energy forms. Just as their being affect us as energies altering our biology their emotional expressions are also energies affecting us in a similar way and processed through our understanding gives their energies add emphasis and interpretations as to whether this incoming energy is life supporting or life negating. It is all interpretation of energy and unfortunately fallible.