Why is the Hard Problem of Consciousness so hard? My view:
1. There is no dualism; this is demonstrated by the incoherence of the p-zombie concept.
2. The question then becomes about epistemological reasons why we cannot reduce the experiential to the physical.
There is a logical argument, A: If experiences are information about the outside world then it is inconsistent that information about the brain should be derivable. However, this does not mean there is no information about how brains divide up the information in the world - e.g. see that opponent processing and trichromacy in our retinal neuronal architectures were all but predicted by observations about the phenomenal structure of colour - at the same time, what was inferred was not the actual physiology of brain processing but just the way that the brain divides up sensory input that enters the retina by frequencies. It didn't tell us that a brain as we know it was doing the dividing, just that a division or organizing was being made.
There is a skeptical/indeterminacy argument, B: The way brains are structured simply does not give them access to information about the micro-physical causes of input (whether externally or internally) - such causes are inherently indeterminate (and much of the information lost anyway at larger scales).
Conceptual primitives argument, C: A description or explanation is just outlining/modeling relations in a conceptual space. Descriptions or explanations cannot go outside of the space / framework they sit in. If our conceptual space is founded on primitives that are experiential qualities then there is no way of explaining or describing those experiences in a satisfactory way since they are the primitive foundations of the entire explanatory space. They cannot be decomposed or reduced further so they seem ineffable, but this ineffability is unavoidable in any inferential system like our brain that can make explanations.
3. It also must be acknowledged that our scientific theories don't say anything about ontology, they are part of the same explanatory framework as C above. Scientific theories are like predictive tools and there can be a plurality of descriptions. There is therefore no inherent contradiction between physics and experiences if we say that physics doesn't tell us about inherent ontology. Equally we might say that the notion of experience doesn't tell us much about ontology other than the fact it is informative about the external world. If anything, coherently non-trivial fundamental ontologies are inherently unattainable.
Next part is more speculative:
4. If my experiences are what its like to be a brain then we might want to try vaguely conceptualize the world in a way that accomodates their existence. We might look to a kind of structuralist but minimalist metaphysics where all structure is on ontologically equal ground. What we may deem most fundamental in the world may be things like symmetries, invariances, regardless of the scale they occur. Experiences are what its like to be some structure, invariances, information (difference that makes a difference). Specifically my experiences reflect particular macroscopic invariances in the vicinity of the brain among many others that exist and are described in physics, chemistry, biology at various scales.