what does it say about the question of whether computers are conscious subjects of experience? Because I take that question to be central to the OP. — Wayfarer
I disagree for two reasons:
1. The original post posits self awareness as the issue rather than conscious[ness]. And I have no reason to presume the poster chose his terms carelessly. And though one could carelessly consider them synonymous, that would be a tough argument to make. All reasonable people would agree that my dog and I are both conscious beings. Yet I doubt all reasonable people would agree that my dog has a sense of self awareness. And if all beings who are conscious are not necessarily self aware, then conscious and self-awareness cannot be synonymous. So absent a reason to believe the original poster meant something other than what he said, it would be anti-philosophical to presume the central issue is other than self-awareness; and
2. It is where "human" stands on the spectrum of self-awareness relative to the computer that is the central question. As the poster clearly asks "Would we be closer to the computer or being x?" Again and with all due respect to the poster, it would be anti-philosophical to suggest a different question is "central to the OP."
……………………………………………………..? <---- HUMAN ----> ?
Rock --------------------------Computer---------------------------------------------------------------Being X
And in an attempt to advance the issue, I suggest that Human is closer to the Computer. However, I suspect that Human is unlikely to move significantly (if at all) closer to Being X but that the Computer certainly will move closer to Being X. If that is the case, then the deeper issue becomes whether Computer will move past Human on the spectrum of self awareness.
Further, self-awareness rather than consciousness strikes me as an interesting twist to this now age old debate. In order for there to be self-awareness, there must be awareness. If we call awareness "AL1" (Awareness Level1) and self awareness "AL2" (Awareness Level2) and awareness of self awareness "AL3" (Awareness Level3), are we not already at AL3? And at what AL(x) is Being X?
Finally and most important of all, is this simply a more grown up version of the "I know" game?
I know
I know you know
I know you know I know.
I am aware
I am self aware
I am aware that I am self aware
Because that is the way it feels every time contemporary programming achieves that which yesterday's learned skeptics said it will never achieve. If we ever had a working definition of "conscious" (which we do not) and coders were able to represent it, you can bet your bottom dollar we would promptly change the definition.