I am building an AI with super-human intelligence We don't know how humans think. Does your AI have the ability to think? — MoK
You are absolutely right, we don't know how we think. We have two perspectives on the matter, one is our own experience of thinking, the other is our neurological knowledge. However, we do not understand the relation between those two. We call it "emergent" but that is another word for "too complex to understand".
Yet something crazy happens at the moment. Neural nets were proposed around 1960, if I am correct. By tinkering, 60 years later, we have ChatGPT. And even while we still don't understand how it works, there are similarities between ChatGPT and our brain processes. That is kind of magic.
What I plan to do is based on observing my own thought processes. I will try to build the architecture that will enable the processes that I am aware of. Language is a large part of that idea. So yes, I believe one day my AI has the ability to think. Hoping for another piece of magic.
This might raise the question of consciousness. But in order not to complicate the discussion, I would like to save that topic for a later post.
For me a proof of thinking would be, you give it a complicated question 'A' and it has no answer. Then some other day you give it a piece of seemingly unrelated information 'B'. Then a day after that, it says "He, do you remember you asked about 'A'? Now yesterday you talked about 'B', and maybe there is an answer here." Then it explains you in all detail a perfect answer.
That is what I am trying to achieve with Babelspeak, a method to store, retrieve and combine internalized abstractions.