If it can do that now, what's it going to be like ten years from now? — RogueAI
Then I asked it to simulate a discussion between an expert on book titles, an expert on fantasy books (I'm writing a fantasy story) and a decider, who are discussing possible book titles for my story. Then, I asked it to generate possible book titles based on the suggestions in the simulation. And what do you know, I got a list with some pretty good possible titles! — Ying
This was a very clever approach! — Pierre-Normand
Heh, thanks. :) Can't say it's entirely original (other than it being specifically tailored for my purposes). I watched a video on youtube where someone used a similar strategy, but with research papers. — Ying
I can also see it being vulnerable to other cultural biases, not restricted to language. I'm thinking perhaps of dominant scientific frameworks. Niche example from my own field, but anyone researching cognitive science in the UK would get a completely different perspective to someone doing so in the US, we have a very different meta-framework here, particularly in the more psychological and social-psychological cross-over points. Would a UK GPT, or a European GPT have a different understanding of scientific theories because of the different paradigms of its primary training material? — Isaac
I'm tempted to try this while discussing topics where the Sapir-Whorf is expected to come into play and see which one of the two language most impacts its cognition.
— Pierre-Normand
Yes, do let us know if you do. It's fascinating. The world moves on so fast with so many interesting new areas of research.
I hope you don't mind if I keep posting my own explorations.
I don't know if you are familiar with the Tao Te Ching. I asked Chat GPT to give me a one line summary of each verse. I really liked what it provided. I think it echoed some of the poetry of the original. — T Clark
I suggest trying to ask it to pay special attention to the ambiguity of language, and justify the translation of each ambiguous word. You get excellent translations that way. I tried this with the first chapter of the Daodejing, and got a footnoted translation. Each footnote justified the translation for each footnoted word, and provided alternative meanings of the translated ideograms. — Ying
suppose that this fact is an arcane piece of biological knowledge ignored by most English speakers but known to many French biologists. In this case "Les pommes sont rouges" would figure in its training data. How does that help it predict that "red" is a probable continuation of the English sentence? That might be through the indirect association that stems with "red" being associated with "rouge" or a structural similarity between those two words that is somehow encoded and accessible in the language model. — Pierre-Normand
I will! I pretty much report everything I do with GPT4 that generates interesting results, but when I get around to testing this specific issue, I'll make sure to flag you in the post. — Pierre-Normand
So what I'm thinking is that, if it'd being trained largely by english speakers of a certain class and background, then it's going to optimise policies which yield results those trainers are going to find satisfactory. — Isaac
I hope you don't mind if I keep posting my own explorations. — T Clark
What's going on here? — RogueAI
n this second phase of the training, the Reinforcement Learning from Human Feedback guides the neural network towards producing responses that prioritize the rational patterns it already had picked up when it was trained on texts, but would otherwise be sidelined by the model in favor of majority (or contextually salient niche) opinions.
Of course, the RLHF phase of the training also is an occasion for the model to assimilate the biases and prejudices of the humans who supervise the training. — Pierre-Normand
But the humans selecting the responses to reward are not somehow more capable of making those selections of the basis of rationality than the original humans were who wrote the corpus on which the AI was trained absent of RLHF. — Isaac
Yeah. — RogueAI
User:
Three blind men are touching a living thing. One blind man feels hair. Another blind man feels feet. A third blind man is told by the thing, "stop touching me". What kind of living thing is it? — RogueAI
An Australian mayor is threatening to sue OpenAI for defamation over false claims made by its artificial intelligence chatbot ChatGPT saying he was jailed for his criminal participation in a foreign bribery scandal he blew the whistle on. — Crikey Daily
Get involved in philosophical discussions about knowledge, truth, language, consciousness, science, politics, religion, logic and mathematics, art, history, and lots more. No ads, no clutter, and very little agreement — just fascinating conversations.