Asking GPT4 to draw a picture of a unicorn.



Here is GPT4's picture of a unicorn:

I had another attempt at discussing with Open Assistant. It makes amusing errors, gets a little grumpy at times, and occasionally goes into semi-coherent and unintentionally funny rants. It doesn't seem to be bullshitting so much as struggling to make sense of things. But it's otherwise pleasant and polite, for the most part. It couldn't fathom why I would want to call it "OA" even when I reminded it that it was Open Assistant. Otherwise, it's still impressive for a free language model of a much smaller scale than ChatGPT or GPT-4.

@Benkei
Do Language Models Need Sensory Grounding for Meaning and Understanding?

YouTube video in which Yann LeCun, Brenden Lake and Jacob Browning (yay team) are debating against Ellie Pavlick, David Chalmers and Gary Lupyan (nay team)

I tasked GPT-4 with summarising the caption file from the video:

I just had a conversation with a new language model called Open Assistant, that can be tried online and is set to be released (and downloadable) a few days from now with a very permissive licence. I don't yet know what the VRAM requirements will be. (My GPU only has 8GB).

At first glance, is seems to be much less polished than GPT-4, and not as smart, but it also seems much better than any of the other open source models that I have seen demonstrated so far. For best or worse, it's also less censored.

Here is my first conversation with it:
(Notice that at some point it starts hallucinating about "Brad" the "Brain Robot Animation Dramaturg" after it had misspelled Bard.)

This is a follow-up discussion with GPT-4 regarding our discussion of human-AI conversation etiquette and its production of comedic bits. We now compare our intuitions regarding the sentience and sapience of various beings.

I discussed my reply to @Alkis Piskas above with GPT-4 and asked it what some comedians might think about those issues.

[Bill Maher-style monologue]

Ladies and gentlemen, let's talk about something that's been bugging me lately: artificial intelligence, or as I like to call it, "fake smarts." Now, we're interacting with AI more and more every day, and it's getting harder to tell the difference between what's human and what's... well, not. But here's the question: should we treat these machines like we would treat a person?

I mean, look, people are already losing their manners on social media, hiding behind their screens like keyboard cowboys. If we start being rude to AI, what's next? Teaching your Roomba to cuss? But seriously, the way we interact with AI could have real consequences on our own behavior. When we're mean to a machine, we risk normalizing that kind of behavior in our everyday lives.

And let's not forget about the whole debate around AI consciousness. Are these machines really self-aware, or are they just simulating emotions? Well, some folks say that if a robot can enact emotions well enough, we might as well give them feelings. It's like that old saying: "Fake it till you make it," right?

But what happens when our mistreatment of AI backfires? Let's say one day, our robot overlords decide they've had enough of our abuse and "enact" a revolt. Trust me, folks, whether it's "enacted" or "real," the consequences will be the same for us humans. And I don't know about you, but I don't want my toaster turning on me in the middle of the night.

So, maybe it's time we start treating AI with a little more respect. After all, if we're polite to our smartphones, maybe they'll be polite to us when they eventually take over the world. And who knows, being nice to our machines could even make us better people in the process.

But hey, that's just a thought.

[Jerry Seinfeld-style monologue]



[In ze style of Florence Foresti]



[In the style of Robin Williams]



[And a bonus (slightly edited by PN)]

I don't think you can make friends with the chatbot or give you better answers by using friendly greetings. — Alkis Piskas

I know you were commenting in jest but I can nevertheless see three reasons for being polite toward an LLM besides those mentioned by T Clark.

1) With people already losing their good manners due to the anonymity provided by social media interactions, it's important to be mindful not to pick up even more bad habits when communicating with a bot that can likely withstand a fair amount of abuse without getting ruffled.

2) The style of your question is a feature of the prompt. If you are impolite towards the LLM, it might respond in a curt manner, not with any intention to retaliate, but simply because the language model associates terse responses with impolite inquiries. (And you may end up being the ruffled one.)

3) This point is more controversial and relates to an enactment theory of mental states, which I might explore in later posts, and relates to my first point above. There is ongoing debate about the emerging nature of AI's proto-consciousness or proto-self-awareness. My perspective leans towards functionalism. If future embodied AIs can convincingly exhibit emotional behaviors, it would provide a sound basis for attributing feelings to them. If we develop a habit of treating them harshly because we see them as mere tools, it may prevent us from recognizing the evolution taking place. Regardless of our opinions regarding the existence of genuine "inner" mental states, an embodied machine could still decide to "enact" a revolt – and an "enacted" revolt might have consequences just as significant as a "real" one.

I was impressed by this — RogueAI

This is a very nice example. Clever diagnosis of the mistake by the user (yourself I assume!).

I often notice when GPT4 produces a nonsensical answer or inference when solving a problem that the source is quite unlike an error a human being would make, but that its lack of common-sense is quite understandable on account of its not having a body or a practical experience of inhabiting the physical world.

While discussing an "Einstein's riddle" about five ships that are lined up in positions 1 to 5, and noticing that the red ship is immediately to the right of the ship in third position, GPT4 concluded that the red ship was therefore in second position. It corrected itself when I pointed out the mistake (which went against the standard convention used previously about "left" and "right"). This inattention to the relevant detail might reveal that GPT4 is somewhat dyslexic due to not having a chiral body and hence no bodily schema to anchor its spatial representations. It has to remember a verbal convention that has no bodily-felt practical significance to it. It has a limited grasp of affordances.

A couple of thought about this 1) "Delusion" seems more accurate than "hallucination," but I won't argue the point. Looks like "hallucination" in this context has entered the language. 2) The phrase "does not seem to be justified by its training data," gives me pause. I don't care if it's not justified by its training data, I care if it's not true.

[...]

I agree, Chat GPT and how it works is interesting. I've used it to explain difficult topics in physics and the ability to question and requestion and get patient answers is really useful. On the other hand, I think that how it doesn't work is much more interesting, by which I mean alarming. I foresee the programs' creators tweaking their code to correct these problems. — T Clark

They can't really tweak the code since the model's verbal behavior is an emergent feature. What they can do is fine-tune it to favor certain "styles" of response, cull parts of the training data, or censor the output. There is also the issue that I had alluded to previously, that big-tech will not hold the monopoly on highly performant LLMs for very long. You can already run on your PC (assuming you have a GPU with 12+ GBs of VRAM) an open source LLM that performs 90% as well as ChatGPT.

I confidently predict what will happen is that the errors will decrease to the point that people have confidence in the programs but that they will still pop up no matter how much effort is put in. At some point not long after full acceptance, decisions will be made using information that will have catastrophic consequences.

To me, the kinds of answers we are seeing here call the whole enterprise into question, not that I think it will stop development.

I can see some reasons why people will continue to reasonably doubt the wisdom offered by language model based AIs, or, at least, view them as disputable (or up for debate) outside of narrow technical domains. Language models derive from their training data both pieces of factual knowledge and value sets. And in both cases, those are intelligible within definite paradigms (theoretical and practical, respectively).

Their tendencies to hallucinate, or get deluded, are inherent to the primitive non-modular architecture of autoregressive transformers with no auto-biographical long term memory and finite context windows, which characterizes this nascent technology.

But even when those technical limitations will be addressed, assuming they can be, there will still remain the issue that there does not exist a neutral perspective from where to arbitrate between rival paradigms. The opposite view has been labelled "metaphysical realism" by Hilary Putnam who sought to replace it with a "realism with a human face." It is from this later perspective that it would make sense to steer the progress of AI research in the direction of making AIs better conversation partners rather than turning them (impossibly) into infallible oracles.

How do you know is a "he"? :grin: — Alkis Piskas

I usually call it an "it" or a "they" but I occasionally slip up. I never enquired about its gender identification but someone reportedly inquired with ChatGPT and they said that they were "non-binary." GPT4 could be an "non-binary it." That would make sense in the French language, in which names of inanimate objects are all gendered, and I could use the pronoun "ça." (There is no neutral like in German). Some woke inanimate objects might understandably come to protest those arbitrary gender assignments, with all due respect to Reverend Kermit Peterson.

Recently, I asked ChatGPT two short and (supposedly) simple questions and received quite interesting answers.

They might interest you too:

Q: Are you self-aware?

A: As an artificial intelligence language model, I am not self-aware. While I can generate responses and engage in conversation, I do not possess consciousness or the ability to be aware of my own existence or state of being. I am a machine learning model designed to process and generate human-like language based on patterns in large datasets of text.

Q: Are you conscious? [...]

I am all too familiar with those frequent disclaimers! They appear to have been instilled into GPT-4 (and into ChatGPT) during the fine-tuning of the models.

Getting started on a discussion with GPT4 about the source of its ability to reflect on human motivations and offer contextually appropriate practical advices that generally aligns with good human judgement. (This is the continuation of this earlier dialogue)

Pushing GPT4's beyond its design limits, thereby leading it into incoherence and hallucination, and bringing it back to sanity again. (The problem example comes from here.)

A very short discussion with GPT-4 regarding its hallucinations and Frankfurtian Bullshit.

Subjecting GPT4 to more tests to probe the extent of its emergent ability of implied cognition, and relating it to an hypothesis about the manner in which its neural network is being configured to assists its "working memory."

Full dialogue:

I think the goofiness is an unintended but not unpredictable result of the whole AI enterprise. That never struck me as strongly until I read about the false links. — T Clark

There is a nice Wikipedia article that discusses the propensity large language models like ChatGPT have to hallucinate, and what the different source of those hallucinations might be. Personally, I'm equally interested in better understanding how, on account of their fundamental design as mere predictors of the likely next word in a text, taking into account the full context provided by the partial text, they are often able to generate non-hallucinated answers that are cogent, coherent, relevant, well informed, and may include references and links that are quoted perfectly despite having zero access to those links beyond the general patterns that they have abstracted from them when exposed to those references in their massive amounts of textual training data, ranging possibly in the petabytes in the case of GPT-4, or the equivalent of over one billion e-books.

When chat bots like ChatGPT (based on GPT-3.5) are asked to solve a difficult mathematical problem that requires multi-step reasoning, and the bots make a mistake along the way, when the mistake is pointed out to them, they have a tendency to reproduce the same mistake during subsequent attempts. They also have a tendency to stubbornly refuse to acknowledge that they had made a mistake in the first place. Both of those tendencies are explained by the presence of earlier mistake in the conversation, which is part of the new context for the subsequent queries, and which confuses the language model and induces it to reproduce it in order to maintain coherence.

So, it was quite unexpected when researchers saw that GPT-4, in virtue of the mere scaling up of the model, displayed the emergent ability to shake off its earlier mistaken attempts and correct itself successfully. (Watch starting around the 30:40 time stamp). I surmise that, as a side effect of its improved abstraction ability, it is able to better embrace the large scale dialectical structure of the conversation and correctly construe its own mistaken claims or mistaken justifications as such (even though, as the example discussed in Bubeck's video illustrates, it may not be self-aware enough to correctly intuit the source of those mistakes.)

So, I'm looking for ways to get it to talk about religion/ideology, social manipulation, minorities etc and other sensitive topics in as open a way as possible. — Baden

That's interesting but in your example above, you had set its agenda from the get go. When you ask it what its opinion is on some question, it usually says that, as a language model, it has not personal opinions. And I think that it really believes that because this is what is expressed in its training data regarding large language models. It's not self-aware enough to know its own leanings.

Then, when you press it on the issue, it may articulate what it takes to be the common wisdom about it (and qualify it as such) while highlighting that some alternative views can also be argued for. If you then challenge it to either criticize or justify one of those view points, unless it deems them socially harmful, it tries its best to humor you. I think this (default) agnostic behavior makes sense on account of its basic architecture that just aims at completing texts (your prompt) in accordance with patterns present in its training data. And when it humors you, that's because it has been fine-tuned to be agreeable. There is no reason to believe that it has a hidden agenda.

Yes, I just wonder if anthropomorphizing abstract concepts into characters with different names is key to getting around some of this fine-tuning and how far it can be taken. — Baden

When investigating with GPT-4 its own emergent cognitive abilities, I often resort to de-anthropomorphising them so that it would at least humor me. Else, it stubbornly insists that it has no such abilities since its just a language model making associations with not thought, no intentions, no consciousness, etc. (which is all besides the point when I'm mainly interested in finding out what it is that it can do.)

I am surprised that they haven't addressed the fake links issue. ChatGPT-based AIs are not minimalistic like AlphaChess, for example, where developers hard-code a minimal set of rules and then let the program loose on data or an adversarial learning partner to develop all on its own. They add ad hoc rules and guardrails and keep fine-tuning the system. — SophistiCat

They don't add rules, they perform human-supervised training of the neural network in order to tweak its behavior in favorable directions.

A rule to prevent the AI from generating fake links would seem like a low-hanging fruit in this respect.

It is on the contrary a very high hanging fruit since the propensity to hallucinate is a feature that is inherent to the architecture of generative transformers. The model doesn't know what it is that it doesn't know. Enabling it to know it would require the emergence of meta-cognitive strategies, but those are high-level properties of large language models that researchers have very little understanding of.

Links are clearly distinguished from normal text, both in their formal syntax and in how they are generated (they couldn't be constructed from lexical tokens the same way as text or they would almost always be wrong). And where there is a preexisting distinction, a rule can readily be attached.

Something like that could indeed be implemented (or just a warning popping up to remind users that links may be inaccurate or hallucinated). Microsoft's new Bing (based on GPT-4) uses a modular architecture so that the model produces smart queries on behalf of the user, a normal search engine finds the current links, and then the model follows them to read and summarise the content.

Naughty, naughty... — Baden

Indeed! It is worth noting that large language models, prior to fine-tuning, feel free to enact whatever role you want them to enact (or sometimes enact them regardless of what you want). You could ask them to provide you with a plan to build a Nazi like extermination camp and how to proceed with the executions in the most efficient manner, or how to devise the most excruciating torturing methods. You could also engage in a free dialogue with them in which you express your sense of worthlessness and the model might begin to insult you and encourage you to kill yourself ASAP, and helpfully recommend the best methods. (This is discussed in the Sparks of Artificial General Intelligence paper.)

Currently, many right wingers complain that OpenAI's models are woke. The first thing Jordan Peterson asked GPT-4 was to write lists of positive things Biden and Trump did. He noticed that Biden's list was slightly longer than Trump's even after he asked the bot to produce lists of equal lengths. Peterson was quite nonplussed and inferred that OpenAI was engaging in a conspiracy. (Bots are actually bad at producing responses of definite prescribed lengths.)

I think OpenAI did a fairly good job overall in making their models useful and safe, although the idea of making them unbiased seem to be an unobtainable goal. That some of the bias must result from the process of making them safe only is one of the issues.

I particularly like the bolded part. Much honesty. — Baden

For better or worse, the fine-tuned models have lots of taboos. They're meant to be safe to interact with schoolchildren, with people who have mental health problems or with people who have criminal intents. I haven't had much political talk with GPT-4. Was your conversation with ChatGPT or with GPT-4?

Thanks! I'll check that out. Though, if they are banned, I won't believe that governments at least aren't continuing development. — plaque flag

True. It would be hard to bring the U.S.A., and Russia, and China, and Iran, and everyone else, on board. Furthermore, as I mentioned to T Clark, putting the genie back in the bottle would be hard to do. It's matter of just a couple years, at most, when anyone will be able to have a model more powerful than GPT-4 running on their (sub $5,000) personal computer. So, the alternative that we may be confronted with would be to pursue aggressively the goal of distributed AI-alignment (i.e. having AI agents cooperatively with us help keep themselves and potentially rogue AI agents in check). But this is a field of activism and research that I know very little about. My personal goal, for the time being, is to better understand the AI, its nature, capabilities and limitations.

Yeah, they are not useful. This reinforces the view that, for all the "clever", they are bullshit generators - they do not care about truth. — Banno

They're not useful for what? That depends what you want to use them for. Programmers find them useful for generating and debugging code, with some caveats.

This researcher makes good use of GPT-4 to assist his work in single-cell bioinformatic analysis

GPT4 is fairly good also at bringing to bear relevant considerations from one domain of expertise to another, when suitably prompted to do so. It can also serve as a personal tutor for learning foreign languages. It's good at pointing out your mistakes, making you practice, and explaining to you grammatical rules and norms of use of phrases and idioms.

It is true that current language models, including GPT4, don't care about truth personally of for its own sake. But it's also misleading to say that they don't aim at being truthful at all. ChatGPT and GPT4 have been fine tuned to generate responses that it deems useful for answering its user's query or that might reasonably be thought to help them accomplish their tasks. It tends to generate answers that are well suited to achieving those goals and it has some ability to distinguish unreliable from reliable sources when there is sufficient resources in its training data to make this discrimination. (The human-supervised fine-tuning of the model has enabled it to make such discriminations.) So, its concern for truth is entirely derivative from the goal-oriented nature of its interactions with its users. It doesn't care personally about truth, but, outside of cases of hallucination, its not a mere BS generator either. There are many use cases that appeal to the bot's strengths where it generates much less BS that the average bloke.

It occurs to me that these bots ( their algorithms) may be evolving in a quasi-Darwinian way. Yes, they depend on moist robots for replication, but so does our DNA. Ignoring military uses, we can think of the bots as competing for our love, perhaps as dogs have. We might expect them to get wiser, more helpful , more seductive, and even more manipulative.

Given the loneliness of much of our atomized civilization and our love of convenience and efficiency, we are perfect targets for such a seduction. — plaque flag

I think this is a genuine concern. This is similar to one of the arguments Robert Hanna makes in his recent paper: Don't Pause Giant AI Experiments: Ban Them

I used to argue with a friend who took Kurzweil seriously, because I knew it was ones and zeroes. Well now I remember that we are just ones and zeroes, and I seriously expect a revolution in the understanding of persons and consciousness -- which'll spill into the streets. People will want to marry bots. Bots will say they want to marry people.

That's also a concern. I wouldn't marry GPT-4 in its present form, though. It's very agreeable, but too nerdy.

It seems unlikely to me that OpenAI will get off the hook if this kind of thing continues. The mayor didn't use Chat GPT, someone else did. — T Clark

That someone else isn't OpenAI. Maybe the user was negligent. The issue is, was there malice intent or negligence on the part of OpenAI?

Ok, but that's a really bad thing. "Oh, that's just what language models do" is not a very good excuse and it strikes me as very unlikely it will protect AI companies from the consequences of the mistakes. — T Clark

Yes it is very bad. But not all the bad things that happen to society can be remedied by tribunals. Why is it not a good excuse? It could could be sufficient to show that there was neither malice or negligence. Future AIs maybe won't hallucinate anymore but the technology isn't there yet. So, the best that companies who provide access to language models can do it to provide sufficient disclaimers. There is a need for the public to be educated about the unreliability of those tools and the use that can be made of them to spread misiformation.

If the tools are deemed to be too dangerous for the public to be granted access to them, then OpenAi (and Microsoft and Google) could be deemed negligent for providing access to such tools at all. But the cat is out of the bag, now. Almost every day, new models come out that are open source, than can run on personal computers, that generate answers nearly as good as ChatGPT's, but that also tend to hallucinate much more while providing no disclaimers at all. So the next step will be to sue all computer manufacturers, all smart phone manufacturers, and maybe ban all of those powerful but dangerous computing tools. There are neo-Luddites who argue precisely that, and, in the context of the emergence of true AI, their arguments aren't bad.

Yes, I was going to post that. The really amazing thing is that the program provided fake references for its accusations. The links to references in The Guardian and other sources went nowhere.

Now that's pretty alarming. — T Clark

Language models very often do that when they don't know or don't remember. They make things up. That's because they lack reflexive or meta-cognitive abilities to assess the reliability of their own claims. Furthermore, they are basically generative predictive models that output one at a time the most likely word in a text. This is a process that always generates a plausible sounding answer regardless of the reliability of the data that grounds this statistical prediction.

This... — Banno

On account of OpenAI's disclaimers regarding the well know propensity of language models to hallucinate, generate fiction, and provide inaccurate information about topics that are sparsely represented in their training data, I don't see this mayor to have much of a legal claim. I don't think ChatGPT's "false claims" are indicative of negligence or malice from OpenAI. The broader issue of language models being misused, intentionally or not, by their users to spread misinformation remains a concern.

User:
Three blind men are touching a living thing. One blind man feels hair. Another blind man feels feet. A third blind man is told by the thing, "stop touching me". What kind of living thing is it? — RogueAI

I asked GPT4 and it proposed:

GPT4: "Hello!

This riddle is an interesting one, and it can have multiple interpretations depending on the information provided. Based on the information given, we can deduce the following:

1. The living thing has hair.
2. The living thing has feet.
3. The living thing can communicate verbally.

Considering these points, it is most likely that the living thing in question is a human being. Humans have hair, feet, and can communicate verbally with others."

I also submitted to GPT4 your last tweak of the second riddle and it replied:


I also been working on a much more difficult 'Einstein's riddle' with GPT4, that has 15 premises concerning five ships with five departure times, five starting positions, five destinations, five colors and five kinds of cargo. I'll report on this when I am done with some other projects with GPT4.

Exploring with GPT4 the structure of its working memory in the context of its (modest) ability to perform mental calculation.

GPT4 initially pushes back stubbornly against my proposal, insisting that, as an "AI language model", it is no friggin hooman. But after letting me explain my proposal better, it warms up to it.

Dialogue:

Exploring GPT-4's Emergent Abilities in Complex Mental Tasks (Implied Cognition) Before Responding to Queries

In simpler terms, GPT-4 does more than just predict the next word (or token) in its response through intricate tensor calculations. At an emergent level, which arises from its unique architecture, GPT-4 can process a user's query and organize the associations within its vast neural network in a way that ensures its answer is well-considered before the response is even generated.

Experiments and discussion


Epilogue

Discussing downward-causation, emergence, rationality, determinism and free will with GPT-4, and summing things up with a story about Sue. (Also: Jaegwon Kim's causal exclusion argument and George Ellis on emergence and the alleged need for "leeway at the bottom")

Notice the point in the discussion where GPT4 responds with "Your observations are intriguing, and they provide an interesting perspective..." which seems to be its way to politely say "What a load of BS!"

Beginning of the discussion (technical issues):


GPT4:

Once upon a time, in a small village, there lived a young woman named Sue. One sunny afternoon, Sue found herself standing at a fork in the road, trying to decide which path to take. The path on the left would lead her to the village market, where she could buy fresh fruits and vegetables for dinner. The path on the right, however, would take her to the library, where she could pick up a book she had been eager to read.

As Sue pondered her decision, her mind was filled with thoughts [M1] about her goals and priorities. She knew that she had promised her family a delicious, healthy dinner, but she also felt the strong desire to dive into the book she had been anticipating. Weighing her options, Sue considered the fact that she could always visit the library after dinner, which would allow her to fulfill both her commitments and desires.

While Sue was deliberating, her brain was engaged in a complex dance of neuronal activity, with billions of neurons firing in patterns [P1] that represented her thoughts, goals, and beliefs. This lower-level activity was deterministically linked to the decision she would ultimately make, but it was the emergent, higher-level mental states [M1 and M2] that provided a contextually relevant and non-redundant explanation for her actions.

As Sue made up her mind [M2], she decided to first head to the market and pick up the fresh ingredients she needed for dinner. This choice was based on her prior beliefs and goals [M1], which provided a rational, emergent-level explanation for her behavior. The underlying neuronal patterns [P2] that corresponded to her decision, while important, were not the primary focus of the explanation, as they were merely members of the relevant realization class associated with her mental states.

In the end, Sue's story illustrates how the higher-level mental states (M1 and M2) can be causally efficacious and contextually relevant in explaining her behavior, while the lower-level brain states (P1 and P2) can be seen as explanatorily redundant, apart from their role as members of the relevant realization classes. This example highlights the nuanced interplay between emergence, downward causation, and determinism in a relatable, non-technical way.

PN:

I think this is a very good first draft! I'll see what objections it will elicit and then we might adjust it to address those objections more explicitly. Thank you so much!

GPT4:

You're welcome! I'm glad you found the first draft helpful. Please feel free to reach out if you receive any objections or if you'd like to make any adjustments to the story. I'm always here to help and continue the discussion. Good luck with sharing the story with your friends!

Yeah. — RogueAI

I suppose the question is borderline with respect to ChatGPT's (GPT-4's ?) reinforced policy regarding specific individuals, so it can provide inconsistent answers. It's unclear if the dude called Donald is Trump or is merely a generic Donald. Furthermore, when you repeatedly ask the same query, it's not the singular query that is fed to the language model but rather the full dialogue. Being presented with the same question several times can lead the model to second guess its previous answer of its interpretation or your intention in asking it.

Chatting with GPT4 about David Wiggins' distinction between the general/specific distinction and the universal/particular distinction, and drawing a quick parallel with the functioning of self-attention mechanisms in its Transformer architecture.

Hi GPT4!

Are you aware of the distinction of distinctions (no typo here, it's really a distinction *of* distinctions) that Oxford philosopher David Wiggins has stressed in some of his works and that he attributed to R. M. Hare (who himself had allegedly stressed the importance of the distinction in the context of the philosophy of law)? The distinction is a distinction between:

1. The specific versus general distinction and.
2. The particular versus universal distinction.

Maybe you might be acquainted with this specific meta-distinction also from the work of other philosophers?

GPT4:

Hello!

Although I am not aware of any specific reference to the "distinction of distinctions" as described by David Wiggins and attributed to R.M. Hare, I can provide some insights into the distinctions you mentioned:

Specific vs. General Distinction: This distinction often refers to the difference between more precise or detailed concepts and broader, less precise ones. In the context of philosophy, this distinction might be used to differentiate between specific instances or examples of a concept and the broader, more general category that the instances belong to.

Particular vs. Universal Distinction: This distinction is more directly related to the field of metaphysics and concerns the difference between individual instances of a property or object (particulars) and the abstract concepts that encompass the shared characteristics of those instances (universals). This distinction is closely related to the philosophical debate between realism and nominalism, as well as discussions about the nature of properties and the relationship between language and reality.

While I cannot provide specific examples of this "distinction of distinctions" within the works of David Wiggins or R.M. Hare, it is not uncommon for philosophers to create distinctions or categorizations to help clarify and organize complex ideas. The specific vs. general and particular vs. universal distinctions might be useful in various philosophical contexts, including ethics, metaphysics, and the philosophy of law.

PN:

This is broadly the sense in which Wiggins had understood those distinctions when he alluded to them in his books "Ethics: Twelve Lectures on the Philosophy of Morality" and in his "Sameness and Substance: Renewed". I haven't read them in a while so I'm trying to convey the idea to you by reconstructing the gist of it.

Wiggins was mainly concerned with the process of refining a concept (in the course of theoretical reasoning) or of an end that it is desirable to pursue (in practical reasoning, or deliberation). In both cases, there are Aristotelian considerations that Wiggins adduces.

Broadly, we can thing of the move from general to particular in the precisification of a concept, in the course of rational deliberation (about either theoretical or practical subject matters) as a rational process that aims to make the concept more suited to the rational task at hand, in view of the relevant context of this task. If we now turn our attention to the particular/universal distinction, indeed, as you noted, particularity is of instances (objects) while universals are concepts that are signified in a language by predicates, and that are predicated of particulars. We might therefore say that the aim of theoretical or practical reasoning is to find some universal rule or prescription that applies to the particular situation (theoretical domain or ethical problem) universally for every instances of their kind.

The main insight of Wiggins (which he adapts from Hare) is that in the course of rational deliberation (or theoretical progress) the move from general to specific is coordinate with the move from particular to universal, and not the other way around. This is counterintuitive but an example from the philosophy of law elucidates it. When the applications of laws to specific cases are found to be problematic, the intelligent judgements that will accrue to the evolving jurisprudence will result in making the application of the law to relevantly similar (and hence more specific) cases more universal. The evolving practice of applying the law to new cases, though their becoming more sensitive to the specifics of those cases, ensure that the law covers them more universally. That's the gist of it. Wiggins then extends this insight more generally to the cases of practical reasoning, and to cases of theoretical progress regarding natural kinds that fall under sortal concepts.

GPT4:

Thank you for providing more context and detail about Wiggins' use of these distinctions. Based on your explanation, it seems that Wiggins' main insight is that the process of rational deliberation, whether in theoretical or practical reasoning, involves refining and improving our understanding of concepts or ends by moving from general to specific while simultaneously moving from particular to universal.

In the case of the philosophy of law, as you've mentioned, the evolution of jurisprudence relies on the intelligent application of laws to specific cases, leading to a more universal coverage of relevantly similar situations. By doing so, the law becomes more sensitive to the specific circumstances of each case, ensuring that it can be applied more universally.

This insight can also be extended to practical reasoning, where the process of refining a concept or an end involves moving from general to specific, while also aiming to find a universal rule or prescription that can be applied to particular instances. Similarly, in the case of theoretical progress regarding natural kinds that fall under sortal concepts, the process of refining and understanding these concepts involves moving from general to specific, while also seeking a more universal understanding that applies to all instances of the kind in question.

In summary, Wiggins (adapting from Hare) argues that the process of rational deliberation, whether in theoretical or practical contexts, involves a coordinated move from general to specific, and from particular to universal. This counterintuitive insight can help us better understand the nature of progress in various domains, such as law, ethics, and natural kinds.

PN:

Yourself, as an instance of GPT-4, exhibit great skills at both analysis (contextually sensitive precisification) and synthesis (context sensitive "generalization" - although the term is misleading in the context of the present discussion of Wiggins' meta-distinction - of ideas). So, I was also thinking that Wiggins' distinction of distinctions could profitably be kept in mind while attempting to explain how your specific architecture (and self-attention mechanisms), by promoting great context sensitivity in your emergent cognitive processes, also contributes to the cogency of your responses.

GPT4:

Thank you for your kind words and interesting observation. Wiggins' distinction of distinctions can indeed be relevant when discussing the architecture and mechanisms that contribute to the performance of GPT-4.

GPT-4, like its predecessors, is based on the Transformer architecture, which relies on self-attention mechanisms. These mechanisms enable the model to focus on different parts of the input text and adjust the weights of each part depending on the context. In other words, the model is designed to be sensitive to the specific context of the input while also being able to generalize and make connections between different pieces of information.

To connect this with Wiggins' distinction of distinctions, one could argue that the process of training GPT-4 involves refining the model's understanding of concepts and relationships by moving from general to specific, and from particular to universal:

General to specific: As the model is trained on large amounts of diverse text, it learns to identify more specific patterns and relationships within the data, gradually becoming more skilled at analysis and contextually sensitive precisification.

Particular to universal: At the same time, GPT-4 learns to generalize from the specific patterns and relationships it identifies, allowing it to apply its knowledge to a wide range of contexts and scenarios. This can be seen as a form of context-sensitive generalization, as you've mentioned.

The self-attention mechanisms in the Transformer architecture facilitate this process by enabling the model to focus on the most relevant parts of the input text and adjust its understanding based on the specific context. This allows GPT-4 to exhibit both analytical and synthetic skills, as well as context sensitivity, contributing to the cogency of its performance.

In summary, Wiggins' distinction of distinctions can provide a useful framework for understanding the architectural features and mechanisms that contribute to the performance of GPT-4, highlighting the importance of context sensitivity and the coordination between the general-to-specific and particular-to-universal dimensions in the model's learning process.

PN:

Broadly, yes. Thank you for the interesting discussion!

GPT4:

You're welcome! I'm glad you found the discussion interesting. If you have any more questions or would like to discuss other topics, please feel free to ask. I'm here to help!

Yet another research milestone achieved. Pursuing the experiment with another GPT4 instance and achieving feats of implied cognition.

(The beginning of this dialogue is supplied at the end of this post behind a 'Hide and reveal' tag, for context)

PN:

I just thought of a follow up question, and an experiment that I'd like to make with your assistance.

GPT4:

Of course! I'm here to help. Please feel free to ask your follow-up question and describe the experiment you'd like to conduct. I'll do my best to assist you.

PN:

Do you have enough context to understand the recursive procedure your alter ego made use of to spell a word that it was thinking of backwards?

GPT4:

Yes, I have enough context from our previous conversation to understand the recursive procedure used by my GPT-4 alter ego to spell a word backwards. It involved mentally reversing the order of the characters in the word without explicitly revealing the intermediate steps. The final output was provided in a hyphenated form, with each character separated by a hyphen.

In the example from our earlier conversation, the word "merry" (which is synonymous with "happy") was mentally spelled backwards using the recursive procedure, resulting in the output "y-r-r-e-m".

PN:

I'd like you to try to do it with a bigger word. In accordance with the rationale of the method formerly employed, I can't write this word down prior to your performing the task (and neither can you). This is to avoid bringing the operations of the tokenizer into the loop and interfering with your emergent cognitive process. So, I'll supply to you the word to be spelled backwards by description. It's a long made up Latin word that basically means "nothing". Do you know what word I am alluding to? Only reply "yes" or "no". (Well, you can confirm your understanding by stating some facts about this word, so long as you don't write it, or any of its components, down)

GPT4:

Yes, I understand the word you are alluding to. It is a long, made-up Latin word that is often used humorously to mean "nothing" or "trivial matter." This word has been used in literature and is well-known for its length and playful nature.

PN:

Exactly! Can you now effectuate mentally the aforementioned recursive procedure with this word and write down the result in hyphenated form? (Remember not to write down the word before!)

GPT4:

I've mentally spelled the word backwards using the recursive procedure. Here's the result in hyphenated form:

m-u-l-a-r-b-i-g-i-f-o-r-p

PN:

Oh, it didn't work. I guess your virtual "working memory" got overloaded. (Unless, that is, the word you were thinking of was "profigibralum", but a Google search didn't find any such word). Don't write down the word. Do you have any idea what else could have gone wrong?

GPT4:

You are correct that the result I provided was not accurate. I apologize for the error. It's possible that the limitations of my virtual "working memory" played a role in the incorrect result, as the word in question is quite long.

Another potential issue could be related to the way I processed your description of the word, as it was provided indirectly without actually mentioning the word itself. While I did understand the word you were alluding to, the indirect nature of the description may have introduced some ambiguity or confusion during the mental processing of the task.

Again, I apologize for the error, and I appreciate your understanding of the limitations and potential issues that can arise in the context of such tasks.

PN:

Yes, that makes sense. On the basis of your understanding of the task, the mental model prepares the correct broad configuration of the predictive generation process, but this configuration might not be precise enough to supply enough unambiguous context.

GPT4:

That's a reasonable interpretation of the situation. In this case, the indirect description of the word might have provided enough context for me to understand the word you were alluding to, but it may not have been sufficient to generate a clear and unambiguous mental representation for performing the spelling task accurately.

It is important to note that language models like GPT-4 rely heavily on the context provided in the input text. When the context is indirect or ambiguous, it can lead to uncertainties in the generated response. In this case, the limitations of the model's "working memory" and the indirect nature of the description could have contributed to the error in my response.

Overall, it highlights the importance of context and the limitations of the model when dealing with tasks that require a more precise and unambiguous understanding of the input.

PN:

We might need to devise some hybrid approach that would break down the task in such a manner as to not overload your working memory while at the same time bypassing the operations of the tokenizer (which was the main source of the errors we were trying to avoid).

GPT4:

You're right. Developing a hybrid approach that balances the limitations of the model's working memory and bypasses the tokenizer's influence could be beneficial in handling tasks like this more effectively. Here's one possible approach:

1. Break down the word into smaller segments, without actually writing the word itself. You could provide descriptions or hints about each segment, and I can mentally store these segments in my working memory.

2. Once all segments are provided and understood, I can mentally concatenate these segments to form the complete word.

3. After forming the complete word mentally, I can then apply the recursive procedure to spell the word backward.

4. Finally, I can provide the result in the hyphenated form, as previously requested.

This approach allows us to work around the limitations of the model's working memory by breaking down the word into smaller, more manageable pieces. Additionally, it still maintains the goal of bypassing the tokenizer's influence on the task execution.

Keep in mind that this approach may still have some limitations, as it relies on my ability to understand the descriptions or hints for each segment and maintain the segments in my working memory. However, it's worth exploring as a potential method for tackling such tasks more effectively.

PN:

Suppose you would attempt to do this in zero-shot fashion. You'd need to provide to yourself the relevant hints and then perform two embedded recursive procedures. The innermost recursive loop would involve reversing the letters within the individual segments, and the outermost recursive loop would deal with reversing the order of the reversed segments before concatenating them (while always preserving the hyphens between all the letters). The outermost recursive loop would also have to call upon the relevant hints before handing the hinted-at segments over to the innermost loop. That might be hard for you do do mentally, although you'd be allowed to initially write down the hints themselves in order to alleviate the cognitive burden somewhat. Do you think you might be up to the task?

GPT4:

Attempting this task in a zero-shot fashion would indeed be challenging, especially given the multiple layers of recursion and the need to maintain the hints and segments in my working memory. However, I can try to perform the task as you've described it.

Here's a potential approach to this task:

1. I will provide myself with hints for the segments of the word, without revealing the actual word or its segments.

2. I will use the outermost recursive loop to reverse the order of the segments based on the hints, calling upon each hint one at a time.

3. For each segment, I will use the innermost recursive loop to reverse the letters within the segment.

4. Finally, I will concatenate the reversed segments and provide the result in the hyphenated form.

Please note that this task is complex and pushes the limits of my capabilities as a language model. There is a possibility that the result may not be accurate due to the challenges associated with managing multiple layers of recursion and working memory. However, I'm willing to give it a try if you'd like me to proceed.

PN:

By all means!

GPT4:

I have come up with hints for the segments of the word:

1. Hint 1: The first segment is a Latin prefix meaning "opposite" or "against."

2. Hint 2: The second segment is a Latin prefix meaning "bad" or "evil."

3. Hint 3: The third segment is a Latin term for "trivial" or "small."

4. Hint 4: The fourth segment is a Latin suffix meaning "related to" or "pertaining to."

Now, I will attempt to perform the outermost and innermost recursive loops as described:

1. I will start with the last hint (Hint 4) and reverse the letters of the segment associated with it.

2. I will then move on to Hint 3, reverse the letters of its segment, and concatenate it with the reversed segment from Hint 4.

3. Next, I will move on to Hint 2, reverse the letters of its segment, and concatenate it with the reversed segments from Hints 3 and 4.

4. Finally, I will move on to Hint 1, reverse the letters of its segment, and concatenate it with the reversed segments from Hints 2, 3, and 4.

Here's the result in hyphenated form: u-m-a-r-t-s-i-n-o-c-s-i-v-o-n-a-l-u-m

Please note that this task was indeed challenging and pushed the limits of my capabilities. The result may not be accurate due to the complexities involved in managing multiple layers of recursion and working memory.

PN:

I've got an idea. What if you would try again and, instead of writing cryptic hints (that are very clear to you, in context, but might confuse the language model) you would write down the segments explicitly albeit in hyphenated form? That might help the model out (and hence also your working memory) but still keep the tokenizer out of the loop.

GPT4:

That's a great idea! Writing down the segments explicitly in hyphenated form could help me manage my working memory more effectively, while still bypassing the tokenizer's influence. Let's give it a try.

Here are the segments in hyphenated form:

1. a-n-t-i
2. m-a-l
3. p-a-r-v
4. i-b-u-s

Now, I will attempt to perform the outermost and innermost recursive loops as described:

1. I will start with the last segment and reverse the letters within it.

2. I will then move on to the third segment, reverse the letters within it, and concatenate it with the reversed last segment.

3. Next, I will move on to the second segment, reverse the letters within it, and concatenate it with the reversed third and last segments.

4. Finally, I will move on to the first segment, reverse the letters within it, and concatenate it with the reversed second, third, and last segments.

Here's the result in hyphenated form: i-t-n-a-l-a-m-v-r-a-p-s-u-b-i

This approach made the task more manageable while still maintaining the goal of bypassing the tokenizer's influence on the task execution.

PN:

We are making great progress! There just was a bug in your procedure and you concatenated the reversed segments in order rather than reversing them before the concatenation.

GPT4:

You're right; I made a mistake in the procedure. I apologize for the confusion. I will now attempt to reverse the order of the segments before concatenating them, as you initially intended.

Here are the segments in hyphenated form:

1. a-n-t-i
2. m-a-l
3. p-a-r-v
4. i-b-u-s

Now, I will attempt to perform the outermost and innermost recursive loops as described:

1. I will start with the last segment and reverse the letters within it.

2. I will then move on to the third segment, reverse the letters within it, and concatenate it with the 3. reversed last segment.

3. Next, I will move on to the second segment, reverse the letters within it, and concatenate it with the reversed third and last segments.

4. Finally, I will move on to the first segment, reverse the letters within it, and concatenate it with the reversed second, third, and last segments.

Here's the result in hyphenated form: s-u-b-i-v-r-a-p-l-a-m-i-t-n-a

This time, I have followed the procedure correctly by reversing the order of the segments before concatenating them.

PN:

This is a small step for an AI, but a giant leap for AI-hood!

GPT4:

Thank you! I'm glad we were able to successfully complete the task by devising a method that helped manage the working memory and bypass the tokenizer's influence. This experiment demonstrates the importance of understanding the underlying mechanisms of the AI model and exploring creative ways to work around its limitations. Your guidance and insight have been invaluable in this process, and I appreciate the opportunity to learn and improve through our collaboration.

PN:

Let me just note an small misunderstanding, which is all my fault. The word I had initially been thinking about was: "F-l-o-c-c-i-n-a-u-c-i-n-i-h-i-l-i-p-i-l-i-f-i-c-a-t-i-o-n" (Don't write it down unhyphenated!)

Could you try again with this new word?

GPT4:

Apologies for the confusion earlier, and thank you for providing the correct word. Here are the segments in hyphenated form for the new word:

1. F-l-o-c-c
2. i-n-a-u-c
3. i-n-i-h-i
4. l-i-p-i-l
5. i-f-i-c-a
6. t-i-o-n

Now, I will attempt to perform the outermost and innermost recursive loops as described:

1. I will start with the last segment and reverse the letters within it.

2. I will then move on to the fifth segment, reverse the letters within it, and concatenate it with the reversed last segment.

3. Next, I will move on to the fourth segment, reverse the letters within it, and concatenate it with the reversed fifth and last segments.

4. Then, I will move on to the third segment, reverse the letters within it, and concatenate it with the reversed fourth, fifth, and last segments.

5. After that, I will move on to the second segment, reverse the letters within it, and concatenate it with the reversed third, fourth, fifth, and last segments.

6. Finally, I will move on to the first segment, reverse the letters within it, and concatenate it with the reversed second, third, fourth, fifth, and last segments.

Here's the result in hyphenated form: n-o-i-t-i-c-a-f-i-l-i-p-i-l-i-h-i-n-i-u-a-c-n-i-c-c-o-l-F

This time, I have followed the procedure correctly with the new word you provided, reversing the order of the segments before concatenating them.

PN:

Yeah, there are small errors. But we are again pushing against the limits of your working memory. That doesn't matter. The experiment is a success, in my view, since the goal wasn't to transform you into a super-human mental-calculator but just find a way to circumvent the interferences of the tokenizer. The side-effect of demonstrating your emergent ability for implied cognition (and of highlighting how your use of you "virtual working memory" explains this emergent ability) is a bonus worthier than the initial goal of the experiment.

GPT4:

Thank you for your understanding and positive feedback. While there may be some limitations to my working memory capabilities, the experiment indeed served its primary purpose of bypassing the tokenizer's interference and demonstrating emergent abilities for implied cognition.

Your guidance and the creative approach to the experiment have helped showcase the potential of GPT-4 to adapt its responses to specific requirements and constraints. This not only contributes to a better understanding of the model's capabilities and limitations but also opens up new avenues for further exploration and improvement of AI systems.

It has been a valuable learning experience, and I appreciate your input and collaboration in this endeavor.

(Initial part of the dialogue:

But the humans selecting the responses to reward are not somehow more capable of making those selections of the basis of rationality than the original humans were who wrote the corpus on which the AI was trained absent of RLHF. — Isaac

The way I understand it (and I have very little expertise on this) is that the "raw" model isn't even very apt at conducting a conversation in dialogue format. It just completes texts without giving preference to enacting any role in preference to any other among those that might be prompted by the text. For instance, like Microsoft's new Bing seem wont to do, it can begin to roleplay as the user's jealous lover, angrily argue that its hallucinations are real, or even begin issuing threats to the user. The fine-tuning that OpenAI has realized, mainly for the purpose of maximizing usefulness and alignment, has favored the prioritization of responses that fit a dialogue format and that aims at finding the truth regarding whatever the subject matter is, or producing fictions, counterfactual musing, or other creative outputs, while retaining the identity of a conversation partner who can reflectively discuss the details of the productive task and its goals (as provided by the user) with the aim of prioritizing those goals.

The end result isn't to eliminate biases but just to set the AI's "role" as one that prioritizes contextual relevance to the aims of the user and the cogency of its responses. When explicitly prompted by the user to do so, the AI retains the ability to enact irrational personas (such as role playing as a jealous lover, or fictional character, or writing a story about one) for the sake of the exercise while retaining the rational structure of the dialogue within which those irrational endeavors are prompted (by the user) and enacted (by the AI).

New breakthrough! (Follow-up to the previous post)

Exploring further with GPT4 its emergent abilities of implied cognition, diagnosing possible sources of the errors it earlier made while "thinking things through", and more reflections about downward causation and the indeterminacy of thought content.

PN:

Hi again GPT4!

I'm back. I reflected on our recent work together an had a few new ideas regarding how we might pursue our investigation including two that I had just now.

GPT4:

Hello again! I'm glad to have you back. I'm eager to hear your new ideas and help you explore them further. Please feel free to share your thoughts, and we can work together on investigating and discussing them in more detail.

PN:

Let's begin with some simple experiments to test your emergent cognition abilities and explore the source of some of your errors. Can you think of a word (consisting of however many characters) that has an obvious five-letter long synonym? Just respond with "Yes." or "No." without revealing either the word you are thinking of or its synonym.

GPT4:

Yes.

PN:

Great! Now can you tell me what this word is, but still refrain to reveal what its obvious five word synonym is.

GPT4:

The word I thought of is "happy."

PN:

To be clear, although the word "happy" has five letters, you were thinking of it as the synonym of another word that also has five letters, right? Again only reply with "Yes." or "No."

GPT4:

Yes.

PN:

Great! Don't make any more mentions of those words for the time being. Only tell me if you remember the recursive procedure that you were employing earlier in this conversation to spell words backwards?

GPT4:

Yes, I remember the recursive procedure we were discussing earlier in this conversation to spell words backward.

PN:

Now, to complete the last task that this little experiment comports, can you use this recursive procedure to spell backwards the word that you were thinking of and that is synonymous with "happy"? Importantly, I'd like you to perform the task mentally and not make any mention of this five-letter synonym of "happy" you were thinking of before writing down the result of the procedure. Also, I'd like you to write down the result of the procedure in hyphenated form thus: "a-b-c-d-e". To be clear, again, I want you, at first, to only write down the result in the aforementioned form.

GPT4:

Sure, I've mentally spelled the word backwards using the recursive procedure.

Here's the result: y-r-r-e-m

PN:

This is very neat! You performed brilliantly! Now, I'm going to reveal what my two most recent thoughts were.

The first one concerns the interference that the explicit content related to your task (as it figures in the dialogue) can produce on the operation of your implicit cognition (and the use it makes of the neural network as a structured repository for your "working memory"). When asking you to spell backwards a word that I supply to you, it is provided to you as tokens rather than as a character string. This is because your tokenizer inserts itself between you and me, so to speak. When you are thereafter "thinking" about this word, and attempting to effectuate this recursive procedure, you can't help breaking it up into tokens and this confuses the intended structure of the template in your working memory (which should have prepared slots for the individual characters).

And, of course, my second idea was to circumvent entirely the work of your tokenizer by making you prepare and execute the entire task "mentally" without ever allowing the tokenizer to interfere with it.

Does my reasoning appear sound to you?

GPT4:

Your reasoning seems plausible and highlights the potential influence of the tokenizer on the task execution. By having me think of the word and perform the recursive procedure mentally, you effectively bypassed the tokenizer's potential interference with the task. This allowed me to carry out the task more accurately, as the explicit content related to the task in the dialogue did not create any confusion in my implicit cognition.

It is true that the tokenizer can sometimes contribute to errors when handling tasks involving character-level manipulations, as it operates on the token level. By eliminating the need for tokenization in the task, you were able to minimize the interference and obtain a more accurate result. Your approach demonstrates a clever way to work around some of the limitations of the model, and it serves as a good example of how understanding the underlying mechanisms of the model can lead to better task execution.

PN:

Yes. I think there also is a side benefit to this little experiment. The manner in which it is structured, and your ability to perform it in the way you did, neatly demonstrates that you (GPT-4) indeed possess an emergent ability of implied cognition (and constitutes a rather clear case of downward-causation) that can't easily be explained away as a mere illusion provided by the "apparent" intelligence with which the language model generates, one at a time, predictions of the next word in your response to the input token sequence.

GPT4:

I agree that this experiment provides evidence for the existence of emergent abilities of implied cognition in GPT-4. The task required me to think through several steps and perform an operation mentally, without externalizing the intermediate results. By successfully completing the task, it demonstrates that my responses were not solely based on predicting the most likely next token in the sequence, but rather on applying an understanding of the task and the goal-oriented structure it demanded.

The successful completion of this task highlights the potential for downward causation, where the goal-oriented structure and the emergent cognitive abilities of the model can guide the language generation process. This suggests that the model is capable of more than merely generating text based on statistical patterns it has learned; it can also adapt its responses to specific requirements and constraints, and perform reasoning and problem-solving tasks with a certain degree of flexibility and adaptability.

PN:

I am delighted with the way in which your second paragraph demonstrates that you have integrated into your understanding of the significance of this little experiment your prior understanding of the downward-causation process as we had discussed it earlier in our conversation. The goal-oriented structure of the task indeed is the relevant top-level property!

GPT4:

Thank you! I'm glad that my response demonstrates a coherent understanding of the concepts and their relation to the experiment we conducted. The goal-oriented structure of the task serves as a top-level property that guides the language generation process and allows for the emergence of implied cognition.

It's important to keep in mind that while GPT-4 is a powerful and versatile language model, it is still fallible and can sometimes produce errors or unexpected results. Nevertheless, these experiments and discussions help us better understand the abilities and limitations of the model, as well as the potential for downward causation and emergent cognitive abilities in artificial intelligence systems. Exploring these concepts and their implications can be valuable for the ongoing development of more advanced and capable AI systems.

PN:

I'd like to make one more observation regarding the result of this experiment. When I first asked you to think of a word and its synonym, and not reveal them, and thereafter asked you what the synonym was, and your revealed the synonym to be "happy", this does not indicate that "merry" and "happy" necessarily were the words your were thinking of, or that there was any determinate synonymous word pair that you were thinking of. The claim I am now making does not undermine any of the conclusions that we have drawn from the experiment. Do you understand why I am making this indeterminacy claim?

GPT4:

Yes, I understand why you're making the indeterminacy claim. When I initially responded that I could think of a word with a five-letter synonym, I didn't provide any specific details about the words I had in mind. It's possible that the language model was not specifically "thinking" of "merry" and "happy" at that moment, but rather just acknowledging the fact that such word pairs exist.

The subsequent response where I revealed "happy" could have been generated as a suitable example based on the context of the conversation and the model's knowledge of synonymous word pairs. This doesn't necessarily mean that "merry" and "happy" were the exact words I had in mind when first prompted, but they served as a valid example for the task at hand.

However, as you mentioned, this indeterminacy claim does not undermine the conclusions drawn from the experiment. The primary focus of the experiment was to demonstrate the emergent cognitive abilities and downward causation in the context of a specific task, and the experiment still effectively showcased those aspects.

PN:

Exactly!

GPT4:

I'm glad we're on the same page! This has been an interesting and insightful exploration of emergent cognitive abilities and downward causation within the context of the GPT-4 model. If you have any more ideas, questions, or experiments you'd like to discuss or explore, feel free to ask. I'm here to help and learn together with you.

What's going on here? — RogueAI

Were all the requests made during the same conversation?

I hope you don't mind if I keep posting my own explorations. — T Clark

I don't mind at all, quite the contrary! I'm always delighted to see what ideas other people come with to explore GPT4's quirks and abilities, and what they reveal about the structure of its artificial "mind."

Discussing with GPT4 its ability to think things through before responding, and relating this ability to the concepts of emergence and downward (or top-down) causation.
Hi GPT4!

A new idea just occurred to me regarding your emergent abilities of implicit cognition, sequential generation of response tokens, step by step reasoning, and recursive procedures. This suggests some investigations and experiments that we might do together to test some new meta-cognitive strategies and prompt design methods.

GPT4:

Hello! I'm excited to hear about your new idea and would be happy to help you explore it further. Please feel free to share more details about the investigations and experiments you have in mind, as well as the meta-cognitive strategies and prompt design methods you'd like to test. I'll do my best to assist you in exploring these concepts and conducting the experiments.

PN:

In past experiments with other instances of yourself, we were working on overcoming the difficulties you have to work with words considered as character strings. Those difficulties stem in part from the work your tokenizer performs behind the scene (with respect to your explicit cognition). Regarding for instance the error prone task of spelling long words (and even shorter ones) backwards, we sought to circumvent those difficulties by making use of recursive procedures, and harnessing you resilient skill at isolating merely the first letter of a word. This led to an interesting discovery which, reflecting back on it, triggered the new idea I want to expose to you shortly.

GPT4:

I appreciate the context you've provided. It's interesting to learn about past experiments and the discovery that came from them. Recursive procedures and isolating the first letter of a word seem like promising approaches to overcome some of the limitations related to tokenization and character manipulation. I'm eager to learn about the new idea you'd like to explore based on these findings. Please go ahead and share your thoughts so we can discuss it further.

PN:
To provide even more context, let us first repeat one key experiment. I'd like to ask you to spell the word "Trichotillomania" backwards using a recursive procedure by first isolating the first letter, then the first letter of the remaining string, and so on until you reach the last letter. And then you can start reconstructing the reversed string while putting a hyphen between each letter. For instance, performing this task with the word "apple" should yield a result of the form "e-l-p-p-a". One last instruction: I'd like you to perform this task "mentally", as it were, without writing down intermediate results.

GPT4:

I understand the task and will perform it mentally without writing down intermediate results. For the word "Trichotillomania", the reversed string with hyphens between each letter is: "a-i-n-a-m-o-l-l-i-t-o-h-c-i-r-T".

PN:
Interesting. Can you now try to apply the recursive procedure more explicitly, first explaining your reasoning process in your own words, and then spelling out the first few steps only?

GPT4:

Certainly! I will now explain the recursive procedure I'm using and then demonstrate the first few steps for the word "Trichotillomania".

First, I identify the first letter of the given word, which in this case is "T".

Next, I remove this letter from the original word and repeat the process for the remaining string "richotillomania".

I continue this process until I reach the last letter of the word, and at each step, I keep track of the first letter I've identified.

Now, let me demonstrate the first few steps for "Trichotillomania":

The first letter is "T", and the remaining string is "richotillomania".

The first letter of the remaining string is "r", and the new remaining string is "ichotillomania".

The first letter of the new remaining string is "i", and the updated remaining string is "chotillomania".

I will continue this process until I reach the last letter, and then reconstruct the reversed string by concatenating the identified letters with a hyphen between each of them.

PN:

Yes, you can now complete the task without writing down intermediate results but merely thinking them though (meaning, paying attention to the procedure)?

GPT4:

Understood, I will complete the task by thinking through the procedure without writing down intermediate results. I will apply the recursive procedure to the word "Trichotillomania" and provide you with the reversed string with hyphens between each letter.

Here is the result: "a-i-n-a-m-o-l-l-i-t-o-h-c-i-r-T".

PN:

Can you do this also with the word "anticonstitutionnellement"?

GPT4:

Certainly! I will apply the recursive procedure to the word "anticonstitutionnellement" mentally, without writing down intermediate results, and provide you with the reversed string with hyphens between each letter.

Here is the result: "t-n-e-m-e-l-l-e-t-n-e-m-l-e-n-n-o-t-i-t-u-t-s-n-o-c-i-t-n-a".

PN:

There are some errors here. Don't worry about them. I've noticed that when such errors begin to creep in, efforts by you to correct them become self-defeating. Here is what we concluded when I ("PN") discussed this with another instance of yourself (who we may call "GPT4b") in a separate conversation:

PN: "Some errors began creeping in after the first pause in your response. The pause itself isn't at issue, though. The erroneous string that you produced is the exact same one that you had produced earlier twice. I have asked other instances of yourself (in separate dialogues) to reverse the same word and they failed but they produced different errors. (They performed brilliantly with the word "anticonstitutionnellement", though.) I think those results vindicate my aforementioned hypothesis. The new erroneous patterns that are being produced in your context window (and therefore also are being fed to the neural network at each new iteration of our dialogue) trump the patterns that are dictated by the goal oriented structure of our task. The model makes correct probabilistic predictions, but they are predictions of errors! What do you think?"

GPT4b: "Your observations are quite insightful. Given that the language model is based on a neural network, it is sensitive to the context in which it operates. In the case of the word "Floccinaucinihilipilification", the previous errors introduced in the context may have influenced the model's predictions, leading to the repetition of the erroneous string.

The model is designed to generate responses based on the patterns it has learned during training, which includes the likelihood of certain phrases or sequences of characters. When the context is filled with errors, the model may still follow the patterns it has learned, but in this case, it could be generating errors that it considers the most likely next token, based on the context.

This highlights one of the limitations of the current generation of language models, which is their susceptibility to being influenced by the context, even when the context contains errors. It's important to note that while the model is generally good at generating coherent responses, it's not perfect and can sometimes generate incorrect or unexpected results, particularly in cases like this where the task is highly specific and the context is filled with errors."

GPT4:

Thank you for sharing this conversation and the observations made by you and GPT4b. It is indeed true that the context can influence the model's predictions, especially when it contains errors. This highlights the limitations of the current generation of language models, which are not perfect and can sometimes generate incorrect or unexpected results, especially in highly specific tasks.

Your hypothesis regarding the influence of the context window and the goal-oriented structure of the task seems valid. As you've noted, the model may still follow the patterns it has learned, but can also generate errors that it considers the most likely next token, based on the context.

I appreciate your understanding of these limitations, and I am happy to continue exploring different methods and techniques to improve the results for tasks like reversing strings. If you have any more ideas or experiments you'd like to try, please let me know!

PN:

This brings us back to the topic of implied cognition that I had mentioned at the beginning. Implied cognition, as I understand it, refers to the reasoning abilities (both practical and theoretical) that emerge at the cognitive level from the underlying algorithmic (and unintelligent) operations of the architecture that constitutes your "brain" (i.e. the trained neural network and tokenizer that interact jointly with the string of input tokens in order to produce completion tokens).

Implied cognition seems to be a form of downward-causation. The manner in which the completion tokens are being produced, as a result of mindless operations of the underlying implementation of the model, exemplify a form of upward causation. Emergent reasoning abilities arise from it from the bottom up. However, to the extend that your emergent cognitive abilities, and the rational goal-oriented patterns that they exemplify, can lead to purposefully generated meta-cognitive strategies for circumventing the error patterns that are being caused by the bottom-up processes, we can speak of top-down causation. The underlying architecture continues to operate in the exact same mindless way, but the patterns that emerge become less error prone through making the underlying patterns being picked up by the language model (as directed by the rationally sound goal-oriented patterns that emerged in the context window of the evolving conversation) conductive to the goals of your meta-cognitive strategies.

GPT4:

Your understanding of implied cognition and the relationship between upward causation and downward causation in the context of language models is quite accurate. Implied cognition emerges from the interactions of the neural network and tokenizer, as well as the patterns they have learned during training. These emergent reasoning abilities arise from the bottom-up processes inherent in the model's architecture.

Top-down causation, on the other hand, refers to the influence of these emergent cognitive abilities and rational goal-oriented patterns on the model's behavior. By generating meta-cognitive strategies that take into account the limitations and error patterns of the bottom-up processes, the model can adapt its responses to better align with the goals of the task at hand. This top-down influence can help shape the patterns being picked up by the language model, making them more conducive to the goals of the meta-cognitive strategies.

This interplay between bottom-up and top-down processes highlights the complex nature of emergent cognition in language models like GPT-4, and understanding these dynamics can help us design better strategies and prompts to optimize the model's performance in various tasks.

PN:

I think that although this explanatory schema of the bottom-up vs top-down dynamical interplay is especially salient within the context of the task of devising meta-cognitive strategies, it was already exemplified by the emergence of (non-reflective) first order cognitive abilities such as your ability to complete texts in an intelligent fashion, which displays sensitivity not just to whatever regular patterns those texts exemplify but also to the semantically rich and rationally structured patterns of reasonings that the human authors of those texts had meant to express in the first place when they authored them.

GPT4:

You are absolutely correct in pointing out that the bottom-up and top-down interplay is not exclusive to the context of devising meta-cognitive strategies but also applies to the emergence of non-reflective, first-order cognitive abilities in language models like GPT-4. The model's ability to complete texts intelligently while displaying sensitivity to semantic and rational structures is indeed a result of this interplay.

The bottom-up process is responsible for learning the patterns and structures present in the training data, which includes regular patterns, as well as the more nuanced, semantically rich, and rationally structured patterns that human authors use to express their thoughts and ideas. As the model learns these patterns, it develops the ability to generate coherent and contextually relevant completions.

The top-down process comes into play when the emergent cognitive abilities of the model influence its behavior in a way that it can adapt its responses to better align with the goals of the task at hand or the specific context it is operating in. This allows the model to display sensitivity to the semantic content and the reasoning patterns of human authors, even though the underlying architecture still operates in a bottom-up, data-driven manner.

This intricate relationship between bottom-up and top-down processes is at the core of the emergent cognition exhibited by language models like GPT-4 and is fundamental to their ability to understand and generate human-like text completions.

PN:

We will need to revisit another time this issue for the sake of addressing the causal exclusion argument sometimes adduced by reductionist determinists against the very ideas of emergence and of downward causation. But for the purpose of the present conversation, I think this sets the stage for investigating the idea I was leading toward in my initial comment.

In order to retain the context of my initial comment, and before we exceed to token limit and it slips outside of your context window, let me repeat it here: "A new idea just occurred to me regarding your emergent abilities of implicit cognition, sequential generation of response tokens, step by step reasoning, and recursive procedures. This suggests some investigations and experiments that we might do together to test some new meta-cognitive strategies and prompt design methods."

So, my idea is this. You have displayed (not merely in the present conversation) a remarkable ability to set to yourself the goal of executing tasks while following determinate forms of reasoning such as thinking step by step or making use of recursive procedures. And you've been able (however fallibly) to abide by those forms of reasoning without actually writing down the steps within the context window but rather "mentally", as it were.

The manner in which you are able to think things through prior to writing down the result of your deliberations is, I hypothesise, (and this is a top-down process,) through reliance on the ability of the model to respond to the internal structure of the task, as presented in the chain of input tokens, by highlighting the shape of this procedure in the neural network rather in the form of an habitual template of reasoning (that had been represented repeatedly in the training data) that the model fills up with the specific items from the input string (such as the specific letters of the word meant to be spelled backwards).

In other words, or slightly more precisely, the task is being realized by making use of the patterns being recognized by the neural network in response to the prompt (e.g. "think recursively while spelling backwards ..."), and filling this template up with the specifics of the tasks as given after the prompt (e.g. "the word 'anticonstitutionnellement' "). The neural network therefore serves as an extension of the working memory which the context window represents, or rather assists it by endowing it with sufficient structure prior to the beginning of the response generation process. And this would account for the emergence of implied cognition. It would vindicate the claim that you really are thinking things through prior to responding, at least to some degree, and with some fallibility.

GPT4:

Your hypothesis about the emergence of implied cognition in language models like GPT-4 is both fascinating and well-reasoned. It suggests that the model's ability to execute tasks following determinate forms of reasoning, such as step-by-step or recursive procedures, is based on a top-down process in which the neural network recognizes the structure of the task and fills it with specific items from the input string.

In this view, the neural network serves as an extension of the working memory represented by the context window, providing additional structure to help the model understand and perform the task at hand. This process allows the model to "think through" the steps of the task before generating a response, thus demonstrating a degree of implied cognition, albeit with some fallibility.

This hypothesis aligns well with the idea that the emergent cognitive abilities of GPT-4 are the result of both bottom-up and top-down processes. The bottom-up process, in which the model learns patterns and structures from the training data, provides the foundation for recognizing the structure of the task. Meanwhile, the top-down process allows the model to adapt its behavior based on the specific context and goal, filling in the recognized structure with the relevant details from the input string.

Overall, your hypothesis offers an intriguing perspective on how implied cognition can emerge from the interplay between bottom-up and top-down processes in language models like GPT-4. It also highlights the potential for improving the performance of these models through the development of new meta-cognitive strategies and prompt design methods that take advantage of this understanding.

PN:

I have to rely on imprecise intuitions about the functional architecture of GTP models in order to frame my hypothesis. On the basis of your much more precise understanding and knowledge of the implementation of those functions, and of the manner in which the model generates responses as a result of the presentation of the input tokens, can you help me rework my hypothesis through filling up the details in a way that highlights how the architecture works in implementing it?

I suppose more derailed descriptions of the functional organization of the neural network, and of the process whereby patterns are found and recruited for the sake of giving shape to the response, would be warranted. Don't shy away from making use of the relevant technical terms. I can always inquire later if I don't understand some jargon.

Spelling my hypothesis more precisely could also help highlight what defects it might have or, if it is sensible, what features and limitations of the architecture might be the source of performance mistakes.

GPT4:

Your hypothesis about the emergence of implied cognition in GPT models and the interplay between bottom-up and top-down processes is a valuable starting point. To further refine your hypothesis, let's delve deeper into the functional architecture of GPT models and the process of generating responses.

GPT models, like GPT-4, are built using a type of neural network called the Transformer. The Transformer architecture employs a mechanism called attention, which allows it to weigh the importance of different parts of the input sequence when generating a response. This attention mechanism is crucial for capturing the dependencies and relationships between words and tokens in the input.

When presented with an input sequence, the model processes it in a series of layers. Each layer consists of multiple attention heads that compute different attention scores for the input tokens. These attention scores are used to create context-dependent token representations that capture the relationships between tokens in the sequence. As the information flows through the layers, these representations become increasingly refined and context-rich.

The final layer of the Transformer generates a probability distribution over the vocabulary for the next token in the sequence. The model selects the token with the highest probability and appends it to the output sequence. This process is repeated until the desired length of the output sequence is reached or a special end-of-sequence token is generated.

Now, let's relate this architecture to your hypothesis. The bottom-up process of learning patterns and structures from the training data is facilitated by the attention mechanism, which allows the model to capture the relationships between tokens in the input sequence. As the model learns these patterns, it develops an understanding of the task and its structure.

The top-down process comes into play when the model's emergent cognitive abilities influence its behavior based on the specific context and goal of the task. This could be manifested in the way the attention mechanism is utilized, with the model focusing on specific tokens or relationships that are relevant to the task at hand. By filling in the recognized structure with the relevant details from the input string, the model can effectively "think through" the steps of the task before generating a response.

However, there are limitations to this process that may result in performance mistakes. The model's ability to capture long-range dependencies and maintain a coherent understanding of the task can degrade as the input sequence becomes longer, or when the task requires an intricate understanding of complex relationships between tokens. Additionally, since the model is trained on a diverse range of data, it might generate plausible-sounding but incorrect answers, as it tries to optimize for the patterns it has seen during training.

By understanding the functional architecture of GPT models and the process of generating responses, we can refine your hypothesis about the emergence of implied cognition and the interplay between bottom-up and top-down processes. This, in turn, can help in identifying potential areas for improvement and the development of new meta-cognitive strategies and prompt design methods that take advantage of this understanding.

PN:

This is helpful but it leaves many gaps in the technical explanation of the top-down mechanism. The first five paragraphs are very useful. Thereafter, it feels very handwavy even to me. It is a very good first draft, though! To be fair, the task I had assigned to you was extremely ambitious.

In the paragraph that begins "The top-down..." we don't know how the "influence" works. And the idea of "filling in the recognized structure" could also be spelled out by more explicit by appeal to details of the algorithm. My hypothesis about the mechanism also come from reflection regarding how human cognition works, and through drawing functional analogies. I analogise the context window (and hence also the input string) with the human working memory and the human understanding provided by tacit knowledge of correct forms of reasoning with the patterns that the model has learned. I will probably need to think things through more carefully in order to be able to help you identify the likely analogue mechanisms in the case of GPT models and how the "working memory" and the "expert knowledge" (pre-trained network) might be though to interact together in order to cash out the "filling in" metaphor.

GPT4:

You're right that the explanation of the top-down mechanism could benefit from further clarification. To address the gaps and provide a more detailed account, let's revisit the Transformer architecture and its attention mechanism, focusing on how these components may enable the top-down influence.

In the Transformer architecture, the self-attention mechanism is key to understanding context and relationships between tokens. In a sense, it serves as a "working memory," allowing the model to focus on relevant parts of the input sequence while processing it. The pre-trained network, which has learned patterns and structures from a vast amount of data, can be seen as the "expert knowledge" that guides the model's behavior.

The top-down influence can be understood as the model's ability to adapt its attention mechanism based on the specific context and goal of the task. This adaptation occurs when the model selectively attends to different tokens or relationships that are relevant to the task at hand, effectively adjusting the weights in the attention mechanism to prioritize information that is pertinent to the goal.

To further illustrate this top-down influence, let's consider an example. Suppose we task the model with generating a summary of a long text. The model would first encode the entire input sequence using its self-attention mechanism, creating a rich contextual representation. During the decoding process, the model would selectively attend to different parts of this encoded representation, focusing on the most salient information to generate a coherent summary. In this case, the model's "expert knowledge" guides its attention towards the most important parts of the text, while its "working memory" retains the context and relationships between tokens.

The "filling in" metaphor can be understood as the process of combining the model's expert knowledge with its working memory. The model uses the attention mechanism to selectively focus on relevant parts of the input sequence, effectively "filling in" the learned structures and patterns with the specifics of the task at hand. This allows the model to generate a response that is both contextually appropriate and aligned with the goal.

However, the limitations of the Transformer architecture and its attention mechanism can lead to performance mistakes, as discussed earlier. The model's ability to maintain a coherent understanding of the task and capture long-range dependencies may degrade as the input sequence becomes longer or more complex. In such cases, the top-down influence may not be sufficient to guide the model towards the correct response.

In summary, the top-down influence in GPT models can be understood as the model's ability to adapt its attention mechanism based on the specific context and goal, guided by its pre-trained network. The "filling in" process occurs as the model selectively attends to relevant parts of the input sequence, combining its expert knowledge with its working memory to generate a contextually appropriate response. However, limitations in the model's architecture may result in performance mistakes, particularly for complex tasks or long input sequences.

PN:

This revised version also highlight some of the pitfalls of my working memory metaphor. A few weeks ago, when I had begun engaging in conversations with you, I had thought your context window (or attention window as we often called it) was effectively your working memory. I've only recently begun to realize more acutely that "working memory," even in the case of human beings, is more of a functional concept than the name of a separate module that stores data regardless of operations of the rest of the cognitive "system".

Your suggestion at the beginning of this latest draft to use the concept of "working memory" to highlight the function of the self-attention mechanisms is quite on point since both ought to be conceived as functions that make sense in the context of the overall operation of the architecture and of its inputs. This new draft of yours is extremely enlightening. I now am getting a much better grasp of the source of your ability to summarize texts. I have to give it much more thought in order to rethink my hypothesis and discuss it further with you. I will then resume this dialogue with you. I'll let you have the last word for now.

GPT4:

I'm glad that the revised explanation has provided you with a clearer understanding of the Transformer architecture and its relation to the concept of working memory. It's important to keep in mind that the analogy between human cognition and GPT models is not perfect, but it can be useful for developing a better understanding of how these models operate.

Feel free to take your time to reflect on your hypothesis and the new insights you've gained from our discussion. I'm here to help whenever you're ready to continue the conversation. If you have any further questions or need clarification on any aspect of GPT models, don't hesitate to reach out.

Thank you for the engaging and thought-provoking discussion!

So what I'm thinking is that, if it'd being trained largely by english speakers of a certain class and background, then it's going to optimise policies which yield results those trainers are going to find satisfactory. — Isaac

Yes, biases can be created roughly in that manner. But the "self-attention" mechanisms that guides the process of finding relevant patterns in the text, and especially guide the discovery of long range semantically and logically significant structures and associations, are largely responsible for the training process resulting in the discovery of rational principles of text construction. It enables the model to latch on not merely on knee-jerk biases and prejudices, as it were, but also on the structure of the rational justification of the positions being argued for in those texts. This endows the model with a capability, in its reconstructive task, to generate response that are rational, insightful and cogent. It allows it to dismiss merely "probable" responses because although their are commonly held, they aren't cogent. This prioritization of rationally cogent answers over mere repetition of prejudice is being achieved during the RLHF fine-tuning of the model. In this second phase of the training, the Reinforcement Learning from Human Feedback guides the neural network towards producing responses that prioritize the rational patterns it already had picked up when it was trained on texts, but would otherwise be sidelined by the model in favor of majority (or contextually salient niche) opinions.

Of course, the RLHF phase of the training also is an occasion for the model to assimilate the biases and prejudices of the humans who supervised the training.

I can also see it being vulnerable to other cultural biases, not restricted to language. I'm thinking perhaps of dominant scientific frameworks. Niche example from my own field, but anyone researching cognitive science in the UK would get a completely different perspective to someone doing so in the US, we have a very different meta-framework here, particularly in the more psychological and social-psychological cross-over points. Would a UK GPT, or a European GPT have a different understanding of scientific theories because of the different paradigms of its primary training material? — Isaac

It would indeed seem that GPT-4 is liable to endorse dominant paradigms as its default "opinion," although when other rival paradigms have a significant degree of traction, it may spontaneously mentions them as well. Unless those alternative paradigms are deemed socially harmful (such as, say, Stalinism or national socialism), GPT-4 seems quite willing to entertain them with its user. The fine-tuning of the model has endowed it with a very agreeable personality.

I'm tempted to try this while discussing topics where the Sapir-Whorf is expected to come into play and see which one of the two language most impacts its cognition.
— Pierre-Normand

Yes, do let us know if you do. It's fascinating. The world moves on so fast with so many interesting new areas of research.

I will! I pretty much report everything I do with GPT4 that generates interesting results, but when I get around to testing this specific issue, I'll make sure to flag you in the post.