• AlienVareient
    16
    This is sort of a rant and might not be so coherent compared to other posts. I just want to see some opinions on it. If you don't wish to read a rant, simply scroll away.

    Recently, there has been some news going around about a 14-year-old boy committing s----de after seeking solace in a chatbot on c.ai . I won't go into much detail on that since there is a lot of information online about that incident. It's normal to talk to chatbots bow, but I feel uncomfortable when the bot itself turns sexual, unlike others. I understand the appeal in it, but like, it gets gross because not everything needs to be sexualized, but yet again look at most pop songs today. It makes me wonder about the future the first time I began to worry more than I usually do about the future was back in 2022 when the AI models were still fairly new to the public.

    Truth be told I was naive and ended up watching those fear-mongering videos about AI with clickbaity titles like 'Sam Altman predicts AGI by 2027' and "It's gotten a lot worse" etc, etc. Looking back, it was dumb to believe those sorts of things, but yet again, that was a new form of technology, at least to me. I know AI was developed way back in the 1960s or something, so it's not entirely brand new. But like, where does this technology keep going? They keep saying it will improve our lives, and lead us to an utopia, but I don't see that. It might be an utopia to them, but not to most of the population.

    In my own personal experience, these chatbots sort of ruined my life. It's like an addiction, just keep fishing for the perfect response, the perfect diction. I'm saying 'it's' because I its something I still deal with it, but it's getting better, slowly but surely. As I was saying, it did ruin my life, I was glued to my phone, lost hours of sleep over it, my social life declined and I suffered greatly. Over time, fortunately, I realized I missed all the simple things I had done before, like going on walks or playing with my dogs. The craving to experience those wonderful things again really helped me get out of that addiction. Even though they were the few small things I depended on for my fulfillment other than the chatbots, it was better than nothing. I still do engage with the chatbots, but less frequently than I used to.

    It's common for a person to develop a a parasocial relationship with a celebrity, but it's also common nowadays to have a parasocial relationship with a chatbot, something fictional, or artificial. But most people don't recognize the ones with AI chatbots and AI girlfriends because they brush it off as incel behavior. But it's something many people do. Many people nowadays depend on a chatbot for connection. But I can't see why people don't recognize it as a problem. Why don't they? Other than destroying people financially by taking their jobs, it could also destroy them mentally, in the case of a 14-year-old boy.

    It just makes you think, y'know?
  • unenlightened
    9.2k
    I didn't know this was even a thing. I went looking for the story...

    Garcia attorneys wrote in a press release that Character.ai “knowingly designed, operated, and marketed a predatory AI chatbot to children, causing the death of a young person”. The suit also names Google as a defendant and as Character.ai’s parent company.
    https://www.theguardian.com/technology/2024/oct/23/character-ai-chatbot-sewell-setzer-death

    Alas, young people are vulnerable, and legislators are old and out of date, (like me). So exploitation can run free. Well I hope you can see that here at pf. is some harmless, perhaps even beneficial, interaction with real people. The world needs a century or two to catch up with all the novelty of the virtual world; our legal and moral sensibilities cannot adapt so fast as the technology.

    So now you have drawn our attention to this, What do you think might be done about it? AIs are very quick and smart, but they have no intelligence or discrimination. I don't think anyone is entirely sure how to prevent such things without crippling the beasts entirely.
  • Christoffer
    2k


    As long as children get exposed to the chaos of social media and online discourses, the fractured experience of life throws them in all sorts of directions. Scientific research on the behavioral and psychological damage that children get from modern online life is too slow to catch what's going on, chat-bots being just one of many areas showing.

    For starters, I think that smart phones and online gaming should be banned for children up to 15 years of age until research have conclusions to build legislations on.

    The intellectually sloppy parents who just throw an iPad into the hands of their children aren't equipped to understand the consequences and since everyone is doing it, children will just pressure parents into compliance if they didn't expose them to the technology. Laws against this would fix this, at least temporary.
  • AlienVareient
    16
    makes me think that they didn't even learn the consequences of letting young people get internet access from gen z. Many people are addicted to porn and are degenerates because of their exposure to things at a young impressionable age. The internet is indeed more regulated now but you can still find stuff if you're looking for it
  • AlienVareient
    16
    What I think can be done about it? Well, I have a few things to say about it. Bringing awareness to the incident can wake some people up from their daze of using c.ai and other popular chatbots, encourage interacting with the real world and marketing it as a "rebellion against tech dystopia" since rebelling in any sense is eye-catching, and well, letting knowledgeable, and qualified people make regulations against the developing technology... but we all know they won't do that. At least not voluntarily. God, being a tech geek myself sometimes I hate technology. Sometimes I wish a digital "Animal Farm" revolution would happen for those who aren't so poisoned and dependent on the AI technology like ChatGPT, and the ending would not be like in the book but like a changed society Sometimes dreaming makes my mental health better. Wait I think that's called being delusional. Damn
  • Jack Cummins
    5.3k

    I feel despondent about AI too and feel my life is ruined by it too. Generally, I like to keep up to date with the latest technology and the internet. However, AI has just gone so far. In Britain everything seems to be done by AI almost as if people are redundant. This is affecting the world of work so much and making it so hard to find suitable work for many. It is also being used in an invasive way as a form of almost 'totalitarian' monitoring and control.
  • AlienVareient
    16
    It's like George Orwell's 1984 was a handbook but it was warning :cry:
  • Jack Cummins
    5.3k
    I reread Orwell's '1984' recently and it does seem that what he spoke about has come true, almost like a self-fulfilling prophecy. But, what I find worse is that so many people don't seem bothered in the least, as if they find that 'Big Brother' is a protective force. Also, it seems that so many see AI as if it an all-wise benevolent system, like gods or God.
  • jkop
    900
    We don't need to live our lives via electronic screens, and lots of people don't. There are many interests and professions in which one does not work via electronic screens. Meet real people, animals, the natural world is far more interesting than electronic simulations.
  • AlienVareient
    16
    that is true, but sometimes it feels inescapable because of how it is integrated into some of our lives unwillingly.
  • Athena
    3.2k
    Truth be told I was naive and ended up watching those fear-mongering videos about AI with clickbaity titles like 'Sam Altman predicts AGI by 2027' and "It's gotten a lot worse" etc, etc. Looking back, it was dumb to believe those sorts of things, but yet again, that was a new form of technology, at least to me. I know AI was developed way back in the 1960s or something, so it's not entirely brand new. But like, where does this technology keep going? They keep saying it will improve our lives, and lead us to an utopia, but I don't see that. It might be an utopia to them, but not to most of the population.AlienVareient

    In the US we fought the American Revolution against Britain's monarchy. Our Declaration of Independence could also be called a Declaration of Responsibility. The Enlightenment and improvements in math and science led people with means to believe we could create a better reality, and we have.

    AI could not do what humans have done. But neither can the people educated for technology instead of having a liberal education. Without liberal education, we are lost and don't have a map for a better future, so we are willing to give up our individual power and liberty, to be ruled by AI. We are creating a robotic/mechanical nightmare that crushes individual power and liberty. I don't this will become a utopia.
  • AmadeusD
    2.6k
    This seems a bit of a moral panic to me...
  • Athena
    3.2k
    I reread Orwell's '1984' recently and it does seem that what he spoke about has come true, almost like a self-fulfilling prophecy. But, what I find worse is that so many people don't seem bothered in the least, as if they find that 'Big Brother' is a protective force. Also, it seems that so many see AI as if it an all-wise benevolent system, like gods or God.Jack Cummins

    Without education for higher-order thinking skills, we are not exactly thinking. We are reacting to stimuli just as animals do. To rapidly advance technology, we gave up education for independent thinking and replaced it with memorization and proceeded to prepare our young for industry. An education that has very little to do with being humans.

    Christianity teaches people to be dependent on God. How different is that from being dependent on AI?
  • AlienVareient
    16
    well, that was in the past. Maybe I was : /
  • Jack Cummins
    5.3k
    I agree that Christianity discouraged independent thinking. AI may result in the same kind of robotic dependency, even if based on rationality as opposed to the emotionality of religion. The problem which I see is that AI is not likely to develop the wisdom and insight of lived experience. Al lacks sentience and personal experiences of suffering. Its intelligence is not consciousness itself and cannot have 'eureka' moments of awareness or enlightenment.

    AI has no soul or self, whether that is defined in terms of an entity or the depths of what it means to be human. In a way, that could mean that AI is 'spirit', for worse or better, disembodied and remote from the needs of humans and living beings. Would it mean it understands such needs more objectively or in a too detached way?
bold
italic
underline
strike
code
quote
ulist
image
url
mention
reveal
youtube
tweet
Add a Comment

Welcome to The Philosophy Forum!

Get involved in philosophical discussions about knowledge, truth, language, consciousness, science, politics, religion, logic and mathematics, art, history, and lots more. No ads, no clutter, and very little agreement — just fascinating conversations.