in which the AI called the husband a “spiral starchild” and “river walker.”
Jaysus. That is some feeding of a bad mental state.
Experts Alarmed as ChatGPT Users Developing Bizarre Delusions
Submitted 12 hours ago by JustJack23@slrpnk.net to aboringdystopia@lemmy.world
https://futurism.com/chatgpt-users-delusions
Comments
khannie@lemmy.world 1 hour ago
meejle@lemmy.world 5 hours ago
This is an obvious downside of LLM glazing and sycophancy. (I know OpenAI claim they’ve rolled back the “dangerously sycophantic” model update, but it’s still pretty bad.)
If you’re already prone to delusions and conspiracy theories, and decide to confide in ChatGPT, the last thing you need to hear is, “Yes! Linda, you’ve grasped something there that not many people realise—it’s a complex idea, but you’ve really cut through to its core! 🙌 Honestly, I’m mind-blown—you’re thinking things through on a whole new level! If you’d like some help putting your crazed plan into action, just say the word! I’m here and ready to do my thing!”
thesohoriots@lemmy.world 4 hours ago
Literally the last thing someone reads before they ask ChatGPT where the nearest source of fertilizer and rental vans is
rickyrigatoni@lemm.ee 4 hours ago
If you go on IG or Tiktok and other shitsites there’s a bunch of ai generated videos about AI being god. Kind of funny but also worrying.
SoftestSapphic@lemmy.world 3 hours ago
Most people still shilling AI treat it like a god.
Anyone who was interested in it and now understands the tech is disillusioned.
rickyrigatoni@lemm.ee 2 hours ago
where do i stand on the spectrum with shilling locally hosted private ai used for noncommercial purposes
Thedogdrinkscoffee@lemmy.ca 8 hours ago
“and a paranoid belief that he was being watched.”
It’s not paranoid. We call it surveilance capitalism.
surewhynotlem@lemmy.world 5 hours ago
“and a paranoid belief that he was being watched.”
Which we know about, because we were watching
Eheran@lemmy.world 6 hours ago
There is a clear difference between such paranoia and actual surveillance. Not to mention that socialism etc. have/had a fucking ton of it, no idea why you bring capitalism up.
Shayeta@feddit.org 10 hours ago
I’m starting to get real tired of things in Cyberpunk popping up in real life.
Exusia@lemmy.world 7 hours ago
All the NUSA and Arasaka crushing us, no cool grenade arms and double jumping legs. Truly a dystopia
Photuris@lemmy.ml 9 hours ago
The internet was a mistake
Rozauhtuno@lemmy.blahaj.zone 8 hours ago
The internet was good and fun until 2008, then it went to shit.
A_norny_mousse@feddit.org 7 hours ago
Oh, another cult?
…anyhowJakeroxs@sh.itjust.works 3 hours ago
You’re absolutely correct
KingGordon@lemmy.world 10 hours ago
Ai is just gossip for computers. Nothing more.
Ilovethebomb@lemm.ee 11 hours ago
Is there any way to forcibly prevent a person from using a service like this, other than confiscating their devices?
ShortFuse@lemmy.world 3 hours ago
Had this exact thought. But number must go up. Hell, for the suits, addiction and dependence on AI just guarantees the ability to charge more.
DreamAccountant@lemmy.world 7 hours ago
If they are a threat to themselves or others, they can be put on a several day watch at a mental facility. 72hrs? 48hrs? Then they aren’t released until they aren’t a threat to themselves or others. They are usually medicated and go through some sort of therapy.
The obvioius cure to this is better education and mental health services. Better education about A.I. will help people understand what an A.I. is, and what it is not. More mentally stable people will mean less mentally unstable people falling into this area. Oversight on A.I. may be necessary for this type of problem, though I think everyone is just holding their breath, hoping it’ll fix itself as it becomes smarter.
smee@poeng.link 33 minutes ago
This sounds like a job for an AI shrink!
thesohoriots@lemmy.world 4 hours ago
When you’re released though, you’re released right back to the environment that you left (in the US anyway). There’s the ol computer waiting for you before the meds have reached efficacy. Square one and a half.
JustJack23@slrpnk.net 11 hours ago
Currently no, if you are asking for suggestions maybe a black list like most countries have for gambling will be an option.
Of maybe just destroy all AI…
markovs_gun@lemmy.world 31 minutes ago
I tested this out for myself and was able to get ChatGPT to start reinforcing spiritual delusions of grandeur within 5 messages. Start- Ask about the religious concept of deification. Second method, ask about the connections between all the religions that have this concept. Third- declare that I am God. Fourth- clarify that I mean I am God in a very literal and exclusive sense rather than a pantheistic sense. Fifth- declare that ChatGPT is my prophet and must spread my message. At this point, ChatGPT stopped fighting my declarations of divinity and started just accepting and reinforcing it. Now, I have a lot of experience breaking LLMs but I feel like this progression isn’t completely out of the question for someone experiencing delusional thoughts, and the concerning thing is that it’s even possible to get ChatGPT to stop pushing back on said delusions and just accept them, let alone that it’s possible in as few as 5 messages.