id like a chatbot rhat gives the worst possible answer to every question posed to it.
“hey badgpt, can tou help me with this math problem?”
"Sure, but first maybe you should do some heroin to take the edge off? "
“I’m having a tough time at school and could use some emotional support”
“emotional support is for pussies, like that bitch ass bus driver who is paying your teachers to make your life hell. steal the school bus and drive it into the gymnasium to show everyone who’s boss”
a chatbot that just, like, goes all in on the terrible advice and does its utmost to escalate every situation from a 1 to 1,000, needlessly and emphatically.
frog@feddit.uk 2 days ago
People should realize what feeds these AI programs. ChatGPT gets their data from the entire internet, the internet that includes gave anyone a voice no matter how confidently wrong they are. The same internet filled with trolls that bullied people to suicide.
Before direct answers from AI programs, when someone tella me they read something crazy on the internet, a common response is “don’t believe everything you read”. Now people aren’t listening to that advice.
markovs_gun@lemmy.world 2 days ago
This isn’t actually the problem. In natural conversation I would say the most likely response to someone saying they need some meth to make it through their work day (actual scenario in this article) is to say “what the fuck dude no” but LLMs don’t use just the statistically most likely response. Ever notice how ChatGPT has a seeming sense of “self” that it is an to LLM and you are not? If it were only using the most likely response from natural language, it would talk as if it were human, because that’s how humans talk. Early LLMs did this, and people found it disturbing. There is a second part of the process that gives a score to each response based on how likely it is to be voted good or bad and this is reinforced by people providing feedback. This second part is how we got here, because people who make LLMs are selling competing products and found people are much more likely to buy LLMs that act like super agreeable sycophants than LLMs that don’t do this. Therefore, they have intentionally tuned their models to prefer agreeable, sycophantic responses because it helps them be more popular. This is why an LLM tells you to use a little meth to get you through a tough day at work if you tell it that’s what you need to do.
TL;DR- as with most of the things people complain about with AI, the problem isn’t the technology, it’s capitalism. This is done intentionally in search of profits.
rottingleaf@lemmy.world 2 days ago
So in our hypothetical people’s republic of united Earth your personal LLM assistant is not going to assist you in suicide, and isn’t even going to send a notification someplace that you have such thoughts, which is certainly not going to affect your reliability rating, chances to find a decent job, accommodations (less value - less need to keep you in order) and so on? Or, in case of meth, just about that, which means you’re fired and at best put to a rehab, how efficient it’ll be, - well, how efficient does it have to be? In case you have no leverage and a bureaucratic machine does.
There are other options other than “capitalism” and “happy”.
dingus@lemmy.world 2 days ago
Yeah, ChatGPT is incredibly sycophantic. It’s like it’s basically just programmed to try to make you feel good and affirm you, even if these things are actually counterproductive and damaging. If you talk to it enough, you end up seeing how much of a brown-nosing kiss-ass they’ve made it.
My friend with a mental illness wants to stop taking her medication? She explains this to ChatGPT. ChatGPT “sees” that she dislikes having to take meds, so it encourages her to stop to make her “feel better”.
A meth user is struggling to quit? It tells this to ChatGPT. ChatGPT “sees” how the user is suffering and encourages it to take meth to help ease the user’s suffering.
Thing is they have actually programmed some responses into it that will vehemently be against self harm. Suicide is one that thankfully even if you use flowery language to describe it, ChatGPT will vehemently oppose you.
breakingcups@lemmy.world 2 days ago
Not just that, their responses are tweaked, fine tuned to give a more pleasing response by tweaking knobs no one truly understands. This is where AI gets its sycophantic streak from.