Comment on Teen killed himself after ‘months of encouragement from ChatGPT’, lawsuit claims
Occhioverde@feddit.it 4 weeks agoYes and no. The example you made is of a defective device, not of an “unethical” one.
For LLMs we know damn well that they shouldn’t be used as a therapist or as a digital friend to ask for advice; they are no more than a powerful search engine.
An example that is more in line with the situation we’re analyzing is a kid that stabs itself with a knife after his parents left him playing with one; are you sure you want to sue the company that made the knife in that scenario?
LillyPip@lemmy.ca 4 weeks ago
Not really, though.
The parents know the knife can be used to stab people. It’s a dangerous implement, and people are killed with knives all the time.
LLMs aren’t sold as weapons, or even as tools that can be used as weapons. They’re sold as totally benign tools that can’t reasonably be considered as dangerous.
That’s the difference. If you’re paying especially close attention to, you may potentially understand they can be dangerously, but most people are just buying a coffee maker.