Comment on On Tuesday afternoon, ChatGPT encouraged me to cut my wrists
backgroundcow@lemmy.world 2 weeks agoThe only reason this is “click bait” is because someone chose to do this, rather than their own mental instability bringing this out organically.
This is my point. The case we are discussing now isn’t noteworthy, because someone doing it deliberately is equally “impressive” as writing out a disturbing sentence in MS Paint. One cannot create a useful “answer engine” without it being capable of producing something weird/provoking/offensive out of context; no more than one can create a useful drawing program that blocks out all offensive content. Nor is it a worthwhile goal.
The cases to care about are those where the LLM takes a perfectly reasonable conversation off the rails. Clickbait like the one in the OP is actually harmful in that they drown out such real cases, and is therefore deserving of ridicule.