It really needs to be a disqualifying factor for generative AI. Even using it for my hobbies is useless when I can’t trust it knows dick about fuck. Every time I test the new version out it gets things so blatantly wrong and contradictory that I give up; it’s not worth the effort. It’s no surprise everywhere I’ve worked has outright banned its use for official work.
Comment on We have to stop ignoring AI’s hallucination problem
FalseMyrmidon@kbin.run 4 months ago
Who's ignoring hallucinations? It gets brought up in basically every conversation about LLMs.
Neato@ttrpg.network 4 months ago
DdCno1@kbin.social 4 months ago
I agree. The only application that is fine for this in my opinion is using it solely for entertainment, as a toy.
The problem is of course that everyone and their mothers are pouring billions into what clearly should only be used as a toy, expecting it to perform miracles it currently can not and might never be able to pull off.
14th_cylon@lemm.ee 4 months ago
People who suggest, let’s say, firing employees of crisis intervention hotline and replacing them with llms…
SkyezOpen@lemmy.world 4 months ago
“Have you considered doing a flip as you leap off the building? That way your death is super memorable and cool, even if your life wasn’t.”
-Crisis hotline LLM, probably.
Voroxpete@sh.itjust.works 4 months ago
Less horrifying conceptually, but in Canada a major airline tried to replace their support services with a chatbot. The chatbot then invented discounts that didn’t actually exist, and the courts ruled that the airline had to honour them. The chatbot was, for all intents and purposes, no more or less official a source of data than any other information they put out, such as their website and other documentation.
L_Acacia@lemmy.one 4 months ago
They know the tech is not good enough, they just dont care and want to maximise profit.