Blindsight mentioned!
The only explanation is that something has coded nonsense in a way that poses as a useful message; only after wasting time and effort does the deception becomes apparent. The signal functions to consume the resources of a recipient for zero payoff and reduced fitness. The signal is a virus.
This has been my biggest problem with it. It places a cognitive load on me that wasn’t there before, having to cut through the noise.
brsrklf@jlai.lu 10 hours ago
Every now and then I see a guy barging in a topic bringing nothing else than “I asked [some AI service] and here’s what it said”, followed by 3 paragraphs of AI-gened gibberish. And then when it’s not well received they just don’t seem to understand.
It’s baffling to me. Anyone can ask an AI. A lot of people specifically don’t, because they don’t want to battle with its output for an hour trying to sort out from where it got its information, whether it represented it well, or even whether it just hallucinated half of it.
And those guys come posting a wall of text they may or may not have read themselves, and then they have the gall to go “What’s the problem, is any of that wrong?”… Dude, the problem is you have no fucking idea if it’s wrong yourself, have nothing to back it up, and have only brought automated noise to the conversation.
tias@discuss.tchncs.de 8 hours ago
That’s not true. For starters you can evaluate it on its own merits to see if it makes logical sense - the AI can help solve a maths equation for you and you can see that it checks out without needing something else to back it up.
Second, agentic or multiple-step AI:s will dig out the sources for you so you can check them. It’s a smart search engine with no ads and better focus on the question asked.
brsrklf@jlai.lu 1 hour ago
I am speaking from experience.
The latest example of that I encountered had a blatant logical inconsistency in its summary, a CVE that wasn’t relevant to what was discussed, because it was corrected years before the technology existed. Someone pointed to it.
The poster hadn’t done the slightest to check what they posted, they just regurgitated it. It’s not the reader’s job to check the crap you’ve posted without the slightest effort.
isVeryLoud@lemmy.ca 4 hours ago
Ok, I didn’t need you as a middle man to tell me what the LLM just hallucinated, I can do this myself.
The point is that raw AI output provides absolutely no value to a conversation, and is thus noisy and rude.
When we ask questions on a public forum, we’re looking to talk to people about their own experience and research through the lens of their own being and expertise. We’re all capable of prompting an AI agent. If we wanted AI answers, we’d prompt an AI agent.
Barrymore@sh.itjust.works 8 hours ago
And what happens when
mechahitlerthe next version of Grok or whatever AI hosted by a large corporation that only has the interest of capital gains comes out with unannounced injected prompt poisoning that doesn’t produce quality output like you’ve been conditioned to expect?These AI are good if you have a general grasp of whatever you are trying to find, because you can easily pick out what you know to be true and what is obviously a
ridiculous mess of computer generated text that is no smarter than your phone keyboard word suggestionsAI hallucination.Trying to soak up all the information generated by AI in a topic without prior knowledge may easily end up with you not understanding anything more than you did before, and possibly give you unrealistic confidence that you know what is essentially misinformation. And just because an AI pulls up references, unless you do your due diligence to read those references for accuracy or authority on the subject, the AI may be hallucinating where it got the wrong information it’s giving you.
Mirodir@discuss.tchncs.de 8 hours ago
On the second part. That is only half true. Yes, there are LLMs out there that search the internet and summarize and reference some websites they find.
However, it is not rare that they add their own “info” to it, even though it’s not in the given source at all. If you use it to get sources and then read those instead, sure. But the output of the LLM itself should still be taken with a HUGE grain of salt and not be relied on at all if it’s critical, even if it puts a nice citation.
tomalley8342@lemmy.world 5 hours ago
If you have evaluated the statement for its correctness and relevance, then you can just own up to the statement yourself. There is no need to defer responsibility by prefacing it with “I asked [some AI service] and here’s what it said”. That is the point of the article that is being discussed, if you’d like to give it a read sometime.
bdonvr@thelemmy.club 6 hours ago
It gives you some links but in my experience what it says in the summary isn’t always the same as what’s in the link…