I’m pretty sure when searching with AI the model gets told “here are five articles about <user search term>, summarize them and answer the following question: <user input>”
Comment on Why AI is going to be a shitshow.
wewbull@feddit.uk 5 months agoThe source is just as vulnerable to being hallucinations as anything else it tells you.
Turun@feddit.de 5 months ago
laurelraven@lemmy.blahaj.zone 5 months ago
So, when you go to check them… It’s not like the AI is going to hallucinate a valid registered domain with a webserver hosting the hallucinated source as well, so click the link, it’s dead/fake, toss out that reply as suspect.
If you follow the source and find it’s valid, supports what the AI said, and is reasonably trustworthy, then you can consider what it has told you.
If it cites its sources, you have a way to check its math (so to speak).
wewbull@feddit.uk 5 months ago
You have a way to do so, yes, but you actually have to do it and we know people don’t. False sources can just make already believable responses more credible, despite them being full of rubbish.
laurelraven@lemmy.blahaj.zone 5 months ago
The person you were replying to was talking about checking those sources though.
Yes, fake sources can and will give people a false sense that it’s legit, but checking a “hallucinated” source will quickly make it clear that there’s nothing backing it up.
It’s a problem, but it’s one that an individual using it who’s aware of it does actually have a way of mitigating fairly easily.