Comment on Ars Technica Fires Reporter Over AI-Generated Quotes
deadbeef79000@lemmy.nz 7 hours agoIt’s not quite like that. The tools used to scrape the web for training data couldn’t access the site to stacks the data, so it’s not encoded in the model.
The query interface for the model just hallucinates when there’s a ‘vacuum’.
hexagonwin@lemmy.today 5 hours ago
i was thinking of some “automated browser” type, like if the browser returns an error page saying it’s blocked, the LLM would get the "blocked from website"ish error as the page content, and shouldn’t it say something around “I’m sorry, I couldn’t access the website” instead of “Sure! Here’s a summary of that webpage” followed by hallucinated bs. well maybe that’s not the case here?
atrielienz@lemmy.world 4 hours ago
It doesn’t say something like that specifically because it isn’t an algorithm that receives x input and spits out Y. It’s an algorithm that receives x query and spits out the most common variant worf that comes after query. If there isn’t a most common word that makes sense to a human, the AI doesn’t know that and so it still gives the most common word in its training set.
If the query is “Juicy” it may output melons. If melons were not available in its training set it might output grapes or cherries, but if those weren’t available it might output apple bottom jeans which would have made sense in 2003 but likely wouldn’t make sense to the average kid today who’s never heard of juicy couture.
It doesn’t understand anything. It can’t reason.