Comment on Firefox is Getting a New AI Browsing Mode
riskable@programming.dev 3 days agoOk how would that work:
find me some good recipes for hibachi style ginger butter
AI model returns 10 links, 4 of which don’t actually exist (because it hallucinated them)? No. If they didn’t exist, it wouldn’t have returned them because it wouldn’t have been able to load those URLs.
It’s possible that it could get it wrong because of some new kind of LLM scamming method but that’s not “making shit up” it’s malicious URLs.
Lemminary@lemmy.world 3 days ago
And yet I’ve had Bing’s Copilot/ChatGPT (with plugins like Consensus), Gemini, and Perplexity do exactly that, but worse. Sometimes they’ll cite sources that don’t mention anything related to the answer they’ve provided because the information they’re giving is based on some other training data they can’t source. They were asked to provide a source, but won’t necessarily give you the source. Hell, sometimes they’ll answer an adjacent just to spit out an answer–any answer–to fulfill the request.
LLMs are simply not the appropriate tool for the job. This is most obvious when you need the specificity and accuracy.
riskable@programming.dev 1 day ago
Yeah… The big commercial models have system prompts that fuck it all up. That’s my hypothesis, anyway.
You have to try it with an open source model. You tell it to turn the titles, URLs, and nothing else. That seems to work fantastic 👍
I’m doing it with Open WebUI and ollama cloud which is open source models that you could run locally—if you have like $5,000 worth of hardware.
Lemminary@lemmy.world 1 day ago
Interesting. I have a couple automations in mind, I’ll have to try it out, then.