There's no way it would be running locally.
Comment on Mozilla lays off 60 people, wants to build AI into Firefox
kakes@sh.itjust.works 8 months ago
Yeesh people here are salty.
Honestly, if they make it optional and/or give the option to run it locally, I could see this being a good thing.
Lord knows the competition is going full bore on AI, and if FF wants to stay relevant with the mass market they’ll need to keep up.
DarkThoughts@kbin.social 8 months ago
kakes@sh.itjust.works 8 months ago
In their defense, Mozilla did create the easiest way to run and integrate an LLM locally, so if anyone could do it, I imagine it would be them.
DarkThoughts@kbin.social 8 months ago
Yes, but what would a local model do for you in this case? Chatbots in browsers are typically used as an alternative / more contextualized search engine. For that you need proper access to an index of search results. Most people will also not have enough computing power to make use of any complex chatbot / larger context sizes.
kakes@sh.itjust.works 8 months ago
Pennomi wrote a whole list of potential ideas. And honestly, while I agree that local LLMs on typical hardware are underpowered for most tasks, it’s possible they would have the option for those that can run it.
People are getting all upset over this announcement without even knowing what their plan actually is, like the word “AI” is making them foam at the mouth or something. I’m just saying we should reserve judgements for when we have an idea of what’s happening.
Heresy_generator@kbin.social 8 months ago
Or they can be the browser that rejects the inclusion of bloat for functionality most people don't actually want and be the go-to for people who want a secure, private, light-weight web browser that's, ya know, intended to browse the fucking web. I'm so sick of web browsers trying to be application platforms; shit's been going on for decades and it was never a good idea.
pennomi@lemmy.world 8 months ago
It depends on what they mean by AI. I can think of oodles of great uses:
But yeah, Mozilla will probably just go for a “chat with your browser” feature. Total waste of space.
DarkThoughts@kbin.social 8 months ago
All of those could be terrible to be honest, because AI is a data tracking vacuum. An AI adblocker or content filter sounds cool at first, but it would mean it reads and analyzes your data, just like the shit you do with chatbots too. Reading your mails? That's basically what Google does for years with gmail, that's why they have such a good spam filter. I agree that a chatbot would be kinda useless though, even if privacy friendly, which in of itself would be great but I just don't see the use. This could simply be outsourced to a website.
KairuByte@lemmy.dbzer0.com 8 months ago
The only reason this would be an issue is if it’s sending that data off to a third party. If its fully local, who cares what data it sees?
DarkThoughts@kbin.social 8 months ago
If they're local they'd be basically useless due to a lack of computing power and potential lack of indexing for a search engine chatbot, so I doubt it. It would also have to be so polished that it wouldn't require further user knowledge / input, and that's just not a thing with any local LLM I've come across. Mozilla can gladly prove me wrong though. I certainly wouldn't mind if they generally can make the whole process of local LLMs easier and more viable.