Why the hell do I need this in a web browser? Why isn’t it a stand alone app?
Opera is testing letting you download LLMs for local use, a first for a major browser
Submitted 1 month ago by MichaelTen@lemmy.world to technology@lemmy.world
Comments
reddig33@lemmy.world 1 month ago
GlitterInfection@lemmy.world 1 month ago
If you think of LLMs as a thing to replace search bars then this kind of makes sense.
reddig33@lemmy.world 1 month ago
Just more unnecessary browser bloat.
noodlejetski@lemm.ee 1 month ago
If you think of LLMs as a thing to replace search bars
I don’t.
FaceDeer@fedia.io 1 month ago
There are plenty of stand-alone LLM apps.
chronicledmonocle@lemmy.world 1 month ago
Same reason people get their WiFi from their ISP Modem+Router combo, even though it’s stupid to do so: People often confuse initial convenience for good.
gunpachi@lemmings.world 1 month ago
Thats a cool feature for sure but I don’t trust opera.
essteeyou@lemmy.world 1 month ago
Can’t they just stick to normal browser things like gaming integrations?
folak@lemmy.world 1 month ago
Bandicoot_Academic@lemmy.one 1 month ago
Intresting. But I’m curious about the performance.
A bigger LLM (mixtral) already struggles to run on my mid-range gaming PC. Trying to run an LLM that isn’t terrible on a standard laptop wouldn’t be a good experience.
tal@lemmy.today 1 month ago
I have no idea how this is set up to work technically, but most of the heavy lifting is gonna be on the GPU. I’m not sure that it matters much whether the browser is what’s pushing data to the GPU or some other package.
Bandicoot_Academic@lemmy.one 1 month ago
Most people probably don’t have a dedicated GPU and an iGPU is probably not powerfull enough to run an LLM at decent speed. Also a decent model requires like 20GB of RAM which most people don’t have.
T156@lemmy.world 1 month ago
Unlikely, at least on non-nvidia chips, and even on AMD, it’s only the latest four chips that support it. Anything older isn’t going to cut it.
You also need a fairly big amount of VRAM for models like that. (4 GB is the minimum for the common kinds, which is more than typical integrated systems, or 8 GB of system memory). You can get by with system RAM, but the performance will be quite bad, since you’re either relying on the CPU, or you’ll be adding the latency from data moving between them.
cmnybo@discuss.tchncs.de 1 month ago
I haven’t used Opera since they switched from their own engine to chrome. They are now owned by a Chinese company, so it probably has at least as much tracking built into it as Google Chrome now.
rottingleaf@lemmy.zip 1 month ago
I used Fifth a bit, which is something aesthetically similar to old Opera made with fltk and a webkit port to fltk. But it’s abandoned now.
It’s so sad really, when I was a Windows user, it was Opera, when I moved to Linux, it was again Opera, then I also started using Conkeror (based on XULRunner).
Then Opera died. Then XULRunner died. No usable web browser anymore.
SharkAttak@kbin.social 1 month ago
Don't you like Firefox? It's on both win and Linux.