Why the hell do I need this in a web browser? Why isn’t it a stand alone app?
Opera is testing letting you download LLMs for local use, a first for a major browser
Submitted 7 months ago by MichaelTen@lemmy.world to technology@lemmy.world
Comments
reddig33@lemmy.world 7 months ago
GlitterInfection@lemmy.world 7 months ago
If you think of LLMs as a thing to replace search bars then this kind of makes sense.
reddig33@lemmy.world 7 months ago
Just more unnecessary browser bloat.
noodlejetski@lemm.ee 7 months ago
If you think of LLMs as a thing to replace search bars
I don’t.
FaceDeer@fedia.io 7 months ago
There are plenty of stand-alone LLM apps.
chronicledmonocle@lemmy.world 7 months ago
Same reason people get their WiFi from their ISP Modem+Router combo, even though it’s stupid to do so: People often confuse initial convenience for good.
gunpachi@lemmings.world 7 months ago
Thats a cool feature for sure but I don’t trust opera.
essteeyou@lemmy.world 7 months ago
Can’t they just stick to normal browser things like gaming integrations?
folak@lemmy.world 7 months ago
Bandicoot_Academic@lemmy.one 7 months ago
Intresting. But I’m curious about the performance.
A bigger LLM (mixtral) already struggles to run on my mid-range gaming PC. Trying to run an LLM that isn’t terrible on a standard laptop wouldn’t be a good experience.
tal@lemmy.today 7 months ago
I have no idea how this is set up to work technically, but most of the heavy lifting is gonna be on the GPU. I’m not sure that it matters much whether the browser is what’s pushing data to the GPU or some other package.
Bandicoot_Academic@lemmy.one 7 months ago
Most people probably don’t have a dedicated GPU and an iGPU is probably not powerfull enough to run an LLM at decent speed. Also a decent model requires like 20GB of RAM which most people don’t have.
T156@lemmy.world 7 months ago
Unlikely, at least on non-nvidia chips, and even on AMD, it’s only the latest four chips that support it. Anything older isn’t going to cut it.
You also need a fairly big amount of VRAM for models like that. (4 GB is the minimum for the common kinds, which is more than typical integrated systems, or 8 GB of system memory). You can get by with system RAM, but the performance will be quite bad, since you’re either relying on the CPU, or you’ll be adding the latency from data moving between them.
cmnybo@discuss.tchncs.de 7 months ago
I haven’t used Opera since they switched from their own engine to chrome. They are now owned by a Chinese company, so it probably has at least as much tracking built into it as Google Chrome now.
rottingleaf@lemmy.zip 7 months ago
I used Fifth a bit, which is something aesthetically similar to old Opera made with fltk and a webkit port to fltk. But it’s abandoned now.
It’s so sad really, when I was a Windows user, it was Opera, when I moved to Linux, it was again Opera, then I also started using Conkeror (based on XULRunner).
Then Opera died. Then XULRunner died. No usable web browser anymore.
SharkAttak@kbin.social 7 months ago
Don't you like Firefox? It's on both win and Linux.