Comment

Comment on How to turn off Gemini in Gmail — and why you should | Proton

I mean, I get that, but why is Proton offering one? What value do I get from Proton’s LLM that I wouldn’t get from any other company’s LLM? It’s not privacy, because it’s not end to end encrypted. It’s not features, because it’s just a fine tuned version of the free Mistral model (from what I can tell). It’s not integration (thank goodness), because they don’t have access to your data to integrate it with (according to their privacy policy).

I kind of just hate the idea that every tech company is offering an LLM service now. Proton is an email and VPN company. Those things make sense. The calendar and drive stuff too. They have actual selling points that differentiate them from other offerings. But investing engineering time and talent into yet another LLM, especially one that’s worse than the competition, just seems like a waste to me. And especially since it’s not something that fits into their other product offerings.

It truly seems like they just wanted to have something AI related so they wouldn’t be “left behind” in case the hype wasn’t a bubble. I don’t like it when companies do that. It makes me think they don’t really have a clear direction.

source

Sort:hotnew top

SuspciousCarrot78@lemmy.world ⁨2⁩ ⁨days⁩ ago
Ah; as I recall, it’s because they polled users and there was an overwhelming “yes please”, based on Proton’s privacy stance.

Given proton is hosted in EU, they’re likely quite serious about GDPR and zero data retention.

Lumo is interesting. Architecturally I mean, as a LLM enjoyer. I played around with it a bit, and stole a few ideas from them when I jury rigged my system. Having said that, you could get a ton more with $10 on OpenRouter. Hell, the free models on there are better than lumo and you can choose to only use privacy respecting providers.

source
- hperrin@lemmy.ca ⁨2⁩ ⁨days⁩ ago
  I played around with it a lot yesterday, giving it documentation and asking it to write some code based on the API documentation. Just like every single other LLM I’ve ever tried, it just bungled the entire thing. It made up a bunch of functions and syntax that just doesn’t exist. After I told it the code was wrong and gave it the right way to do it, it told me that I got it wrong and converted it back to the incorrect syntax. LLMs are interesting toys, but shouldn’t be used for real work.
  
  source
  - SuspciousCarrot78@lemmy.world ⁨2⁩ ⁨days⁩ ago
    Yeah. I had ChatGPT (more than once) take the code given, cut it in half, scramble it and then claim “see? I did it! Code works now”.
    
    When you point out what it did, by pasting its own code back in, it will say “oh, why did you do that? There’s a mistake in your code at XYZ”. No…there’s a mistake in your code, buddy.
    
    When you paste in what you want it to add, it “fixes” XYZ … and …surprise surprise… It’s either your OG code or more breaks.
    
    The only one ive seen that doesn’t do this is (or does it a lot less) is Claude.
    
    I think Lumo for the most part is really just Mistral, Nemotron and Openhands in a trench coat. ICBW.
    
    I think Lumo’s value proposition is around data retention and privacy, not SOTA llm tech.
    
    source
  - IEatDaFeesh@lemmy.world ⁨2⁩ ⁨days⁩ ago
    Sounds like a skill issue. I guess you don’t know how to prompt correctly. 🤷
    
    source
    hperrin@lemmy.ca ⁨2⁩ ⁨days⁩ ago
    Feel free to try. Here’s the library I use: nymph.io
    
    It’s open source, and all the docs and code are available at that link and on GitHub. I always ask it to make a note entity, which is just incredibly simple. Basically the same thing as the ToDo example.
    
    The reason I use this library (other than that I wrote it, so I know it really well) is that it isn’t widely known and there aren’t many example projects of it on GitHub, so the LLM has to be able to actually read and understand the docs and code in order to properly use it. For something like React, there are a million examples online, so for basic things, the LLM isn’t really understanding anything, it’s just making something similar to its training data. That’s not how actual high level programming works, so making it follow an API it isn’t already trained on is a good way to test if it is near the same abilities as an actual entry level SWE.
    
    source
Blue_Morpho@lemmy.world ⁨2⁩ ⁨days⁩ ago

I have a laptop with 48GB of VRAM

???

The AMD GPU in some Frameworks have 8GB of vram.

source
- hperrin@lemmy.ca ⁨2⁩ ⁨days⁩ ago
  It’s integrated graphics so it uses up to half of the system RAM. I have 96GB of system ram, so 48GB of VRAM. I bought it last year before the insane price hikes, when it was within reach to normal people like me.
  
  source