Comment on Bewildered enthusiasts decry memory price increases of 100% or more — the AI RAM squeeze is finally starting to hit PC builders where it hurts

<- View Parent
Dremor@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

For a normal user, 16G is still enough.

But for a power user like me, a Dev, with multiple IDE open, multiple browsers, a database manager with a dockerized DB, I’m basically at 96-98% RAM all the time. But even then, if you use a local AI, prepare to loose multiple Gig to it. I already used more than 30 Gig on one LLM (dolphin-mixtral 8x7B for the curious), when I tried testing one.

source
Sort:hotnewtop