Comment on Local LLM for Server Setup Guidance?
irmadlad@lemmy.world 1 week ago
GPT4All can accommodate a plethora of models all the way until you run out of VRAM. LOL Maybe play around with some of them. Right now I’m experimenting with DeepSeek R1 Distill Qwen 14 B, and Qwen 2.5 Coder -32B Instruct GGUF. Pretty neat stuff.
Lumisal@lemmy.world 1 week ago
Is GPT4all still up to date though? I see the last release was in 2024
Release v3.10.0 dropped on Feb 24, 2025, so yeah it does have a little age. I’m not sure how often they would update the front end, as it seems the models are the driving force.
corsicanguppy@lemmy.ca 1 week ago
Mature software doesn’t need hourly updates. All the shit that leverages the library repos in horribly unsafe ways - ohai npm - that stuff needs constant updates.
Lumisal@lemmy.world 6 days ago
I know it doesn’t need hourly updates but something that relies on other data (in this case LLMs) probably needs yearly updates at the very least to ensure better compatibility with newer models.