Comment on Want a more private ChatGPT alternative that runs offline? Check out Jan
Infiltrated_ad8271@kbin.social 5 months agoThe question is quickly answered as none is currently that good, open or not.
Anyway it seems that this is just a manager. I see some competitors available that I have heard good things about, like mistral.
Bipta@kbin.social 5 months ago
Local LLMs can beat GPT 3.5 now.
june@lemmy.world 5 months ago
3.5 fuckin sucks though. That’s a pretty low bar to set imo.
Speculater@lemmy.world 5 months ago
I think a good 13B model running on 12GB of VRAM can do pretty well. But I’d be hard pressed to believe anything under 33B would beat 3.5.