Comment on Hello GPT-4o
Sabata11792@kbin.social 5 months agoI been playing with the Mistral 7b models. About the most my hardware can reasonably run... so far. Would love to add vision and voice but I'm just happy it can run.
Comment on Hello GPT-4o
Sabata11792@kbin.social 5 months agoI been playing with the Mistral 7b models. About the most my hardware can reasonably run... so far. Would love to add vision and voice but I'm just happy it can run.
ProfessorProteus@lemmy.world 5 months ago
I’ve been wanting to run that one on my hardware but GPT4All just refuses to start its GUI. The only thing is a “chat.exe” that sits idle in the task manager. And this is an issue I’ve seen reported in their Github from several users, on both Win 10 and 11.
Have you find success with that frontend, or are you using one that actually works? I haven’t researched any others since this issue has me a little burnt out.
Sabata11792@kbin.social 5 months ago
I use TextgenWebui and sometimes Kobold. I can only run it with 4bit quant enabled since I'm just short on VRam to fully load the model.
Text gen runs a server you access though the web browser instead of a desktop app.
I haven't tried GPT4all.