Comment on Hello GPT-4o
ProfessorProteus@lemmy.world 5 months agoI’ve been wanting to run that one on my hardware but GPT4All just refuses to start its GUI. The only thing is a “chat.exe” that sits idle in the task manager. And this is an issue I’ve seen reported in their Github from several users, on both Win 10 and 11.
Have you find success with that frontend, or are you using one that actually works? I haven’t researched any others since this issue has me a little burnt out.
Sabata11792@kbin.social 5 months ago
I use TextgenWebui and sometimes Kobold. I can only run it with 4bit quant enabled since I'm just short on VRam to fully load the model.
Text gen runs a server you access though the web browser instead of a desktop app.
I haven't tried GPT4all.