Comment on Hello GPT-4o
Sabata11792@kbin.social 7 months agoI use TextgenWebui and sometimes Kobold. I can only run it with 4bit quant enabled since I'm just short on VRam to fully load the model.
Text gen runs a server you access though the web browser instead of a desktop app.
I haven't tried GPT4all.