Comment on Want a more private ChatGPT alternative that runs offline? Check out Jan
Just_Pizza_Crust@lemmy.world 5 months agoI’d also recommend Oobabooga if you’re already familiar with Automatic1111 for Stable diffusion. I have found being able to write the first part of the bots response gets much better results and seems to make up false info much less.
FaceDeer@kbin.social 5 months ago
There's also koboldcpp, which is fairly newbie friendly.
Turun@feddit.de 5 months ago
And llama file, which is a chat bot in a single executable file.