Comment on Want a more private ChatGPT alternative that runs offline? Check out Jan
Just_Pizza_Crust@lemmy.world 9 months agoI’d also recommend Oobabooga if you’re already familiar with Automatic1111 for Stable diffusion. I have found being able to write the first part of the bots response gets much better results and seems to make up false info much less.
FaceDeer@kbin.social 9 months ago
There's also koboldcpp, which is fairly newbie friendly.
Turun@feddit.de 9 months ago
And llama file, which is a chat bot in a single executable file.