Are they as good as chatgpt?
Comment on Want a more private ChatGPT alternative that runs offline? Check out Jan
PerogiBoi@lemmy.ca 8 months ago
Also check out LLM Studio and GPT4all. Both of these let you run private ChatGPT alternatives from Hugging Face and run them off your ram and processor (can also offload to GPU).
tubbadu@lemmy.kde.social 8 months ago
PerogiBoi@lemmy.ca 8 months ago
Mistral is thought to be almost as good. I’ve used the latest version of mistral and found it more or less identical in quality of output.
It’s not as fast though as I am running it off of 16gb of ram and an old GTX 1060 card.
tsonfeir@lemm.ee 8 months ago
I’m sure that meth is for personal use right? Right?
PerogiBoi@lemmy.ca 8 months ago
Absolutely. Synthesizing hard drugs is time consuming and a lot of hard work. Only I get to enjoy it.
timetravel@lemmings.world 8 months ago
Can you provide links for those? I see a few and don’t trust search results
tsonfeir@lemm.ee 8 months ago
No.
Just_Pizza_Crust@lemmy.world 8 months ago
I’d also recommend Oobabooga if you’re already familiar with Automatic1111 for Stable diffusion. I have found being able to write the first part of the bots response gets much better results and seems to make up false info much less.
FaceDeer@kbin.social 8 months ago
There's also koboldcpp, which is fairly newbie friendly.
Turun@feddit.de 8 months ago
And llama file, which is a chat bot in a single executable file.