Comment on People are speaking with ChatGPT for hours, bringing 2013’s Her closer to reality
PeterPoopshit@lemmy.world 1 year agoUse llama cpp. It uses cpu so you don’t have to spend $10k on a graphics card that meets the minimum requirements.
Comment on People are speaking with ChatGPT for hours, bringing 2013’s Her closer to reality
PeterPoopshit@lemmy.world 1 year agoUse llama cpp. It uses cpu so you don’t have to spend $10k on a graphics card that meets the minimum requirements.
kamenlady@lemmy.world 1 year ago
Gonna look into that - thanks
NotMyOldRedditName@lemmy.world 1 year ago
Check this out
github.com/oobabooga/text-generation-webui
It has a one click installer and can use llama.cpp
From there you can download models and try things out.
If you don’t have a really good graphics card, maybe start with 7b models. Then you can try 13b and compare performance and results.