Comment on People are speaking with ChatGPT for hours, bringing 2013’s Her closer to reality

• PeterPoopshit@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Use llama cpp. It uses cpu so you don’t have to spend $10k on a graphics card that meets the minimum requirements.

  source

  • kamenlady@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Gonna look into that - thanks

    source

    • NotMyOldRedditName@lemmy.world ⁨1⁩ ⁨year⁩ ago

      Check this out

      github.com/oobabooga/text-generation-webui

      It has a one click installer and can use llama.cpp

      From there you can download models and try things out.

      If you don’t have a really good graphics card, maybe start with 7b models. Then you can try 13b and compare performance and results.

      source