Comment on OpenAI's GPT Trademark Request Has Been Denied

• L_Acacia@lemmy.one ⁨9⁩ ⁨months⁩ ago

  If you have good enough hardware, this is a rabbithole you could explore. github.com/oobabooga/text-generation-webui/

  source
• Dalraz@lemmy.ca ⁨9⁩ ⁨months⁩ ago

  You bet your ollama I am.

  source
• UraniumBlazer@lemm.ee ⁨9⁩ ⁨months⁩ ago

  Naah. I think this model needs a crazy amount of vram to run. I’m stuck with 4gigs :(

  source

  • neutron@thelemmy.club ⁨9⁩ ⁨months⁩ ago

    Did you use a specific website to use Mixtral? I want to try but system requirements are crazy.

    source

    • UraniumBlazer@lemm.ee ⁨9⁩ ⁨months⁩ ago

      huggingface.co/chat

      source
• QuadratureSurfer@lemmy.world ⁨9⁩ ⁨months⁩ ago

  You can run it locally with an RTX 3090 or less (as long as you have enough RAM), but there’s a bit of a tradeoff in speed when using more system RAM vs VRAM.

  source