Comment on How to use GPUs over multiple computers for local AI?

• vane@lemmy.world ⁨1⁩ ⁨month⁩ ago

  I run this one. ollama.com/…/deepseek-r1:32b-qwen-distill-q4_K_M with this frontend github.com/open-webui/open-webui on single rtx 3090 hardware 64gb ram. It works quite well for what I wanted it to do.

  source

  • marauding_gibberish142@lemmy.dbzer0.com ⁨1⁩ ⁨month⁩ ago

    I see. Thanks

    source