Comment on How to use GPUs over multiple computers for local AI?

<- View Parent
vane@lemmy.world ⁨3⁩ ⁨weeks⁩ ago

I run this one. ollama.com/…/deepseek-r1:32b-qwen-distill-q4_K_M with this frontend github.com/open-webui/open-webui on single rtx 3090 hardware 64gb ram. It works quite well for what I wanted it to do.

source
Sort:hotnewtop