Comment on How to use GPUs over multiple computers for local AI?
Sims@lemmy.ml 1 week ago
There are several solutions:
github.com/b4rtaz/distributed-llama
github.com/kalavai-net/kalavai-client
Didn’t try any of them and haven’t looked for 6 months, so maybe something better have arrived…
marauding_gibberish142@lemmy.dbzer0.com 1 week ago
Thank you for the links. I will go through them
Wigglytuff@lemmy.world 6 days ago
I’ve tried Exo and it worked fairly well for me. Combined my 7900 XTX, GTX 1070, and M2 MacBook Pro.
ebuttonsdude@ani.social 6 days ago
+1 on exo, worked for me across the 7900xtx, 6800xt, and 1070ti