Comment on How to use GPUs over multiple computers for local AI?
just_another_person@lemmy.world 3 weeks agoWow, so you want to use inefficient models super cheap. I guarantee nobody has ever thought of this before. Good move coming to Lemmy for tips on how to do so. I bet you’re the next Sam Altman 🤣
marauding_gibberish142@lemmy.dbzer0.com 3 weeks ago
I don’t understand your point, but I was going to use 4 GPUs (something like used 3090s when they get cheaper or the Arc B580s) to run the smaller models like Mistral small.