Comment on What type of computer setup would one need to run ai locally?
surewhynotlem@lemmy.world 1 week agoDoes multiple GPU help? I could get a cheap 970 to toss in my rig
Comment on What type of computer setup would one need to run ai locally?
surewhynotlem@lemmy.world 1 week agoDoes multiple GPU help? I could get a cheap 970 to toss in my rig
ShellMonkey@piefed.socdojo.com 1 week ago
My go to for messing with chat bots is Kobold that’ll let you split the work between multiple GPUs. I get the impression the actual processing is only done on one but it lets you load larger models with the extra memory.