Comment on How to use GPUs over multiple computers for local AI?
marauding_gibberish142@lemmy.dbzer0.com 2 weeks agoThanks, but will NPUs integrated along with the CPU ever match the performance of a discrete GPU?
Comment on How to use GPUs over multiple computers for local AI?
marauding_gibberish142@lemmy.dbzer0.com 2 weeks agoThanks, but will NPUs integrated along with the CPU ever match the performance of a discrete GPU?
Natanox@discuss.tchncs.de 2 weeks ago
Depends on which GPU you compare it with, what model you use, what kind of RAM it has to work with, ecetera. NPU’s are purpose-built chips after all. Unfortunately the whole tech is still very young, so we’ll have to wait for stuff like ollama to introduce native support for an apples-to-apples comparison. The raw numbers to however do look promising.