Comment on Any external NPU that can be hooked to a proxmox miniPC?
hendrik@palaver.p3x.de 3 days agoAren’t diffusion models and LLMs (ollama) too big for a NPU? As far as I know something like a Coral runs specific models only. And it’s limited to the 1 or 2GB of memory on it. It’d do tasks like voice recognition, or image classification. But not generate images or text.
frongt@lemmy.zip 3 days ago
Agreed. OP should probably upgrade to a bigger case and discrete graphics card.
iturnedintoanewt@lemmy.world 3 days ago
Thanks! I was seeing if there was a way to do it while avoiding a full blown desktop PC case :(
dan@upvote.au 2 days ago
For small options, there’s mini PCs with the AMD Ryzen AI Max+ 395, and the Nvidia DGX. Their memory bandwidth is quite low compared to a GPU though, so expect slower performance.