Comment on Any external NPU that can be hooked to a proxmox miniPC?
hendrik@palaver.p3x.de 3 days ago
You should probably have a look at the software you intend to run and see what kind of external NPU they support. I’m aware of Frigate for example which leverages hardware acceleration to classify camera surveillance footage. Guess their community knows which stick to get. Or you’d have a look at the frameworks which package machine learning models for inference on some NPU and have a look at their table of supported hardware.
non_burglar@lemmy.world 3 days ago
Inference from GPU, even QuickSync, is better now than what TensorFlow was able to do on a Google Coral TPU.
Plus, the Coral drivers are untouched for the last 4 years.
hendrik@palaver.p3x.de 3 days ago
I think you mean SyCL or Vulkan or oneDNN… QuickSync is video de- and encoding.
non_burglar@lemmy.world 3 days ago
QuickSync is the GPU hardware used to infer from vino models.
docs.frigate.video/…/hardware_acceleration_video/…
hendrik@palaver.p3x.de 3 days ago
Thx! That’s the video decoding page, though. The thing that decodes the video stream and makes individual images from the stream. Seems the thing that does inference / object detection is called OpenVINO.
https://docs.frigate.video/configuration/hardware_acceleration_enrichments