Comment on Any external NPU that can be hooked to a proxmox miniPC?
non_burglar@lemmy.world 3 days agoInference from GPU, even QuickSync, is better now than what TensorFlow was able to do on a Google Coral TPU.
Plus, the Coral drivers are untouched for the last 4 years.
hendrik@palaver.p3x.de 3 days ago
I think you mean SyCL or Vulkan or oneDNN… QuickSync is video de- and encoding.
non_burglar@lemmy.world 3 days ago
QuickSync is the GPU hardware used to infer from vino models.
docs.frigate.video/…/hardware_acceleration_video/…
hendrik@palaver.p3x.de 3 days ago
Thx! That’s the video decoding page, though. The thing that decodes the video stream and makes individual images from the stream. Seems the thing that does inference / object detection is called OpenVINO.
https://docs.frigate.video/configuration/hardware_acceleration_enrichments
non_burglar@lemmy.world 3 days ago
Oops, you’re right. Still the QuickShnc GPU doing the detector work, though.
docs.frigate.video/frigate/hardware/