LLM and VLM are generally the type of model that needs a ton of resources to run. Birdnet uses an audio classification model, but there are dozens of types of models.

I’m building specialized task-focused pipelines which keep the memory footprint small for self-hosted users, and I’m working on a unified framework too make building other pipelines and applications much easier: docs.circuitforge.tech