I’ve been running birdnetpi on a raspberry pi 3 for years. It runs very well on this modest hardware. I also run birdnet-go in a docker container and use my reolink security cameras for the RSTP audio feed to that instance.

There are all sorts of AI/ML models available that can run on smaller hardware. But they are usually very specific and not general purpose, like the LLMs.