Comment on What are the differences between conversation, intents, intent_script, and responses?
mike_wooskey@lemmy.d.thewooskeys.com 7 months agoThanks for all that info, @RandomLegend@lemmy.dbzer0.com!
Currently I’m running HA on a mini-pc with a celeron CPU with some Atom Echos around the house, and it takes 15-30 seconds for HA to respond to a voice command. I have a server with a GeForce 4060Ti (8GB) so I’m going to try to install whisper on it and direct HA to use that whisper service, hopefully reducing the response time to something reasonable. I don’t use Portainer but I think I’ll be able to figure out how to build the images and customize the docker-compose.yaml, thanks to your info.
RandomLegend@lemmy.dbzer0.com 7 months ago
Oh my that 4060Ti will reduce the response time to the bare minimum that whisper is capable of i am sure!
You don’t have to customize the docker-compose at all. That’s the plug’n’play part. You have to make sure to build the docker image so it uses the makefile and the run.sh file.
Also make sure your docker environment is able to use the 4060Ti.
Easiest way is to run
docker run -it --rm --gpus all ubuntu nvidia-smiand see if you get a proper nvidia-smi