Oh my that 4060Ti will reduce the response time to the bare minimum that whisper is capable of i am sure!

You don’t have to customize the docker-compose at all. That’s the plug’n’play part. You have to make sure to build the docker image so it uses the makefile and the run.sh file.

Also make sure your docker environment is able to use the 4060Ti.

Easiest way is to run docker run -it --rm --gpus all ubuntu nvidia-smi and see if you get a proper nvidia-smi