It does make me wonder how far could we push self-hosted models. Speech to text by itself is already doable faster than real-time with a 1070 using OpenAI’s whisper model. Maybe in 10 years from now it will be trivial to have a self-hosted AI personal assistant? It doesn’t need to do absolutely everything right or blazingly fast to be useful enough for day-to-day house and work assistance.