Comment on What's up, selfhosters? - Sunday thread
pezhore@infosec.pub 2 weeks ago
I spun up a new Plex server with a decent GPU - and decided to try offloading Home Assistant’s Preview Voice Assistant TTS/STT to it. That’s all working as of yesterday, including an Ollama LLM for processing.
Last on my list is figuring out how to get Home Assistant to help me find my phone.
kalpol@lemmy.world 2 weeks ago
Got any links for howtos on this?
pezhore@infosec.pub 2 weeks ago
Sure! I mostly followed this random youtuber’s video for getting Wyoming protocols offloaded (Whisper/Piper), but he didn’t get Ollama to use his GPU: youtu.be/XvbVePuP7NY.
For getting the Nvidia/Docker passthrough, I used this guide: bittenbypython.com/…/install_ollama_openwebui_ubu….
It’s working fairly great at this point!