Comment on Is anyone self-hosting their own AI?
Natanox@discuss.tchncs.de 4 days ago Not for complex tasks, really. Gemma4b or similar might be just enough as the backend for a voice assistant replacing Alexa (which I honestly hope, I need to get family members off of that fucking spy devices…). Small web searches might just fit. Or image recognition for Nextcloud Memories, stuff like that.
Immich’s image recognition works fine off the CPU. I did get it running an LMM, but it was useless.