I don’t know much about Home Assistant, but you could keep that separate on an R.Pi of its own. Or install it as a native app on Debian if you use a desktop OS on your server.

Tinkering is fun. Home server is one of the few projects that have gone through to full completion. Silksong will take up my time for now till I find a new project. Might just make a new macropad for work.