i had radicale working as you describe with home assistant and mobile/desktop apps for years