Vikunja is the only viable thing. CalDAV spec allows to assign tasks, but we got XMPP moment here - spec exists, but almost no apps implement it properly.

Also you may take a look at github.com/awesome-selfhosted/awesome-selfhosted#…