I run a Nextcloud server and use DavX5 on my phone to sync my contacts and calendars over WebDAV. Works great.

If Nextcloud is more than you need, you might try Radicale which just does CalDAV and CardDAV.