In my experience matrix is a total mess with plenty of bugs, also uses quite a lot server resources. xmpp is lighter, easier to set up and works flawlessly, and seem also easier to proxy or do stuff like that with it. Calls are kinda messy to set up tho.