I only personally have experience with jellyfin, but the docs of Emby look to support the same remote access as Plex (without the TURN server).

So essentially you can use a login instead of a server IP, but it does require port forwarding or upnp on your router - which you may already have enabled.