If this is your first time trying to selfhost I highly recommend Cosmos Cloud, I’ve been using it for 6 months and it’s made every step of the way so much easier for me. It manages docker containers and has included reverse proxy and security features, with paid option for personal VPN like tailscale.

Most services work perfectly from a catalog of pre-built docker compose files, but Jellyfin I remember I did have to go to the internal docker IP on the actual host machine to set the server up and working properly from other machines