Install tailscale on your vps. Install tailacale on your router. Use tailscale option (on your router) to expose subnet to the tailnet, the subnet being whatever you’re trying to reverse proxy.

Replace tailscale with headscale if you’re paranoid, can run headscale on the vps too if you want to.