Yes.

An example of such a DIY container would be: Alpine base + Librewolf + Script to install necessary extensions in Librewolf and configure them + Guacamole as a VNC server. Or maybe just configuring X-forwarding (does that work with Podman) will do.