I checked the volumes that I included in the compose file, and looked for either a texlive, tlmgr or a package folder and didn’t find anything. I think it’s safe to assume that you would need to reinstall the packages if you recreated the containers.

This is a problem that I didn’t consider. I will try to make an update to my compose file that will keep the packages persistent.