getenforce gives me Enforcing. And I think I have SELinux. I had a look at this tutorial www.tutorialworks.com/podman-rootless-volumes/ suggested by another commenter and after running podman unshare ls -al in the folder with the bind mount it returns root root as the owner of the directory. So as far as I understand this means for the podman namespace this folder belongs to root? Like I said in my edit using named volumes solved the issue in on way. I just tried the :Z label too and it seems to work too. So it was probably a SELinux issue?