Putting everything in one folder/directory and let the metadata speak for itself is just calling for a nightmare later one (same goes for folder/directory structure without metadata!).

I am not doing that. I’ll guess here that you aren’t familiar with the way calibre Web and CWA work?