I was thinking the anime is giving enough detail to vaguely understand the world, but that it didn’t feel like good world building.

It’s disappointing to hear that an anime-only experience feels lost. If they don’t do a good enough job, they might not have a next season. It would be like stopping the story right after the introduction.