Most of the wealthy in the US don’t keep any significant part of their wealth in land.

This is really key. If it was 100 years ago, this would make more sense, but the vast majority of measured wealth created in the world today is in intangible assets, like stock prices.