but if you apply the same rate to the homes that average people have to buy you’re going to end up in a shitty spot

And that’s why you don’t do that and instead make progressive taxation a thing.

If taxing the rich is the goal we shouldn’t be talking about property taxes on single family homes unless it’s specifically related to second and third homes.

Nah. It is good and correct to tax extremely large single-family homes at high rates even if they’re primary residences.