They still took hammers to machines and not the wealthy. The modern variant of Luddites are talking about banning technologies outright instead of uses of said tech. Also, the discussion I’ve seen online is almost always strictly black and white and often ignores the people, instead focusing on the tech.

The actions and words of the Luddites don’t seem reflect what you’re saying from my PoV.