The whole world knows by now that these numbers are good for identifying people, and what a giant data privacy hole it is that they even exist.

No, the giant problem is that you can do everything using only SSN.