Although the point is kind of moot - because of all the people who know you, that do willingly share their everything (including their phone contacts, photos etc), Facebook already has a You-shaped hole, even if you don’t have an account.

My favourite bit of the WhatsApp terms and conditions is where you agree that you have permission to share the information from your contacts. So, even if you go out of your way and tell WhatsApp you object to them using your data, someone else will supercede that when they accept WhatsApp’s terms.