I have all of my email sent to my own domain, so while I would lose previous emails, if my provider just up and shut down, I could just switch to another provider, change a few records on my DNS, and all of my emails would go to my new provider from then on with no problem. I control the domain after the “@” sign.