There’s usually a lot of private data in the home folder. I feel compromise or loss of my phone is a greater risk than loss of my home folder. I’d use an SD card before I’d use a phone.