You can boot Pis off an USB HDD or SSD. I think there are specific hats for that as well. But yeah, backups, at least of configs, are nice.