It’s SUCH a battle. The only people I had on Signal were my immediate family. I just replaced it with my own XMPP server so my kids can join without a SIM.