As long as you set your home server properly, with allow rules, firewalls and stuff, you’ll be fine

But don’t be sloppy, take care of your server