Technically, yes. And SCOTUS found a bit of a spine and upheld that.

They would also stay citizens if their other parent was one.