It never could go the other way, you can’t make a baby using two dads’ sperm. You can get twins (which is incredibly rare). But that just means two people with different fathers and doesn’t matter when you look at a specific one. At best, if there wasn’t any incest, you’d get equal male and female ancestors.