That argument falls apart if the scientific world is imperfect in some way. It was not that long ago that “race sciences” were a rather undisputed thing, even worse if you get into the psychiatric field, eugenics and all.