You’re not dumb as fuck.
It’s a common misconception. Wasn’t even really until around the time of Queen Isabella (Might have the wrong queen as it’s pretty late here) that fair skin was considered preferable and a sign of religious purity.
Humans are a weird species.