I saw a really interesting video on this recently, actually.

Daniel Mackler: An Analysis of People who don’t like children

He’s an ex-therapist. Video is pretty short. He posits that people who didn’t like who they were as children dislike children.