Perhaps “clear reference” isn’t the issue. Both the equator and prime meridian are clearly defined.

The equator is kind of a natural landmark, arising from the tilt of the planet. Greenwich is a place built by humans. I think that’s the rub.