The age of majority (or various ages) are somewhat arbitrary, but it has to be drawn somewhere because it’s used to allow a whole bunch of activities rather than just for relationships.

There’s a significant difference between “you must be this age to be considered old enough to make your own choices on a variety of things” and “here’s a specific range of people who you are not allowed to have sexual intercourse with”