I’ve had uber drivers cancel on me because they don’t want to enter a gate code. Because it’s inconvenient, could be error prone, and slows them down (I would assume.) So it might not always be privacy concerns but also inconvenience.