But isn’t that exactly the situation we’re in now? If there’s a car in the opposing left turn lane, they might start to turn in front of you.

The only thing the light does is say “right now, they’re braking”. It doesn’t say whether they’re moving or stationary any more than the headlights, and it doesn’t say anything about their intentions or whether it’s safe to enter the intersection.