Yeah, people tend to have that problem, especially if they’re treating it like driving a car. If you want to fly manual, never fly more than 400 m/s, because then you won’t have enough time to slow down.

My actual advice though is to just use autopilot. People seem to forget that you can cancel autopilot. If you start to see that there’s something getting in your way, cancel the autopilot and push the ship to the left or right (it’s easier to go around the planet than to slow down). Once you’re clear, resume autopilot.