Surprised nobody has mentioned this yet, but the Paralympics may bear you out to some extent. In a lot of events their finish times are similar to normal Olympians, suggesting the reduced weight burden compensates significantly for reduced physical ability.

(It’s not super clear cut, because apples, oranges, and bouncy prosthetics).