To be fair, the Tesla vision system has 3 cameras facing forward. One in the center above the front bumper grille and two behind the rear view mirror. Those two provide some level of stereoscopic vision to help judge distances.

But yeah, the lack of other sensors is a huge issue. Anything from bug splatter to mud to snow etc. can easily obscure one or more cameras and render the whole vision system unreliable.