New Footage Shows Tesla On Autopilot Crashing Into Police Car After Alerting Driver 150 Times

Comments

• hoodlem@hoodlem.me ⁨1⁩ ⁨year⁩ ago

  In fact, by the time the crash happens, it’s alerted the driver to pay more attention no less than 150 times over the course of about 45 minutes. Nevertheless, the system didn’t recognize a lack of engagement to the point that it shut down Autopilot

  I blame the driver, but if the above is true there was a problem with the Tesla as well. The Tesla is intended to disengage and disable autopilot for the remainder of the drive after a small number of ignored alerts. If the car didn’t do that, there’s a bug in the Tesla software.

  I think it’s more likely the driver used a trick to make the car think he was engaged when he was not. You can do things like put a water bottle wedged in the steering wheel to make the car think you have tugged on the steering wheel to prove you are engaged. (Don’t ask me how I know)

  source

  • NeoNachtwaechter@lemmy.world ⁨1⁩ ⁨year⁩ ago

    The Tesla is intended to disengage and disable autopilot

    What about: slow down, pull up to the right, stop the car, THEN disengage?

    source
  • RushingSquirrel@lemm.ee ⁨1⁩ ⁨year⁩ ago

    After 3 alerts, it’s off until you park. There are visual cues that precede the alert though and these do not count. I don’t recall how many there are and for how long, but you start by seeing a message asking to have your hands on the wheel, then a blue line at the top, them the line starts pulsing ,then you’ve got an audio alert that is the first strike. Three strikes during the same drive and you need to park before using autopilot again.

    source

    • meco03211@lemmy.world ⁨1⁩ ⁨year⁩ ago

      And those alerts don’t come if you’ve overridden the system by putting a weight on the wheel or something.

      source

      • -> View More Comments
• daikiki@lemmy.world ⁨1⁩ ⁨year⁩ ago

  I have a lot of trouble understanding how the NTSB (or whoever’s ostensibly in charge of vetting tech like this) is allowing these not-quite self driving cars on the road. The technology doesn’t seem mature enough to be safe yet, and as far as I can tell, nobody seems to have the authority or be willing to use that authority to make manufacturers step back until they can prove their systems can be integrated safely into traffic.

  source

  • SpaceNoodle@lemmy.world ⁨1⁩ ⁨year⁩ ago

    It’s just ADAS - essentially fancy cruise control. There are a number of autonomous vehicle companies who are carefully and successfully developing real self-driving technology, and Tesla should be censured and forbidden for labeling their assistance software as “full self-driving.” It’s damaging the real industry.

    source
  • RushingSquirrel@lemm.ee ⁨1⁩ ⁨year⁩ ago

    That’s similar to cruise control. Cruise control can be dangerous because someone could fall asleep (not having to manage your speed can afford up sleepiness) and the car wouldn’t slow down.

    In my opinion, those options are all the driver’s responsibility to know their own limit and understand that the tool is just a tool and you are responsible to making sure your driving is safe for others. Tesla autopilot adds a ton of safety features that avoid a lot of collisions based on lacking attention, sleepiness, and actively avoiding other drivers faults. But it’s still just a tool and the driver is responsible of their own car and driving.

    source

    • daikiki@lemmy.world ⁨1⁩ ⁨year⁩ ago

      The difference is that cruise control will maintain your speed, but ‘autopilot’ may avoid or slow down for obstacles. Maybe it avoids obstacles 90% of the time or 99% of the time. It apparently avoids obstacles enough that people can get lulled into a false sense of security, but once in a while it slams into the back of a stationary vehicle at highway speed.

      It’s easy to say it’s the driver’s responsibility, and ultimately it is, of course, but in practice, a system that works almost all of the time but occasionally causally kills somebody is very dangerous indeed, and saying it’s all the driver’s fault isn’t really realistic or fair.

      source

      • -> View More Comments
    • masterairmagic@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

      The problem with Tesla is that their entire marketing is based on “Our cars drives themselves”.

      source
  • Not_Alec_Baldwin@lemmy.world ⁨1⁩ ⁨year⁩ ago

    It’s not “not-quite-self-driving” though, it’s literal garbage. It’s cruise control, lane assist and brake assist. The robot vision in use is horrible.

    There are Tesla engineers bad mouthing the system openly.

    Musk is a scammer and they need to issue an apology for all of the claims around autopilot, probably pay a great deal of money, and then change the name and advertising around it.

    Oh, and also this guy should never drive again.

    source
  • Guy_Fieris_Hair@lemmy.world ⁨1⁩ ⁨year⁩ ago

    $$$ that’s how.

    source
• zerbey@lemmy.world ⁨1⁩ ⁨year⁩ ago

  150 more warnings than a regular car would give, ultimately it’s the driver’s fault.

  source

  • masterairmagic@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

    Tesla actively markets their cars as ‘‘the car drives itself’’.

    source

    • CmdrShepard@lemmy.one ⁨1⁩ ⁨year⁩ ago

      Do we have any evidence from the driver stating that he didn’t realize he was using a glorified cruise control similar to autopilot on an airplane?

      source
    • PR_freak@programming.dev ⁨1⁩ ⁨year⁩ ago

      Source or stfu

      source

      • -> View More Comments
  • ArmokGoB@lemmy.world ⁨1⁩ ⁨year⁩ ago

    If the driver was unresponsive in a normal car, it would stop.

    source

    • sugartits@lemmy.world ⁨1⁩ ⁨year⁩ ago

      The driver was responding. If he didn’t respond the car would have stopped.

      If this was a normal car he probably would have just crashed earlier.

      source
  • Reddit_Is_Trash@reddthat.com ⁨1⁩ ⁨year⁩ ago

    Yes, even in self driving cars the driving is expected to pay attention in case they need to take control in unexpected events

    source
• CaptainProton@lemmy.world ⁨1⁩ ⁨year⁩ ago

  This is stupid. Teslas can park themselves, they’re not just on rails. It should be pulling over and putting the flashers on if a driver is unresponsive.

  source

  • Colorcodedresistor@lemm.ee ⁨1⁩ ⁨year⁩ ago

    [deleted]

    source

    • limelight79@lemm.ee ⁨1⁩ ⁨year⁩ ago

      I turned off the “lane assist” in our Mazda because it kept steering me back toward obstacles I was trying to avoid, like cyclists, oversized loads, potholes, etc. I don’t know why anyone thought that was a good idea.

      But try buying a car without those features now…sigh.

      source

      • -> View More Comments
    • 30mag@lemmy.world ⁨1⁩ ⁨year⁩ ago

      I agree. More regulation may be necessary, but it isn’t a cure-all. It can’t be relied upon to prevent people from being stupid.

      source
  • chris2112@lemmy.world ⁨1⁩ ⁨year⁩ ago

    The driver is responsible for this accident, Tesla still should be liable imo for all the shady and outright misleading advertising around their so called “self driving”. Compare Tesla’s marketing to like GMs of Hyundai’s, both of which essentially have parity with Teslas system in terms of actual features, and you’ll see a big difference

    source
  • doggle@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Sounds like the injured officers are suing. It’s a civil case not criminal, so I’m not sure how much the court would actually be asked to legislate. I’d be interested to hear their arguments, though I’m sure part of their reasoning for suing Tesla over the driver is they have more money.

    source
  • dzire187@feddit.de ⁨1⁩ ⁨year⁩ ago

    It should be pulling over and putting the flashers on if a driver is unresponsive.

    Yes. Actually, just stopping in the middle of the road with hazard lights would be sufficient.

    source

    • CmdrShepard@lemmy.one ⁨1⁩ ⁨year⁩ ago

      You say that yet a Tesla did exactly that, which caused some tailgaters to crash into the back of it, and everyone blamed the Tesla for causing an accident.

      source
• jeena@jemmy.jeena.net ⁨1⁩ ⁨year⁩ ago

  So if the guy behind the wheel died and couldn’t react to the alerts then the car can’t do a decision to just stop instead of crashing into a police car?

  source

  • NathanielThomas@lemmy.world ⁨1⁩ ⁨year⁩ ago

    The video showed that the guy behind the wheel was drunk and letting autopilot work. Apparently autopilot recognized the the emergency vehicles with only 37 metres to impact but instead of braking the system disengaged completely allowing the car to impact at nearly 100 km/h.

    source

    • Wats0ns@programming.dev ⁨1⁩ ⁨year⁩ ago

      Isn’t that in purpose tho ? Like “hey if we’re not sure to be able to break on time, just disengage so it’s not our responsibility anymore”?

      source

      • -> View More Comments
    • Bookmeat@lemmy.world ⁨1⁩ ⁨year⁩ ago

      You don’t answer the question.

      source

      • -> View More Comments
  • pec@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

    He was reacting to alerts, complying to them by simply touching the steering wheel. He did that 150 times during that 45 minute trip ( not all the trip was on auto pilot).

    So if the guy died the car would of disengaged auto pilot (I’m not sure how this works).

    You check the video in the article. It’s quite informative

    source

    • tony@lemmy.hoyle.me.uk ⁨1⁩ ⁨year⁩ ago

      TBH if you’re not used to it the steering wheel check can warn frequently. It’s checking for a small amount of torque on the wheel rather than actually holding it (as there are no pressure sensors) and that catches people out but the prompt says to put your hands on the wheel… I could believe 150 times on a long journey.

      source
• thatKamGuy@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

  Driver is definitely the one ultimately at fault here, but how is it that Tesla doesn’t perform an emergency stop in this situation - but just barrels into an obstacle?

  Even my relatively ‘dumb’ car with adaptive cruise control handles this type of situation better than Tesla?!

  source

  • daikiki@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Your relatively ‘dumb’ car probably doesn’t try to gauge distance exclusively by interpreting visual data from cameras.

    source

    • thatKamGuy@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

      Wait, the Model X doesn’t have RADAR/LIDAR to supplement the cameras?

      source

      • -> View More Comments
  • RushingSquirrel@lemm.ee ⁨1⁩ ⁨year⁩ ago

    I believe this is caused by the fog combined with flashing lights and upward/curved road. The Tesla autopilot system is super impressive in almost all situations but you can clearly see the limits in extreme situations. Here, the drunk driver is definitely at fault, I don’t understand why they’d sue Tesla.

    source

    • meco03211@lemmy.world ⁨1⁩ ⁨year⁩ ago

      I don’t understand why they’d sue Tesla.

      Money. Tesla has much more money than the drunk.

      source
    • themajesticdodo@lemmy.world ⁨1⁩ ⁨year⁩ ago

      Because of Tesla’s exaggerated advertising.

      source
  • NeoNachtwaechter@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Even my relatively ‘dumb’ car […] handles […] better than Tesla?!

    Not going to be the last time when you experience that :-)

    source
• jordanlund@lemmy.one ⁨1⁩ ⁨year⁩ ago

  Don’t see how that’s a Tesla problem… Drunk/high driver operating their car incorrectly.

  source
• NathanielThomas@lemmy.world ⁨1⁩ ⁨year⁩ ago

  One thing I find obnoxious about police or emergency stops on highways is that they simply block lanes without regard for the safety of traffic, expecting their lights and obstruction to cue drivers into stopping or changing lanes. This is nevertheless dangerous.

  When police or emergency stop on a busy freeway where cars exceed 120 km/h and accidents are fatal, you would expect there to be the deployment of cones or other traffic controlling deterrents to alert drivers much earlier to the danger.

  If you watch the video, although the emergency lights are flashing, you basically have cops parked on a highway. Which is honestly just a shitty idea.

  source

  • Obi@sopuli.xyz ⁨1⁩ ⁨year⁩ ago

    You’re completely right and I’ve never seen this for traffic stops in Europe, they’ll make you park somewhere safe, at the very worst, in the emergency lane, but even that is rare for traffic stops. The only times I see lanes blocked is when there’s been an accident/breakdown and then the first thing they do is bring massive light panels well ahead of the spot to make everyone clear the lane.

    source
• hark@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Setting aside the driver issue, isn’t this another case that could’ve been prevented with LIDAR?

  source
• Md1501@lemmy.world ⁨1⁩ ⁨year⁩ ago

  You know what might work, program the car so that after the second unanswered “alert” the autopilot pulls the car over, or reduces speed and turns on the hazards. The third violation of this auto pilot is disabled for that car for a period of time.

  source

  • HalcyonReverb@midwest.social ⁨1⁩ ⁨year⁩ ago

    I drive a Ford Maverick that is equipped with adaptive cruise control, and if I were to get 3 “keep your hands on the wheel” notifications, it deactivates adaptive cruise until the vehicle is completely turned off and on again. It blew my mind to learn that Tesla doesn’t do something similar.

    source

    • tony@lemmy.hoyle.me.uk ⁨1⁩ ⁨year⁩ ago

      It does and did… He kept driving anyway. Drink drivers FTW.

      I presume AEB kicked in but all that can do is reduce the speed of inpact… if you’re determined to kill yourself there’s not much the car can do.

      source

      • -> View More Comments
  • Landmammals@lemmy.world ⁨1⁩ ⁨year⁩ ago

    They didn’t say he didn’t respond to the alerts. If you don’t respond, autopilot turns off.

    source
• n3cr0@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Poor drunk impaired driver falling victim to autonomous driving… Hopefully that driver lost their license.

  source

  • yuki2501@lemmy.world ⁨1⁩ ⁨year⁩ ago

    That doesn’t drive the problem of autopilot not taking the right choices. What is the driver wasn’t drunk, but they had a heart attack? What if someone put a roofie on their drink? What if the driver was diabetic or hypoglycemic and suffered a blood glucose fall? What if they had a stroke?

    Furthermore, what if the driver got drunk BECAUSE the car’s AI was advertised as being able to drive for you? Think of false publicity.

    If your AI can’t handle one simple case of a driver being unresponsive, that’s negligence on the company’s part.

    source

    • CmdrShepard@lemmy.one ⁨1⁩ ⁨year⁩ ago

      How could the company be negligent if someone gets drunk or has a heart attack and crashes their car? No company has a Level 5 autonomous vehicle where no human intervention is needed. Tesla is only Level 2. Mercedes has a Level 3 option (in extremely limited conditions). Waymo claims Level 4 but is geofenced.

      source
• EndOfLine@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Officers injured at the scene are blaming and suing Tesla over the incident. … And the reality is that any vehicle on cruise control with an impaired driver behind the wheel would’ve likely hit the police car at a higher speed. Autopilot might be maligned for its name but drivers are ultimately responsible for the way they choose to pilot any car, including a Tesla.

  I hope those officers got one of those “you don’t pay if we don’t win” lawyers. The responsibility with the driver, and I’m not seeing them getting any money from Tesla.

  source
• Snapz@lemmy.world ⁨1⁩ ⁨year⁩ ago

  This source keeps pushing tesla propaganda. There’s always an angle trying to sell that it wasn’t the tesla’s fault

  source
• liontigerwings@lemmy.world ⁨1⁩ ⁨year⁩ ago

  Hard to argue Tesla at fault when clearly the driver was impaired and at fault here.

  source
• r00ty@kbin.life ⁨1⁩ ⁨year⁩ ago

  I'm not so sure disengaging autopilot because the driver's hands were not on the wheel while on a highway, is the best option. Engage hazard lights, remain in lane (or if able move to the slowest lane) and come to a stop. Surely that's the better way?

  Just disengaging the autopilot seems like such a copout to me. Also the fact it disengaged right at the end "The driver was in control at the moment of the crash" just again feels like bad "self" driving. Especially when the so-called self-driving is able to come to a stop as part of its software in other situations.

  Also if you cannot recognize an emergency vehicle (I wonder if this was a combination of the haze and the usually bright emergency lights saturating the image it was trying to analyse) it's again a sign you shouldn't be releasing this to the public. It's clearly just not ready.

  Not taking any responsibility away from the human driver here. I just don't think the behaviour was good enough for software controlling a car used by the public.

  Not to mention, of course, the reason for suing Tesla isn't because they think they're more liable. It's because they can actually get some money from them.

  source

  • I_LOVE_VEKOMA_SLC@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

    The video is very thorough and goes into the hazy video caused by the flashing lights being one of the issues.

    source

    • NeoNachtwaechter@lemmy.world ⁨1⁩ ⁨year⁩ ago

      That’s not the main problem. It is more like an excuse. The main problem has been explained in the video right before that:

      Their radar is bad at recognizing immobile cars on the road. This means all objects. All obstacles on your road!

      The emergency vehicles just happen to be your most frequent kind of obstacles.

      The fallback to the camera is a bad excuse anyway, because radar is needed first to detect any obstacles. The cam will usually be later (=at closer distance) than the radar.

      The even better solution (Trigger warning: nerdy stuff incoming) is to always mix all results of all kinds of sensors at an early stage in the processing software. That’s what european car makers do right from the beginning, but Tesla is way behind with their engineering. Their sensors still work indepently, and each does their own processing. So every shortcoming of one sensor creates a faulty detection result that has to be covered later (read: seconds later, not milliseconds) by other kinds of sensors.

      source

      • -> View More Comments
    • r00ty@kbin.life ⁨1⁩ ⁨year⁩ ago

      The question here is, could you see there was a reason to stop the car significantly (more than 3 seconds) before the autopilot did? If we can recognize it through the haze the autopilot must too.

      Moreover, it needs to now be extra good at spotting vehicles in bad lighting conditions because other sensors are removed on newer Teslas. It only has cameras to go on.

      source
• redcalcium@lemmy.institute ⁨1⁩ ⁨year⁩ ago

  Data from the Autopilot system shows that it recognized the stopped car 37 yards or 2.5 seconds before the crash.

  Is the video slowed down? In the video, if you pause 2.5s before the crash, the stopped police car seems to be very close already.

  source
• masterairmagic@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

  Tesla’s are not safe.

  source

  • Thorny_Thicket@sopuli.xyz ⁨1⁩ ⁨year⁩ ago

    In the 2nd quarter, we recorded one crash for every 4.41 million miles driven in which drivers were using Autopilot technology (Autosteer and active safety features). For drivers who were not using Autopilot technology (no Autosteer and active safety features), we recorded one crash for every 1.2 million miles driven. By comparison, NHTSA’s most recent data shows that in the United States there is an automobile crash every 484,000 miles.

    Source

    source

    • tiny_electron@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

      There is a bias here in the numbers. Teslas are expensive and not everyone is buying them. The lower accident rate can be explained by the different demographic driving the vehicle rather than Teslas being better. For exemple, younger people might be more likely to cause accident because of different factors and they are also less likely to buy a Tesla because they are so expensive. I dont have the numbers for this, but we should all be careful with the claims of Tesla on safety when they compared themself to the global average.

      source

      • -> View More Comments
    • masterairmagic@sh.itjust.works ⁨1⁩ ⁨year⁩ ago

      So Tesla says. There is no independent verification of this data. It could all be bullshit.

      source

      • -> View More Comments
    • NeoNachtwaechter@lemmy.world ⁨1⁩ ⁨year⁩ ago

      almost 4 times less likely to be involved in a crash than a human driven

      Not relevant at all here, when we are discussing occurences that seem so easily and obviously avoidable.

      source

      • -> View More Comments
• chakan2@lemmy.world ⁨1⁩ ⁨year⁩ ago

  I hope the cops win. Autopilot allows for a driver to completely disengage their attention from the car in a way that’s not possible with just cruise control.

  There’s no way you can drop a human in a life threatening critical situation with 2.5 seconds to make a decision and expect them to make reasonable decisions. Even stone cold sober, that’s a lot to ask of a person when the car makes a critical mistake like this.

  On cruise, the driver would still have to be aware that they were driving. With auto pilot, the driver had likely passed out and the car carried on it merry way.

  source

  • meco03211@lemmy.world ⁨1⁩ ⁨year⁩ ago

    Because people can’t pass out with just cruise control? He didn’t have 2.5 seconds. According to the article he had 45 minutes of multiple warnings.

    source
  • dragoness@lemmy.zip ⁨1⁩ ⁨year⁩ ago

    No, autopilot does not allow for a driver to completely disengage their attention. That’s what they want to get to but that’s not where we are. You still have to drive the car, you still have to be in control.

    I hope Tesla wins this one. We need to set a precedent for this, you can’t be out here driving high, drunk or any type of impairment and just assume you can get around that by your cars technology.

    Granted I agree that the car should slow down, put hazards on and pull you off if you don’t respond by a certain timeframe. There are a few brands that do that and it should be standard.

    source
• TruTollTroll@lemmy.world ⁨1⁩ ⁨year⁩ ago

  So self driving cars, are so self driving… Huh, whodathunk it lol /s

  source
• pizzaiolo@slrpnk.net ⁨1⁩ ⁨year⁩ ago

  It’s what you get when you design places that require cars for everything

  source
• BroederJakob@lemmy.world ⁨1⁩ ⁨year⁩ ago

  It’s also so misleading that Tesla use the word Autopilot for what is basically adaptive cruise control and lane assist

  source
• Peanutbjelly@sopuli.xyz ⁨1⁩ ⁨year⁩ ago

  i still think tesla did a poor job in conveying the limitations on the larger scale. they piggybacked waymo’s capability and practice without matching it, which is probably why so many are over reliant. i’ve always been against mass-producing semi-autonomous vehicles to the general public. this is why.

  and then this garbage is used to attack the general concept of autonomous vehicles, which may become a fantastic life-saver, because then it can safely drive these assholes around.

  source
• ExclamatoryProdundity@lemmy.world ⁨1⁩ ⁨year⁩ ago

  It’s a douche bag trifecta

  Tesla owner, driving drunk Cops, being cops Tesla, overselling their shitty car

  I just hope that innocent bystander gets something from all three of them

  source
• MrSpArkle@lemmy.ca ⁨1⁩ ⁨year⁩ ago

  I think Mercedes is the only car company that will accept blame for a self-driving or self-parking failure. That should tell you something.

  source