Report Suggests Rampant Negligence In Uber Self Driving Car Fatality

from the I'm-sorry-I-can't-do-that,-Dave dept

Earlier this year you might recall that a self-driving Uber in Tempe, Arizona killed a woman who was trying to cross the street with her bike outside of a crosswalk. The driver wasn't paying attention, and the car itself failed to stop for the jaywalking pedestrian. Initial reporting on the subject, most of it based on anonymous Uber sources who spoke to the paywalled news outlet The Information, strongly pushed the idea that the car's sensors worked as intended and detected the woman, but bugs in the system software failed to properly identify the woman as something to avoid:

"The car’s sensors detected the pedestrian, who was crossing the street with a bicycle, but Uber’s software decided it didn’t need to react right away. That’s a result of how the software was tuned. Like other autonomous vehicle systems, Uber’s software has the ability to ignore “false positives,” or objects in its path that wouldn’t actually be a problem for the vehicle, such as a plastic bag floating over a road. In this case, Uber executives believe the company’s system was tuned so that it reacted less to such objects. But the tuning went too far, and the car didn’t react fast enough, one of these people said."

Thanks to that report, a narrative emerged that the vehicle largely worked as designed, and the only real problem was a modest quirk in uncooked programming.

But a new report by Bloomberg this week shatters that understanding. According to NTSB findings seen by Bloomberg, the vehicle in question wasn't even programmed to detect jaywalkers. Like, at all:

"Uber Technologies Inc.’s self-driving test car that struck and killed a pedestrian last year wasn’t programmed to recognize and react to jaywalkers, according to documents released by U.S. safety investigators."

Assuming Bloomberg's read of the 400 page report (only a part of which has been made public) is accurate, that's a far cry from a bug. The NTSB report found that Uber staff had also disabled Volvo auto-detection and breaking software that could have at least slowed the vehicle if not avoided the pedestrian impact altogether. Investigators also noted that despite the fact that Uber was conducting risky trials on public streets, the company had little to no real system in place for dealing with safety issues. Again, not just underwhelming public safety protocols, but none whatsoever:

"The Uber Advanced Technologies Group unit that was testing self-driving cars on public streets in Tempe didn’t have a standalone safety division, a formal safety plan, standard operating procedures or a manager focused on preventing accidents, according to NTSB."

Again, that's not just buggy or "poorly tuned" software, it's total negligence. Despite the fact the driver was distracted, the car was never adequately programmed to detect jaywalkers, some safety features were disabled, and Uber had little to no safety protocols in place, prosecutors have already absolved Uber of criminal liability (though the driver still may face a lawsuit). The NTSB also hasn't formally affixed blame for the crash (yet):

"The documents painted a picture of safety and design lapses with tragic consequences but didn’t assign a cause for the crash. The safety board is scheduled to do that at a Nov. 19 meeting in Washington."

Self driving cars are remarkably safe, and most accidents involve autonomous vehicles getting confused when people actually follow the law (like rear ending a human-driven vehicle that stopped at a red light before turning right). But that's only true when the people designing and conducting trials are competent. If the NTSB report is anything to go by, Uber fell well short, yet got to enjoy a lot of press suggesting the problem was random bad programming luck, not total negligence and incompetence. Later this month we'll get to see if Uber faces anything resembling accountability for its failures.

Filed Under: arizona, autonomous vehicles, jaywalkers, self driving cars, sensors, tempe
Companies: uber


Reader Comments

Subscribe: RSS

View by: Time | Thread


  1. icon
    Thad (profile), 6 Nov 2019 @ 2:13pm

    Earlier this year you might recall that a self-driving Uber in Tempe, Arizona killed a woman who was trying to cross the street with her bike outside of a crosswalk.

    I suppose it's technically accurate to say that you might recall it that way, but if you do, your recollection is wrong. It happened last year.

    On-topic: Sadly, this is unsurprising. This is the entirely foreseeable result of Uber choosing Arizona for its lack of safety regulations.

    There was a bit in last year's gubernatorial debate, when challenger David Garcia criticized Governor Doug Ducey for allowing Uber to test its AVs without proper safety oversight. Ducey responded by protesting that as soon as it became clear that Uber was unsafe, he immediately barred them from further tests.

    I was flabbergasted when Garcia let that remark pass unchallenged. He should have said "But you waited until somebody died to take any action." I think Garcia's poor debate performance is a big part of why Ducey was reelected.

    Better late than never; at least Uber's not testing its AVs here anymore. Waymo continues to operate in the Phoenix area, but hasn't been involved in any fatal collisions as of yet. I do think it's a little premature to declare that "self driving cars are remarkably safe" (though I suppose that depends on what you mean by "remarkably"); there simply aren't enough miles driven to make an accurate comparison between the safety of an AV compared to the safety of an average human driver. But so far, at least, Waymo's done pretty well.


Add Your Comment

Have a Techdirt Account? Sign in now. Want one? Register here



Subscribe to the Techdirt Daily newsletter




Comment Options:

  • Use markdown. Use plain text.
  • Remember name/email/url (set a cookie)

Follow Techdirt
Insider Shop - Show Your Support!

Advertisement
Report this ad  |  Hide Techdirt ads
Essential Reading
Techdirt Deals
Report this ad  |  Hide Techdirt ads
Techdirt Insider Chat
Advertisement
Report this ad  |  Hide Techdirt ads
Recent Stories
Advertisement
Report this ad  |  Hide Techdirt ads

Close

Email This

This feature is only available to registered users. Register or sign in to use it.