Tesla knew Autopilot caused death, but didn’t fix it::Software’s alleged inability to handle cross traffic central to court battle after two road deaths

  • Lucidlethargy@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    30
    arrow-down
    2
    ·
    1 year ago

    Didn’t, or couldn’t? Tesla uses a vastly inferior technology to run their “automated” driving protocols. It’s a hardware problem first and foremost.

    It’s like trying to drive a car with a 720p resolution camera mounted on the license plate holder versus a 4k monitor on the top of the car. That’s not a perfect analogy, but it’s close enough for those not aware of how cheap these cars and their tech really is.

    • CmdrShepard@lemmy.one
      link
      fedilink
      English
      arrow-up
      9
      ·
      1 year ago

      It remains to be seen what hardware is required for autonomous driving as no company has a fully functioning system, so there is no baseline to compare to. Cruise (the “4k monitor” in your anaology) just had to cut their fleet of geofenced vehicles after back to back crashes involving emergency vehicles along with blocking traffic and attempting to run over things like fire hoses.

    • CmdrShepard@lemmy.one
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      3
      ·
      edit-2
      1 year ago

      https://www.wardsauto.com/blog/my-somewhat-begrudging-apology-ford-pinto

      https://www.latimes.com/archives/la-xpm-1993-02-10-mn-1335-story.html

      Two examples of the media creating a frenzy that wound up being proven completely false later.

      In OP’s case, both of these drivers failed to see a semi crossing the road right in front of them even though they were sitting in the driver’s seat with their hands on the wheel. This technology certainly needs improvement, but this is like blaming every auto manufacturer when someone crashes their car while texting on their phone.

    • Ultraviolet@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      1
      ·
      1 year ago

      Here’s how to do self driving cars in a reliable way. First, instead of cameras that try to use road markings designed for human eyes, use specially designed roads with guide rails on them to ensure it follows a safe path. Second, for added convenience, these roads could also power the cars so you don’t need to stop to charge. Then we could even connect those cars together to increase efficiency. To mitigate the cost, no individual has to own them, they can stop at fixed points to pick up and drop off passengers, charging an affordable rate for each trip, or monthly/annual passes for frequent users. Maybe we could call them trains.

  • gamer@lemm.ee
    link
    fedilink
    English
    arrow-up
    11
    ·
    1 year ago

    I remember reading about the ethical question about the hypothetical self driving car that loses control and can choose to either turn left and kill a child, turn right and kill a crowd of old people, or do nothing and hit a wall, killing the driver. It’s a question that doesn’t have a right answer, but it must be answered by anybody implementing a self driving car.

    I non-sarcastically feel like Tesla would implement this system by trying to see which option kills the least number of paying Xitter subscribers.

    • Liz@midwest.social
      link
      fedilink
      English
      arrow-up
      8
      ·
      1 year ago

      At the very least, they would prioritize the driver, because the driver is likely to buy another Tesla in the future if they do.

    • CmdrShepard@lemmy.one
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 year ago

      I think the whole premise is flawed because the car would have had to have had numerous failures before ever reaching a point where it would need to make this decision. This applies to humans as we have free will. A computer does not.

    • Ocelot@lemmies.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      3
      ·
      1 year ago

      Meanwhile hundreds of people are killed in auto accidents every single day in the US. Even if a self driving car is 1000x safer than a human driver there will still be accidents as long as other humans are also sharing the same road.

  • skymtf@pricefield.org
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    4
    ·
    1 year ago

    I feel like some people are such Tesla fanboys that they will argue when I say Tesla FSD is not real and never has been.

    • _stranger_@lemmy.world
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      6
      ·
      1 year ago

      Probably because calling something “not real” is infuriatingly vague.

      Feel free to expand on your position, I actually do want to know what “not real” means in this context.

      If you mean, from a semantics perspective, that FULL means it should be a completely independent and autonomous system, bravo, you’ve made and won the most uninteresting form of that argument.

      • Liz@midwest.social
        link
        fedilink
        English
        arrow-up
        11
        arrow-down
        3
        ·
        1 year ago

        I mean, don’t call your service something it’s not? Words should have meaning? Tesla’s Autopilot is very impressive, but it’s not fully independent, and that’s okay. Honestly if it had an accurate name people wouldn’t attack it so much. Other manufacturers are gaining similar capabilities but no one is complaining that their cars aren’t perfect either.

        • CmdrShepard@lemmy.one
          link
          fedilink
          English
          arrow-up
          6
          arrow-down
          3
          ·
          1 year ago

          Autopilot is an accurate name as it takes over the mundane portions of the task. Airline pilots don’t just hit a green button on the dash that says “fly” and the autopilot takes over until they hit a red “land” button. You can argue that people have a misconception about the word but the word itself is correct.

          • Liz@midwest.social
            link
            fedilink
            English
            arrow-up
            6
            arrow-down
            2
            ·
            1 year ago

            It’s my understanding that they actually could do that at this point, commerical flying is a controlled and predictable environment compared to driving on the road. Ten years ago I was hearing anecdotes from pilots saying the only thing they do is takeoff and land and even then the computer could handle it just fine if they let it. Maybe the autopilot in a Cesna sucks, but it’s pretty much fully automated in an Airbus.

        • _stranger_@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          3
          ·
          1 year ago

          Yeah that’s a really tired argument. I agree, they should call it whatever will stop people from arguing about the name. Something super generic and meaningless and uncreative that doesn’t encourage conversation. Something like Blue Cruise, ooh, or super cruise!

          At least then 99% of the complaints wouldn’t be about the least possible interesting part of it

      • renohren@partizle.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        1 year ago

        [comment clarification: I confused Autopilot and FSD]

        Yeah they should have called it level 2 autonomous driving, like most other mass market car makers do (except Mercedes which have level 3 on the roads). People could then compare the different limits and clearly see what brands are or are not at the forefront of the tech.

        • Zink@programming.dev
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I did not know that about Mercedes, so I had to go read about it. Level 3 is huge because that’s when the system is approved to not have constant human monitoring. It’s the difference between being able to read a book or use your phone on a boring trip, even if it might not get you fully door to door on many trips.

          It can’t drive you home drunk, and you can’t sleep in your car (you have to be available to take over when requested) but it’s a huge jump in most practical usage.

          • renohren@partizle.com
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            Realisticaly, i think FSD has the potential to be level 3 officially and probably some car makers have the tech to do it too BUT in the EU, if the car has a level 3 autonomous driving, the car maker becomes legally responsible of accidents when the driving conditions are met ( most EU states limit it to highways). For the time being,only Mercedes had the courage to try it (probably because they have ample knowledge of driving assistance through their trucking production.)

    • Ocelot@lemmies.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      3
      ·
      1 year ago

      I have nearly 20k miles on tesla’s FSD platform, it works amazingly well for something thats “not real”. There are countless youtube channels out there where people will mount a gopro in their car and go for a drive. Some of them like AIDRIVR and Whole Mars Catalog pretty much never take over control of the car without any drama. Especially in the past ~6 months or so of development it has been amazing.

  • fne8w2ah@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    Yet Phoney Stark keeps on whinging about the risks of AI but at the same time slags off humans who actually know their stuff especially regarding safety.

  • chakan2@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    1 year ago

    It’s time to give up the Tesla FSD dream. I loved the idea of it when it came out, and believed it would get better over time. FSD simply hasn’t. Worse, Musk has either fired or lost all the engineering talent Telsa had. FSD is only going to get worse from here and it’s time to put a stop to it.

    • Ocelot@lemmies.world
      link
      fedilink
      English
      arrow-up
      0
      arrow-down
      5
      ·
      1 year ago

      That is precisely why autopilot is called a driver assist system. Just like every other manufacturer’s LKAS.

  • Nogami@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    7
    ·
    edit-2
    1 year ago

    Calling it Autopilot was always a marketing decision. It’s a driver assistance feature, nothing more. When used “as intended”, it works great. I drove for 14 hours during a road trip using AP and arrived not dead tired and still alert. That’s awesome, and would never have happened in a conventional car.

    I have the “FSD” beta right now. It has potential, but I still always keep a hand on the wheel and am in control of my car.

    At the end of the day, if the car makes a poor choice because of the automation, I’m still responsible as the driver, and I don’t want an accident, injury, or death on my conscience.

    • silvercove@lemdro.id
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Tesla is producing advertisement videos (already in 2016) that said “our cars drive themselves, you don’t need a driver”. What you said is worthless when Tesla itself is marketing their cars like that.

  • Ocelot@lemmies.world
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    10
    ·
    1 year ago

    Since when has autopilot, especially in 2019, ever had the ability to deal with “cross-traffic” situations? It always has been a glorified adaptive cruise with lanekeeping and has always been advertised as such. Literally the same as any other car with LKAS. Tesla’s self-driving software wasn’t released to the public until 2021/2022.

    Meanwhile about 120 people died in traffic related accidents today in the US.

  • BruinBears@lemmy.world
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    26
    ·
    1 year ago

    I do agree the name and Teslas general advertising of drivers assists are a bit misleading.

    But this is really on the driver for not paying attention.

    • Doug7070@lemmy.world
      link
      fedilink
      English
      arrow-up
      29
      arrow-down
      6
      ·
      1 year ago

      “A bit misleading” is, I think, a bit of a misleading way to describe their marketing. It’s literally called Autopilot, and their marketing material has very aggressively pitched it as a ‘full self driving’ feature since the beginning, even without mentioning Musk’s own constant and ridiculous hyperbole when advertising it. It’s software that should never have been tested outside of vehicles run by company employees under controlled conditions, but Tesla chose to push it to the public as a paid feature and significantly downplay the fact that it is a poorly tested, unreliable beta, specifically to profit from the data generated by its widespread use, not to mention the price they charge for it as if it were a normal, ready to use consumer feature. Everything about their deployment of the system has been reckless, careless, and actively disdainful of their customers’ safety.

      • Thorny_Thicket@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        10
        arrow-down
        11
        ·
        1 year ago

        You don’t even seem to get the terms right so makes me question how well informed you really are on the subject.

        Autopilot is the most basic free driver assist version that comes with every Tesla. Then there’s Enhanced Autopilot which costs extra and is more advanced and lastly there’s Full Self Driving BETA. Even the name indicates you probably shouldn’t trust your life with it.

      • anlumo@feddit.de
        link
        fedilink
        English
        arrow-up
        9
        arrow-down
        17
        ·
        1 year ago

        Everybody who has a bit of an idea what an autopilot in a plane actually does is not mislead. Do people really think that commercial airline pilots just hit the “autopilot” button in their cockpit after disengaging the boarding ramp and then lean back until the boarding ramp at the destination is attached?

        • Einar@lemm.ee
          link
          fedilink
          English
          arrow-up
          17
          arrow-down
          6
          ·
          edit-2
          1 year ago

          So I need to understand the autopilot of a plane first before I buy a car?

          I would be mislead then, as I have no idea how such autopilots work. I also suspect that those two systems don’t really work the same. One flies, the other drives. One has traffic lights, the other doesn’t. One is operated by well paid professionals, the other, well, by me. Call me simple, but there seem to be some major differences.

          • CmdrShepard@lemmy.one
            link
            fedilink
            English
            arrow-up
            0
            arrow-down
            2
            ·
            1 year ago

            This is a pretty absurd argument. You could apply this to literally any facet of driving.

            “I have to learn what each color of a traffic light means before driving?”

            “I have to learn what white and yellow paint means and dashes versus lines? This is too confusing”

            God help you when you get to 4-way stops and roundabouts.

            • Einar@lemm.ee
              link
              fedilink
              English
              arrow-up
              2
              ·
              edit-2
              1 year ago

              Not absurd, but reality. We do that in driving school.

              I don’t know where you are from, of course, but I definitely learned all those lessons you mentioned.

              • CmdrShepard@lemmy.one
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                1 year ago

                That’s precisely my argument and why “learning my new car’s features is too confusing” is an absurd argument.

          • anlumo@feddit.de
            link
            fedilink
            English
            arrow-up
            5
            arrow-down
            8
            ·
            1 year ago

            Yeah, there are some major differences in the vehicles, but both disengage when there’s anything out of the ordinary going on. Maybe people base their understanding of autopilots on the movie “Airplane!” where that inflatable puppet groped the Stewardess afterwards.

              • anlumo@feddit.de
                link
                fedilink
                English
                arrow-up
                2
                ·
                edit-2
                1 year ago

                True, good point. As far as I know, it does turn itself off if it detects something it can’t handle, though. The problem with cross traffic is that it obviously can’t detect it, otherwise turning itself off would already be a way of handling it.

                Proximity detection is far easier up in the air, especially if you’re not bound by the weird requirement to only use visible spectrum cameras.

                (To make things clear, I’m just defending the engineers there who had to work within these constraints. All of this is a pure management failure.)

              • Ocelot@lemmies.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                1 year ago

                I’m sorry, what? If you set an airplane to maintain altitude and heading with autopilot, it will 100% fly you into the side of a mountain if there’s one in front of you.

        • r00ty@kbin.life
          link
          fedilink
          arrow-up
          12
          arrow-down
          2
          ·
          1 year ago

          They’re not buying a plane though. They’re buying a car with an autopilot that is labeled as “full self driving”. That term does imply it will handle a complete route from A to B.

          People are wrongly buying into the marketing hype and that is causing crashes.

          I’m very concerned about some of the things I’ve seen regarding FSD on Teslas. Such as sudden hard braking on highways, failing to avoid an accident (but it’s OK it disengaged seconds before impact so the human was in control) and of course the viral video of FSD trying to kill a cyclist.

          They should not be allowed to market the feature this way and I don’t think it should be openly available to normal users as it is now. It’s just too dangerous to put in the hands (or not) of normal drivers.

          • Ocelot@lemmies.world
            link
            fedilink
            English
            arrow-up
            4
            ·
            edit-2
            1 year ago

            Autopilot has never been “Full Self Driving”. FSD is an additional $15,000 package on top of the car. Autopilot is the free system providing lane keeping with adaptive cruise, same as “Pro Pilot Assist” or “Honda Sensing” or any of the other packages from other car companies. The only difference is whenever someone gets in an accident using any of those technologies we never get headlines about it.

          • anlumo@feddit.de
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            6
            ·
            1 year ago

            I’ve never sat in a Tesla, so I’m not really sure, but based on the things I’ve read online, autopilot and FSD are two different systems on Tesla cars you can engage separately. There shouldn’t be any confusion about this.

            • r00ty@kbin.life
              link
              fedilink
              arrow-up
              2
              ·
              1 year ago

              Well, if it’s just the lane assistance autopilot that is causing this kind of crash. I’d agree it’s likely user error. The reason I say if, is because I don’t trust journalists to know or report on the difference.

              I am still concerned the FSD beta is “out there” though. I do not trust normal users to understand what beta means, and of course no-one is going to read the agreement before clicking agree. They just want to see their car drive itself.

              • anlumo@feddit.de
                link
                fedilink
                English
                arrow-up
                1
                ·
                1 year ago

                If it were about the FSD implementation, things would be very different. I’m pretty sure that the FSD is designed to handle cross traffic, though.

                I do not trust normal users to understand what beta means

                Yeah, Google kinda destroyed that word in the public conciousness when they had their search with the beta flag for more than a decade while growing to be one of the biggest companies on Earth with it.

                When I first heard about it, I was very surprised that the US even allows vehicles with beta self-driving software on public roads. That’s like testing a new fire fighter truck by randomly setting buildings on fire in a city and then trying to stop that with the truck.

              • Ocelot@lemmies.world
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                edit-2
                1 year ago

                Yeah, I don’t trust a machine that has been trained for millions of hours and simulated every possible traffic scenario tens of millions of times and has millisecond reaction time while seeing the world in a full 360 degrees. A system that never drives drunk, distracted or fatigued. You know who’s really good at driving though? Humans. Perfect track record, those humans.

            • Miqo@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              1 year ago

              I’ve never sat in a Tesla, so I’m not really sure

              There shouldn’t be any confusion about this.

              U wot m8?

    • silvercove@lemdro.id
      link
      fedilink
      English
      arrow-up
      9
      ·
      1 year ago

      Back on 2016 Tesla released a video that says “our cars drive themselves, you don’t the driver”.

  • PatFusty@lemm.ee
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    23
    ·
    1 year ago

    The driver was also not even paying attention to the road so the blame should be on him not the car. People need to learn that Tesla’s version of autopilot has a specific use case and regular streets is not that.

  • ColorcodedResistor@lemm.ee
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    28
    ·
    1 year ago

    Software’s inability to handle cross traffic…You mean the Driver’s inability to handle cross traffic, while also trusting his life to a glorified Speak n Spell.