https://spectrum.ieee.org/self-driving-cars [ ] IEEE.orgIEEE Xplore Digital LibraryIEEE StandardsMore Sites Sign InJoin IEEE A Former Pilot On Why Autonomous Vehicles Are So Risky Share FOR THE TECHNOLOGY INSIDER Search: [ ] Explore by topic AerospaceArtificial IntelligenceBiomedicalComputingConsumer ElectronicsEnergyHistory of TechnologyRoboticsSemiconductorsSensors TelecommunicationsTransportation IEEE Spectrum FOR THE TECHNOLOGY INSIDER Topics AerospaceArtificial IntelligenceBiomedicalComputingConsumer ElectronicsEnergyHistory of TechnologyRoboticsSemiconductorsSensors TelecommunicationsTransportation Sections FeaturesNewsOpinionCareersDIYThe Big PictureEngineering Resources More Special ReportsCollectionsExplainersPodcastsVideosNewslettersTop Programming LanguagesRobots Guide For IEEE Members Current IssueMagazine ArchiveThe InstituteTI Archive For IEEE Members Current IssueMagazine ArchiveThe InstituteTI Archive IEEE Spectrum About UsContact UsReprints & PermissionsAdvertising Follow IEEE Spectrum Support IEEE Spectrum IEEE Spectrum is the flagship publication of the IEEE -- the world's largest professional organization devoted to engineering and applied sciences. Our articles, podcasts, and infographics inform our readers about developments in technology, engineering, and science. Join IEEE Subscribe About IEEEContact & SupportAccessibilityNondiscrimination PolicyTerms IEEE Privacy Policy (c) Copyright 2023 IEEE -- All rights reserved. A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. IEEE websites place cookies on your device to give you the best user experience. By using our websites, you agree to the placement of these cookies. To learn more, read our Privacy Policy. view privacy policy accept & close Enjoy more free content and benefits by creating an account Saving articles to read later requires an IEEE Spectrum account The Institute content is only available for members Downloading full PDF issues is exclusive for IEEE Members Access to Spectrum's Digital Edition is exclusive for IEEE Members Following topics is a feature exclusive for IEEE Members Adding your response to an article requires an IEEE Spectrum account Create an account to access more content and features on IEEE Spectrum, including the ability to save articles to read later, download Spectrum Collections, and participate in conversations with readers and editors. For more exclusive content and features, consider Joining IEEE. Join the world's largest professional organization devoted to engineering and applied sciences and get access to all of Spectrum's articles, archives, PDF downloads, and other benefits. Learn more - CREATE AN ACCOUNTSIGN IN JOIN IEEESIGN IN Close Special offer: Join IEEE now for 2023 and save 50%! IEEE Members receive 12 print issues of IEEE Spectrum and enjoy PDF downloads, full access to our archive with thousands of in-depth articles, and other exclusive content and features. Join IEEE today for 2023 and save 50%! JOIN IEEE TransportationTopicMagazineArticleType A Former Pilot On Why Autonomous Vehicles Are So Risky 5 questions for transportation-safety expert Missy Cummings Philip E. Ross 13 May 2023 3 min read A photo illustration of Missy Cummings with colors and shapes. Stuart Bradford type:departmentsautonomous vehicles5 questionsself drivingTesla In October 2021, Missy Cummings left her engineering professorship at Duke University to join the National Highway Transportation Safety Administration (NHTSA) in a temporary position as a senior safety advisor. It wasn't long before Elon Musk tweeted an attack: "Objectively, her track record is extremely biased against Tesla." He was referring to Cummings's criticism of his company's Autopilot, which is supposed to help the driver drive, though some customers have used it to make the car drive itself--sometimes with disastrous results. Some of Musk's fans followed his lead: Cummings received a slew of online attacks, some of them threatening. As a former Navy fighter pilot,Cummings was used to living dangerously. But she hates taking unnecessary risks, particularly on the road. At NHTSA, she scrutinized data on cars operating under varying levels of automation, and she pushed for safer standards around autonomy. Now out of the government and in a new academic perch at George Mason University, she answered five high-speed questions from IEEE Spectrum. We are told that today's cars, with their advanced driver-assistance systems (ADAS), are fundamentally safer than ever before. True? Cummings: There is no evidence of mitigation. At NHTSA we couldn't answer the question that you're less likely to get in a crash--no data. But if you are in an accident, you're more likely to be injured, because people in ADAS-equipped cars are more likely to be speeding. Could it be that people are trading the extra safety these systems might otherwise have provided for other things, like getting home 3 minutes sooner? Cummings: I call it risk homeostasis. It's a big problem with Tesla, for example. You're told it has self-driving capability, with all these features, such as automatic braking. Oh, the car is going to do x, y, and z for me, and then it turns out that it doesn't. Did you observe risk homeostasis back in your fighter-pilot days? Cummings: It happened with air-to-ground bombing radar. Pilots figured out that you could use it to set up a self-contained approach to an aircraft carrier and then manage the landing by yourself. Given the control freaks that pilots are, it happened. But the system didn't adjust for the pitching deck, so it set people up for much more lethal approaches. Some have said that partial autonomy is the riskiest solution of all. What's your take? The policy should be that either the computer is driving or you are driving. And by driving I mean steering--people do fine with regular cruise control. The act of keeping your hands on the wheel and guiding the car's lateral motion is enough to keep your brain engaged. So, no L3 [full self-driving, but the driver must be ready to take the wheel], which is too confusing, and no hands-free L2 [partial self-driving]. I am not against the passing of control per se, but there should just be two modes of operation, with crystal clear feedback about which mode you are in. When do you think true self-driving cars will come? Cummings: It's possible to do self-driving in narrow applications. Waymo has been giving rides for a long time in Chandler [Ariz.]. That environment is very structured, and it's much easier to operate these systems in. My favorite application is last-mile delivery, say, food delivery; it could be very helpful when, say, viruses spike. But the day when AI in cars can handle all conditions on the road, all of the time--it's not going to be in my lifetime. Mary (Missy) L. Cummings is the director of the Autonomy and Robotics Center at George Mason University and a senior member of IEEE. She received a Ph.D. in systems engineering from the University of Virginia. From Your Site Articles * IEEE Standard Will Make Autonomous Vehicles Safer > * Autonomous Vehicles Should Start Small, Go Slow > Related Articles Around the Web * In San Francisco hundreds of self-driving cars are flooding the roads ... > * Automated Vehicle Safety | NHTSA > type:departmentsautonomous vehicles5 questionsself drivingTesla Philip E. Ross Philip E. Ross is a senior editor at IEEE Spectrum. His interests include transportation, energy storage, AI, and the economic aspects of technology. He has a master's degree in international affairs from Columbia University and another, in journalism, from the University of Michigan. The Conversation (0) A photo of an antique contraption having glass disks, a wooden base, and supporting wires. History of TechnologyTopicMagazineArticleType James Wimshurst's Electrostatic Immortality 6h 4 min read A white haired man with a beard and mustache sits at a table with his hands folded, in front of a white board with notes on it. ComputingTopicTypeCareersNews Vint Cerf's Career Advice for Engineers 7h 1 min read Software screenshot shows a satellite image with red dots, and yellow plane icons. TransportationTopicTypeNews Big Players, Bigger Bets on eVTOLs and Air Taxis 13 May 2023 3 min read Related Stories CareersTopicMagazineTypeProfile From EE to VC: Eileen Tanghal's Journey History of TechnologyTopicAerospaceMagazineArticleTypeMay 2023 Skylab: The Space Station That Fell on Australia Artificial IntelligenceTopicMagazineTypeInterviewMay 2023 Stable Attribution Identifies the Art Behind AI Images