https://spectrum.ieee.org/ai-pause-letter-stokes-fear [ ] IEEE.orgIEEE Xplore Digital LibraryIEEE StandardsMore Sites Sign InJoin IEEE The April 2023 issue of IEEE Spectrum is here! Download PDF | Close bar 'AI Pause' Open Letter Stokes Fear and Controversy Share FOR THE TECHNOLOGY INSIDER Search: [ ] Explore by topic AerospaceArtificial IntelligenceBiomedicalComputingConsumer ElectronicsEnergyHistory of TechnologyRoboticsSemiconductorsSensors TelecommunicationsTransportation IEEE Spectrum FOR THE TECHNOLOGY INSIDER Topics AerospaceArtificial IntelligenceBiomedicalComputingConsumer ElectronicsEnergyHistory of TechnologyRoboticsSemiconductorsSensors TelecommunicationsTransportation Sections FeaturesNewsOpinionCareersDIYThe Big PictureEngineering Resources More Special ReportsCollectionsExplainersPodcastsVideosNewslettersTop Programming LanguagesRobots Guide For IEEE Members Current IssueMagazine ArchiveThe InstituteTI Archive For IEEE Members Current IssueMagazine ArchiveThe InstituteTI Archive IEEE Spectrum About UsContact UsReprints & PermissionsAdvertising Follow IEEE Spectrum Support IEEE Spectrum IEEE Spectrum is the flagship publication of the IEEE -- the world's largest professional organization devoted to engineering and applied sciences. Our articles, podcasts, and infographics inform our readers about developments in technology, engineering, and science. Join IEEE Subscribe About IEEEContact & SupportAccessibilityNondiscrimination PolicyTerms IEEE Privacy Policy (c) Copyright 2023 IEEE -- All rights reserved. A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. IEEE websites place cookies on your device to give you the best user experience. By using our websites, you agree to the placement of these cookies. To learn more, read our Privacy Policy. view privacy policy accept & close Enjoy more free content and benefits by creating an account Saving articles to read later requires an IEEE Spectrum account The Institute content is only available for members Downloading full PDF issues is exclusive for IEEE Members Access to Spectrum's Digital Edition is exclusive for IEEE Members Following topics is a feature exclusive for IEEE Members Adding your response to an article requires an IEEE Spectrum account Create an account to access more content and features on IEEE Spectrum, including the ability to save articles to read later, download Spectrum Collections, and participate in conversations with readers and editors. For more exclusive content and features, consider Joining IEEE. Join the world's largest professional organization devoted to engineering and applied sciences and get access to all of Spectrum's articles, archives, PDF downloads, and other benefits. Learn more - CREATE AN ACCOUNTSIGN IN JOIN IEEESIGN IN Close Special offer: Join IEEE now for 2023 and save 50%! IEEE Members receive 12 print issues of IEEE Spectrum and enjoy PDF downloads, full access to our archive with thousands of in-depth articles, and other exclusive content and features. Join IEEE today for 2023 and save 50%! JOIN IEEE The InstituteTopicArtificial IntelligenceTypeNews 'AI Pause' Open Letter Stokes Fear and Controversy IEEE signatories say they worry about ultrasmart, amoral systems without guidance Margo Anderson 4h 3 min read The letters Ai with a pause symbol in the dot for the i. 4 hands are reaching in with writing implements as if signing it. iStock/IEEE Spectrum aiai ethical designai pauseartificial intelligenceethicsieee member newslarge-language modelstype:ti The recent call for a six-month "AI pause"--in the form of an online letter demanding a temporary artificial intelligence moratorium--has elicited concern among IEEE members and the larger technology world. The Institute contacted some of the members who signed the open letter, which was published online on 29 March. The signatories expressed a range of fears and apprehensions including about rampant growth of AI large-language models (LLMs) as well as of unchecked AI media hype. The open letter, titled "Pause Giant AI Experiments," was organized by the nonprofit Future of Life Institute and signed by more than 10,000 people (as of 5 April). It calls for cessation of research on "all AI systems more powerful than GPT-4." It's the latest of a host of recent "AI pause" proposals including a suggestion by Google's Francois Chollet of a six-month "moratorium on people overreacting to LLMs" in either direction. In the news media, the open letter has inspired straight reportage, critical accounts for not going far enough ("shut it all down," Eliezer Yudkowsky wrote in Time magazine), as well as critical accounts for being both a mess and an alarmist distraction that overlooks the real AI challenges ahead. IEEE members have expressed a similar diversity of opinions. "AI can be manipulated by a programmer to achieve objectives contrary to moral, ethical, and political standards of a healthy society," says IEEE Fellow Duncan Steel, a professor of electrical engineering, computer science, and physics at the University of Michigan, in Ann Arbor. "I would like to see an unbiased group without personal or commercial agendas to create a set of standards that has to be followed by all users and providers of AI." IEEE Senior Life Member Stephen Deiss--a retired neuromorphic engineer from the University of California, San Diego--says he signed the letter because the AI industry is "unfettered and unregulated." "This technology is as important as the coming of electricity or the Net," Deiss says. "There are too many ways these systems could be abused. They are being freely distributed, and there is no review or regulation in place to prevent harm." Eleanor "Nell" Watson, an AI ethicist who has taught IEEE courseson the subject, says the open letter raises awareness over such near-term concerns as AI systems cloning voices and performing automated conversations--which she says presents a "serious threat to social trust and well-being." Although Watson says she's glad the open letter has sparked debate, she says she confesses "to having some doubts about the actionability of a moratorium, as less scrupulous actors are especially unlikely to heed it." "There are too many ways these systems could be abused. They are being freely distributed, and there is no review or regulation in place to prevent harm." IEEE Fellow Peter Stone, a computer science professor at the University of Texas at Austin, says some of the biggest threats posed by LLMs and similar big-AI systems remain unknown. "We are still seeing new, creative, unforeseen uses--and possible misuses--of existing models," Stone says. "My biggest concern is that the letter will be perceived as calling for more than it is," he adds. "I decided to sign it and hope for an opportunity to explain a more nuanced view than is expressed in the letter. "I would have written it differently," he says of the letter. "But on balance I think it would be a net positive to let the dust settle a bit on the current LLM versions before developing their successors." IEEE Spectrum has extensivelycovered one of the Future of Life Institute's previous campaigns, urging a ban on "killer robots." The outlines of the debate, which began with a 2016 open letter, parallel the criticism being leveled at the current "AI pause" campaign: that there are real problems and challenges in the field that, in both cases, are at best poorly served by sensationalism. One outspoken AI critic, Timnit Gebru of the Distributed AI Research Institute, is similarly critical of the open letter. She describes the fear being promoted in the "AI pause" campaign as stemming from what she calls "long-termism"--discerning AI's threats only in some futuristic, dystopian sci-fi scenario, rather than in the present day, where AI's bias amplification and power concentration problems are well known. IEEE Member Jorge E. Higuera, a senior systems engineer at Circontrol in Barcelona, says he signed the open letter because "it can be difficult to regulate superintelligent AI, particularly if it is developed by authoritarian states, shadowy private companies, or unscrupulous individuals." IEEE Fellow Grady Booch, chief scientist for software engineering at IBM, signed although he also, in his discussion with The Institute, cited Gebru's work and reservations about AI's pitfalls. "Generative models are unreliable narrators," Booch says. "The problems with large-language models are many: There are legitimate concerns regarding their use of information without consent; they have demonstrable racial and sexual biases; they generate misinformation at scale; they do not understand but only offer the illusion of understanding, particularly for domains on which they are well-trained with a corpus that includes statements of understanding. "These models are being unleashed into the wild by corporations who offer no transparency as to their corpus, their architecture, their guardrails, or the policies for handling data from users. My experience and my professional ethics tell me I must take a stand, and signing the letter is one of those stands." Please share your thoughts in the comments section below. From Your Site Articles * Hallucinations Could Blunt ChatGPT's Success > * IEEE Global Initiative Aims to Advance Ethical Design of AI and Autonomous Systems > * How ChatGPT Could Revolutionize Academia > Related Articles Around the Web * Bill Gates, AI developers push back against Musk, Wozniak open letter > * Pause Giant AI Experiments: An Open Letter - Future of Life Institute > aiai ethical designai pauseartificial intelligenceethicsieee member newslarge-language modelstype:ti Margo Anderson Margo Anderson is the news manager at IEEE Spectrum. She has a bachelor's degree in physics and a master's degree in astrophysics. The Conversation (0) A robot hand with soft purple fingers gently grasps a pink marshmallow Peep RoboticsTopicTypeNews Video Friday: Peep Handling 6h 3 min read image of gray cubes on left and yellow 3d object with lines linking together on right SemiconductorsTopicTypeRoboticsNews Holograms Supercharge Nanoscale 3D Printing 7h 4 min read A square with a colorful square inset that is pink and green and covered with dots. EnergyTopicNewsType Oxygen-Ion Battery Unlocks Green-Grid Promise 8h 2 min read More from The Institute The InstituteTopicTypeCareersOpinion Survey Shows Overwhelming Interest in a Four-Day Workweek The InstituteTopicTypeNews Remembering the Legacy of Trailblazing Technologist Gordon Moore The InstituteTopicArticleTypeCareers Why Governments' Involvement in Standards Development is Crucial The InstituteTopicTypeCareersNews New Award Recognizes IEEE Society's Work in DEI The InstituteTopicTypeSensorsProfile Millimeter Wave Radar System Keeps Drivers Safe on the Road