https://www.theverge.com/2024/5/24/24164119/google-ai-overview-mistakes-search-race-openai Skip to main content The Verge logo.The Verge homepage * The Verge homepageThe Verge logo./ * Tech/ * Reviews/ * Science/ * Entertainment/ * AI/ * MoreMenu The Verge logo. Menu * Google/ * Tech/ * Artificial Intelligence Google scrambles to manually remove weird AI answers in search Google scrambles to manually remove weird AI answers in search / The company confirmed it is 'taking swift action' to remove some of the AI tool's bizarre responses. By Kylie Robison, a senior AI reporter working with The Verge's policy and tech teams. She previously worked at Fortune Magazine and Business Insider. May 25, 2024, 12:10 AM UTC Share this story * * * If you buy something from a Verge link, Vox Media may earn a commission. See our ethics statement. Hands with additional fingers typing on a keyboard. Image: Alvaro Bernis / The Verge Social media is abuzz with examples of Google's new AI Overview product saying weird stuff, from telling users to put glue on their pizza to suggesting they eat rocks. The messy rollout means Google is racing to manually disable AI Overviews for specific searches as various memes get posted, which is why users are seeing so many of them disappear shortly after being posted to social networks. It's an odd situation, since Google has been testing AI Overviews for a year now -- the feature launched in beta in May 2023 as the Search Generative Experience -- and CEO Sundar Pichai has said the company served over a billion queries in that time. But Pichai has also said that Google's brought the cost of delivering AI answers down by 80 percent over that same time, "driven by hardware, engineering and technical breakthroughs." It appears that kind of optimization might have happened too early, before the tech was ready. "A company once known for being at the cutting edge and shipping high-quality stuff is now known for low-quality output that's getting meme'd," one AI founder, who wished to remain anonymous, told The Verge. Google continues to say that its AI Overview product largely outputs "high quality information" to users. "Many of the examples we've seen have been uncommon queries, and we've also seen examples that were doctored or that we couldn't reproduce," Google spokesperson Meghann Farnsworth said in an email to The Verge. Farnsworth also confirmed that the company is "taking swift action" to remove AI Overviews on certain queries "where appropriate under our content policies, and using these examples to develop broader improvements to our systems, some of which have already started to roll out." Gary Marcus, an AI expert and an emeritus professor of neural science at New York University, told The Verge that a lot of AI companies are "selling dreams" that this tech will go from 80 percent correct to 100 percent. Achieving the initial 80 percent is relatively straightforward since it involves approximating a large amount of human data, Marcus said, but the final 20 percent is extremely challenging. In fact, Marcus thinks that last 20 percent might be the hardest thing of all. "You actually need to do some reasoning to decide: is this thing plausible? Is this source legitimate? You have to do things like a human fact checker might do, that actually might require artificial general intelligence," Marcus said. And Marcus and Meta's AI chief Yann LeCun both agree that the large language models that power current AI systems like Google's Gemini and OpenAI's GPT-4 will not be what creates AGI. Look, it's a tough spot for Google to be in. Bing went big on AI before Google did with Satya Nadella's famous "we made them dance" quote, OpenAI is reportedly working on its own search engine, a fresh AI search startup is already worth $1 billion, and a younger generation of users who just want the best experience are switching to TikTok. The company is clearly feeling the pressure to compete, and pressure is what makes for messy AI releases. Marcus points out that in 2022, Meta released an AI system called Galactica that had to be taken down shortly after its launch because, among other things, it told people to eat glass. Sounds familiar. Google has grand plans for AI Overviews -- the feature as it exists today is just a tiny slice of what the company announced last week. Multistep reasoning for complex queries, the ability to generate an AI-organized results page, video search in Google Lens -- there's a lot of ambition here. But right now, the company's reputation hinges on just getting the basics right, and it's not looking great. "[These models] are constitutionally incapable of doing sanity checking on their own work, and that's what's come to bite this industry in the behind," Marcus said. Most Popular Most Popular 1. EcoFlow's $200 PowerStream is so clever, you might buy a $4,000 solar generator ----------------------------------------------------------------- 2. Google scrambles to manually remove weird AI answers in search ----------------------------------------------------------------- 3. Samsung Galaxy Watch 7 'Ultra' leaks show a supersized squircle for your wrist ----------------------------------------------------------------- 4. Google promised a better search experience -- now it's telling us to put glue on our pizza ----------------------------------------------------------------- 5. Activision and Meta sued by families of Uvalde school shooting victims ----------------------------------------------------------------- Verge Deals / Sign up for Verge Deals to get deals on products we've tested sent to your inbox weekly. Email (required)[ ]Sign up By submitting your email, you agree to our Terms and Privacy Notice. This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply. From our sponsor Advertiser Content FromSponsor logo Sponsor thumbnail More from Google * A screenshot showing Google's AI OverviewA screenshot showing Google's AI Overview You can get rid of AI Overviews in Google Search * Image of the Google "G" logo on a blue, black, and purple background.Image of the Google "G" logo on a blue, black, and purple background. Some people with legacy Google Workspace accounts are getting extra storage for free * Photo illustration of a gavel casting a shadow over the Google logoPhoto illustration of a gavel casting a shadow over the Google logo Judge doesn't buy Google's 'terrifying world of chaos' argument in Epic case * An illustration of Google's multicolor "G" logoAn illustration of Google's multicolor "G" logo Google waves around a cashier's check in an attempt to avoid a jury trial * Advertiser Content FromSponsor logo The Verge logo. * Terms of Use * Privacy Notice * Cookie Policy * Consent Management * Licensing FAQ * Accessibility * Platform Status * How We Rate and Review Products * Contact * Tip Us * Community Guidelines * About * Ethics Statement The Verge is a vox media network * Advertise with us * Jobs @ Vox Media (c) 2024 Vox Media, LLC. All Rights Reserved