https://shkspr.mobi/blog/2022/06/googles-ai-doesnt-understand-restaurant-menus/ Terence Eden's Blog Google's AI Doesn't Understand Restaurant Menus * By @edent on 2022-06-12 * AI google * 8 comments * 450 words * Read ~4,800 times. --------------------------------------------------------------------- In the glorious future, every website will be chock-full of semantic metadata. Restaurants won't have a 50MB PDF explaining the chef's vision for organic cuisine - instead, they'll have little scraps of data on the HTML page like: "hasMenuItem":{ "@type":"MenuItem", "name":"Dodo In A Bun", "description":"The legendary extinct bird cooked in tomato sauce, served in a gluten-free bun.", "offers":{ "@type":"Offer", "price":"7.99", "priceCurrency":"GBP" }, But, for now, they don't. So Google uses MACHINE LEARNING and DEEP AI to scrape the menus out of PDFs and photos submitted by patrons. It works about as well as you'd expect. Examples Here's a bunch of screenshots from Google Maps. Would a human have made these mistakes? (No they'd make much more interesting mistakes!) Chicken PS0.86. Gourmet Burger PS810.76. Veggie US$10.76. Are those realistic prices for burgers? Would a place that sells a gold-covered burger also sell second-hand chicken? Is it usual that UK menus offer items in different currencies? What about this: A side dish called "plain paper" for PS45 Is that a likely name for a side dish? You wouldn't find that even in trendy Shoreditch. And, again with the weird pricing. Side dishes rarely cost that much. Still, it could be worse... Chicken Tika Massala listed for PS1,990. I guarantee you the little curry shop I was looking at didn't have anything on the menu that pricey! Other times, it seems to just pick random words in a vague attempt to be "useful". List of salads including one called "the". And another called "middle". Perhaps my favourite is this British restaurant which offers [DEL: spam, spam, and more spam:DEL]: A menu with the word "egg" written three times. There were dozens (dozens!) of examples I found within a few minutes of looking for somewhere nearby to grab a cheap lunch. To be fair, when the website has supplied data in an appropriate format, Google is good at displaying it. But when Google tries to be clever... ah. There is, of course, no way for a user to contact Google and say "I dunno, man. This looks kinda off." Whose Fault Is It Anyway? Obviously, restaurateurs should provide machine-readable descriptions of their menus. That way search engines, smart speakers, and all sorts of funky computers will be able to parse the food available. But they don't. Because they're busy cooking. Google has discovered that it takes 90% of the effort to get 90% of the way there - but the last 10% takes the next 90% of the effort. As ever, a feature has launched and it is of dubious value to business owners and customers - but I'm sure a product manager at Google got their wings. --------------------------------------------------------------------- Share the love: * Twitter * Facebook * LinkedIn * Reddit * HackerNews * Lobsters * Email * Pocket * Mastodon * WhatsApp * Telegram * Like this: Like Loading... More posts from around the site: 8 thoughts on "Google's AI Doesn't Understand Restaurant Menus" 1. 2022-06-12 12:37 [TDTgB12d] Chaz6 says: Google really should not be allowed to misrepresent businesses like this. It could be perceived that they are giving other businesses an advantage by putting potential customers off. Reply 2. 2022-06-12 12:58 [Gp0O6aBK] Ben Hardill says: Given this week's suggestions that Google is sentient I have to assume they just don't like curry... Reply 3. 2022-06-12 13:12 [go7-T3xm] Rayan says: I have mixed feelings about this, I'd be inclined to think that it's still a net positive to highlight business like this. I really doubt a potential customer will actually think that the curry costs 2 grand. Reply 1. 2022-06-12 21:57 [099e446e] Alastair says: But Google thinks it costs two grand. So when someone searches for 'cheap lunch' or 'good value curry' - there's not much hope of this curry house showing up, or it'll be shown on the map as 'expensive' for no good reason. Reply 4. 2022-06-12 15:02 [E7SiQCu-] Daniel Knell says: That had better be a darn good curry... and come with a bottle of dom. Reply 5. 2022-06-12 16:08 [G3sBtHlb] [twitter] HackerNewsTop10 says: Google's AI Doesn't Understand Restaurant Menus Link: shkspr.mobi/blog/2022/06/g... Comments: news.ycombinator.com/item?id=317138... Reply 6. 2022-06-12 19:09 [Z05OGYRL] [mastodon] mikechislett says: @Edent Google news doesn't understand DD/MM/YYYY and MM/DD/YYYY context either.You can trick it into thinking news is published in the future. Reply 7. 2022-06-12 20:13 [d8fda575] DinoNerd says: I wonder how many people will continue to use the feature after its initial, relatively useless release, and notice if and when Google gets to the point where it's functional enough to be usable - let's say it's only wrong 1% of the time, so it gets some menus 100% correct. In my experience, vendors who release new features at this quality level essentially never announce "Heh folks, we've fixed it; you should come back and try it again". There are Google features that were at least as useless as this one at first release, which I never use, because I "know" they don't work. Every once in a while some youngster tells me that they use the feature, and find it usable and convenient, and I look back and realize it's been years since I tried it. One example is Google Translate. When I last used it, its many flaws included the practice of omitting words it didn't understand, without any ellipsis. It only took one example where the word omitted basically meant "not", reversing the meaning, to cause me to file Google Translate as "useful ONLY if you basically already understand the text". I relatively recently discovered it's now good enough that people with no language in common routinely use it to communicate on MMORPGs; another player wondered why I wasn't interacting with an in-game neighbour whose chats always used the Cyrillic alphabet, and didn't think "because none of the languages I know use that alphabet" was a reasonable response. Reply Leave a Reply Cancel reply Your email address will not be published. Required fields are marked * [ ] [ ] [ ] [ ] [ ] [ ] [ ] Comment *[ ] Name * [ ] Email * [ ] Website [ ] [ ] Notify me of follow-up comments by email. [ ] Notify me of new posts by email. [Post Comment] [ ] [ ] [ ] [ ] [ ] [ ] [ ] D[ ] To respond on your own website, enter the URL of your response which should contain a link to this post's permalink URL. Your response will then appear (possibly after moderation) on this page. Want to update or remove your response? Update or delete your post and re-enter your post's URL again. (Learn More) [ ] [Ping me!] Found this post useful? Click the icons to support this blog More ways to support my blog Get new posts by email Enter your email address to subscribe to this blog and receive brand new posts by email. (Or subscribe to this RSSAtom Feed.) Join 13,384 other subscribers. Email Address [ ] Free Sign Up Search Blog Posts Search for: [ ] [Search] Explore The Archives 2022 January 30 posts February 23 posts March 15 posts April 19 posts May 19 posts June 9 posts July August September October November December 2021 January 31 posts February 28 posts March 31 posts April 30 posts May 31 posts June 30 posts July 31 posts August 31 posts September 30 posts October 31 posts November 30 posts December 31 posts 2020 January 31 posts February 29 posts March 31 posts April 30 posts May 31 posts June 30 posts July 31 posts August 31 posts September 30 posts October 31 posts November 30 posts December 31 posts 2019 January 31 posts February 12 posts March 17 posts April 12 posts May 12 posts June 10 posts July 7 posts August 5 posts September 6 posts October 14 posts November 30 posts December 17 posts 2018 January 8 posts February 4 posts March 6 posts April 14 posts May 5 posts June 6 posts July 6 posts August 13 posts September 14 posts October 8 posts November 30 posts December 4 posts 2017 January 12 posts February 9 posts March 8 posts April 4 posts May 10 posts June 5 posts July 5 posts August 6 posts September 3 posts October 4 posts November 30 posts December 2016 January 10 posts February 10 posts March 11 posts April 9 posts May 8 posts June 9 posts July 6 posts August 9 posts September 4 posts October 2 posts November 30 posts December 14 posts 2015 January 8 posts February 11 posts March 10 posts April 4 posts May 9 posts June 3 posts July 7 posts August 9 posts September 10 posts October 2 posts November 30 posts December 4 posts 2014 January 13 posts February 13 posts March 14 posts April 14 posts May 8 posts June 7 posts July 9 posts August 5 posts September 5 posts October 1 post November 30 posts December 20 posts 2013 January 25 posts February 17 posts March 15 posts April 18 posts May 11 posts June 14 posts July 6 posts August 14 posts September 6 posts October 4 posts November 30 posts December 14 posts 2012 January 14 posts February 8 posts March 13 posts April 15 posts May 10 posts June 16 posts July 8 posts August 8 posts September 6 posts October 6 posts November 30 posts December 31 posts 2011 January 13 posts February 11 posts March 11 posts April 12 posts May 8 posts June 8 posts July 6 posts August 5 posts September 11 posts October 7 posts November 30 posts December 17 posts 2010 January 6 posts February 15 posts March 12 posts April 13 posts May 4 posts June 3 posts July 15 posts August 8 posts September 11 posts October 9 posts November 30 posts December 9 posts 2009 January 1 post February 5 posts March 3 posts April 7 posts May 12 posts June 8 posts July 10 posts August 10 posts September 12 posts October 22 posts November 31 posts December 15 posts 2008 January 2 posts February March 2 posts April 3 posts May 2 posts June July 1 post August 3 posts September 1 post October 3 posts November 2 posts December 1 post 2007 January February March April May June July August September October November 4 posts December 5 posts 2006 January February March April 1 post May June July August September October November 1 post December 2005 January February March 1 post April May June July August September 1 post October November December 2004 January February March April May 5 posts June 3 posts July 1 post August September October November December 2003 January February March 2 posts April May June July August September October November December 2002 January February 1 post March April 3 posts May June July August September October November December 2001 January February March April May June July 1 post August September October 1 post November December 2000 January February March 1 post April May June July August September October November 1 post December 1999 January February March April May June July August September 1 post October November December 1 post 1997 January 1 post February March April May June July August September October November December 1995 January February March 1 post April May June July August September October November December 1987 January February March April May June July August September October November December 1 post * (c) Terence Eden * Contact Me * Subscribe * Citations * Support My Blog * About Me ISSN 2753-1570 %d bloggers like this: