https://arstechnica.com/ai/2024/11/niantic-uses-pokemon-go-player-data-to-build-ai-navigation-system/ Skip to content Ars Technica home Sections Forum Subscribe * AI * Biz & IT * Cars * Culture * Gaming * Health * Policy * Science * Security * Space * Tech * Feature * Reviews * Store * AI * Biz & IT * Cars * Culture * Gaming * Health * Policy * Science * Security * Space * Tech Forum Subscribe Story text Size [Standard] Width * [Standard] Links [Standard] * Subscribers only Learn more Pin to story Theme * HyperLight * Day & Night * Dark * System Search dialog... Sign In Sign in dialog... Sign in gotta catch 'em all Niantic uses Pokemon Go player data to build AI navigation system Visual scans of the world have helped Niantic build what it calls a "Large Geospatial Model." Benj Edwards - Nov 19, 2024 3:34 pm | 72 A man plays Pokemon Go game on a smartphone on July 22, 2016 in Tokyo, Japan. A man plays Pokemon Go game on a smartphone on July 22, 2016 in Tokyo, Japan. A Pokemon Go game. Credit: https://www.gettyimages.com/detail/ news-photo/ man-plays-pokemon-go-game-on-a-smartphone-on-july-22-2016-news-photo/ 578680184 A Pokemon Go game. Credit: https://www.gettyimages.com/detail/ news-photo/ man-plays-pokemon-go-game-on-a-smartphone-on-july-22-2016-news-photo/ 578680184 Text settings Story text Size [Standard] Width * [Standard] Links [Standard] * Subscribers only Learn more Minimize to nav Last week, Niantic announced plans to create an AI model for navigating the physical world using scans collected from players of its mobile games, such as Pokemon Go, and from users of its Scaniverse app, reports 404 Media. All AI models require training data. So far, companies have collected data from websites, YouTube videos, books, audio sources, and more, but this is perhaps the first we've heard of AI training data collected through a mobile gaming app. "Over the past five years, Niantic has focused on building our Visual Positioning System (VPS), which uses a single image from a phone to determine its position and orientation using a 3D map built from people scanning interesting locations in our games and Scaniverse," Niantic wrote in a company blog post. The company calls its creation a "large geospatial model" (LGM), drawing parallels to large language models (LLMs) like the kind that power ChatGPT. Whereas language models process text, Niantic's model will process physical spaces using geolocated images collected through its apps. The scale of Niantic's data collection reveals the company's sizable presence in the AR space. The model draws from over 10 million scanned locations worldwide, with users capturing roughly 1 million new scans weekly through Pokemon Go and Scaniverse. These scans come from a pedestrian perspective, capturing areas inaccessible to cars and street-view cameras. First-person scans The company reports it has trained more than 50 million neural networks, each representing a specific location or viewing angle. These networks compress thousands of mapping images into digital representations of physical spaces. Together, they contain over 150 trillion parameters--adjustable values that help the networks recognize and understand locations. Multiple networks can contribute to mapping a single location, and Niantic plans to combine its knowledge into one comprehensive model that can understand any location, even from unfamiliar angles. "Imagine yourself standing behind a church," Niantic wrote in its blog post. "The closest local model has seen only the front entrance of that church, and thus, it will not be able to tell you where you are. But on a global scale, we have seen thousands of churches captured by local models worldwide. No church is the same, but many share common characteristics. An LGM accesses that distributed knowledge." The technology builds on Niantic's existing Lightship Visual Positioning System, which lets players place virtual items in real-world locations with centimeter-level precision. A recent Pokemon Go feature called Pokemon Playgrounds demonstrates this capability, allowing users to leave Pokemon at specific spots for others to find. Niantic suggests the technology could support augmented reality products, robotics, and autonomous systems, with additional applications in spatial planning, logistics, and remote collaboration. Did Niantic's millions of players have any idea their scans would be fed into an AI system? Judging from this Reddit thread reacting to the 404 Media article, it seems that many are not surprised. "Definitely wasn't unwittingly," wrote one Redditor. "Most of us knew their business model didn't revolve around supporting the actual players." No doubt the process was covered by Pokemon Go's data collection terms of service, but the larger reaction to this news will likely be a developing story. Photo of Benj Edwards Benj Edwards Senior AI Reporter Benj Edwards Senior AI Reporter Benj Edwards is Ars Technica's Senior AI Reporter and founder of the site's dedicated AI beat in 2022. He's also a tech historian with almost two decades of experience. In his free time, he writes and records music, collects vintage computers, and enjoys nature. He lives in Raleigh, NC. 72 Comments Comments Forum view Loading Loading comments... Prev story Next story Most Read 1. Listing image for first story in Most Read: Russia takes unusual route to hack Starlink-connected devices in Ukraine 1. Russia takes unusual route to hack Starlink-connected devices in Ukraine 2. 2. NASA believes it understands why Ingenuity crashed on Mars 3. 3. Back where it started: "Do Not Track" removed from Firefox after 13 years 4. 4. Photobucket opted inactive users into privacy nightmare, lawsuit says 5. 5. Startup will brick $800 emotional support robot for kids without refunds Customize Ars Technica has been separating the signal from the noise for over 25 years. With our unique combination of technical savvy and wide-ranging interest in the technological arts and sciences, Ars is the trusted source in a sea of information. After all, you don't need to know everything, only what's important. More from Ars * About Us * Staff Directory * Newsletters * Ars Videos * General FAQ * RSS Feeds Contact * Contact us * Advertise with us * Reprints Do Not Sell My Personal Information (c) 2024 Conde Nast. All rights reserved. Use of and/or registration on any portion of this site constitutes acceptance of our User Agreement and Privacy Policy and Cookie Statement and Ars Technica Addendum and Your California Privacy Rights. Ars Technica may earn compensation on sales from links on this site. Read our affiliate link policy. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of Conde Nast. Ad Choices