https://breakingdefense.com/2024/08/ai-gold-mine-nga-aims-to-exploit-archive-of-satellite-images-expert-analysis/ [p] * * * * * * Newsletter Signup * About Us * Webinars * Resource Library More breaking defense logo * Air Warfare * Land Warfare * Naval Warfare * Space * Networks / Cyber * Congress * Multi-Domain * Global * Special Features >> + Indo-Pacific + All Domain: Connecting the Joint Force + Defense Budget Coverage + Advanced Weapons Technology + Air Dominance * Newsletters * About Us * Air * Land * Naval * Space * Networks * Multi-Domain * Congress * Pentagon * Global * Newsletter Signup * About Us * Webinars * Resource Library Search for: [ ] [Search] * * * * * PTDO USecAF Jones leads panel discussion "Driving Change with Speed" Air Force greenlights baseline for new NRO-Space Force satellites to track ground targets Keyboard with China flag key NSA's China specialist: US at a loss to deter Chinese hackers Neurons connect at US Army's CyberCenter of Excellence A year into its cyber workforce initiative, DoD faces personnel shortages, bureaucratic hurdles CP inside Army's upcoming Project Convergence billed as early test for 'C2 Next' plans 220420_pexels_chip_processor Pentagon will award $280 million in CHIPS Act grants for microelectronics prototypes 240828_GNA_tearline_northkorea_HANDOUT 'AI gold mine': NGA aims to exploit archive of satellite images, expert analysis Army photo (82nd Airborne Division) 'So far, so good' on Army's radio frequency pilot, with industry outreach coming soon CP1 Army using 'transformation in contact' to make case for new weapons, formation decisions Allied Spirit 24 Army attempts to reassure industry on software acquisition Breaking Defense SATCOM webinar 2024 main-well image How SATCOM and resilient space networks are driving the future of command and control 7719557 Army progressing toward Theater Information Advantage Detachments deployments DSD Delivers Remarks at Marine Corps Audit Awards Ceremony Navy Comptroller: ERP software will finally enable a clean audit, big data analytics 240822_technet_ballroom_WELCH 'Criminal investigation' underway after foul smell stinks up TechNet Augusta 220526_pentagon_AI_brain Break and counter: Army's 500-day artificial intelligence plan to include new testing, defense Soldier is Using Laptop Computer for Tracking the Target and Radio for Communication During Military Operation in the Desert Army feeling 'lukewarm' about radio as-a-service pilot, PEO C3T says Defense industry news, analysis and commentary * Special Features x Close Signup Modal Breaking Defense In your inbox Want the latest defense industry news? Sign up for the Breaking Defense newsletter. We will never sell or share your information without your consent. See our privacy policy. [logo] * Air * Land * Naval * Space * Networks * Multi-Domain * Congress * Pentagon * Global Search for: [ ] [Search] Featured: TechNet Augusta 2024 >> 2025 Budget >> Indo-Pacific >> * Networks & Digital Warfare, Pentagon, Space 'AI gold mine': NGA aims to exploit archive of satellite images, expert analysis "We're sitting on two big sets of data," said NGA's Mark Munsell, referring to an unequalled archive of satellite imagery and all the intelligence analysts' reports on that imagery - and they're cross-referenced so an AI can correlate them easily. By Sydney J. Freedberg Jr. on August 28, 2024 at 11:08 AM 240828_GNA_tearline_northkorea_HANDOUT Overview of Kwan-li-so No. 18, September 9, 2023 (Copyright (c) 2024 by Airbus, via Google Earth, via NGA's Tearline) WASHINGTON -- The director of data and digital innovation at the National Geospatial Intelligence Agency said the NGA has started training artificial intelligence algorithms on its unique trove of visual and textual data. This data is "an AI gold mine," said Mark Munsell. That's not just because it consists of large amounts of well-labeled, well-organized, and carefully vetted data, accumulated over decades by the intelligence agency tasked with compiling and analyzing geospatial data for policymakers from the president on down. It's also because this data is what experts call multi-modal, combining images with text descriptions. Contrast that to how GenAI companies are feverishly scraping everything from Reddit posts to YouTube captions in their desperate quest for training data -- and that's all pure text, without any ability to cross-reference other kinds of sources. "We're in the early days of some really cool experiments," Munsell told the annual INSA Intelligence & National Security Summit on Tuesday. "Those experiments involve taking the visual record of the Earth that we have from space ... and merging it with millions and millions of finely curated humans' reports about what they see on those images." "We're sitting on two big sets of data, a gold mine of data, where we have images that nobody else in the world has, and ... experts that have described what's on those images in expert language and text," Munsell continued. "We're really looking forward to this multi-modal experiment, where we bring those two things together." RELATED: GIDE goes wide: Defense AI chief seeks host of industry players for global battle network Large Language Models like ChatGPT erupted into public view last year and have fired fierce debate over AI ever since. Skeptics point to their tendency to "hallucinate" convincing falsehoods and misinformation. Enthusiasts argue that -- properly safeguarded -- they can revolutionize knowledge-based tasks that once required tedious clerical work. Some well-credentialed commentators even claim that LLMs are on the verge of superhuman "artificial general inteligence." Unlike humans, however, LLMs operate purely on text: They train on text, take input in text, and output answers as text. Other forms of generative artifcial intelligence can correlate text and imagery well enough to turn users' written prompts into pictures or even video. But many in industry have already been working on the next frontier: multi-modal AI. The crucial capability is to cross-reference different types of information on the same thing, like an image or video with the associated caption describing it in words, much the way a human brain can associate an idea or memory with information from all the senses. Multi-modal AI can even work with senses that human beings don't have, like infra-red imagery, radio and radar signals, or sonar. "That enables a lot of avenues that would have been closed to us," said DARPA program manager William Corvey, speaking at the same INSA panel as NGA's Munsell. "[Imagine] cross-modal systems that can reconcile visual and linguistic information and other kinds of modalities of sensors that might be available to a robot but aren't to a human being." Modern AI algorithms have proven perfectly capable of working with images, video, and all sorts of sensor data, not just text, because they can abstract any and all of them into the same mathematical representations. "You can start to knit together reality in these new ways and induce these alignments across what were previously completely different systems," Corvell continued, "and that's all because these models for all of their expensive training turn out to be really parsimonious representations of reality. They just take sort of everything and squish it into a panini press, and then you can insert that sandwich that you have, basically, into any number of different meals." The hard part, it turns out, is getting the data cleaned, curated, and correlated enough for the AI to ingest it in the first place. Many popular "AI" systems actually rely on large numbers of of humans working long hours for low wages to click checkboxes on images and videos. Sometimes giving the humans involved even develop PTSD as they try to moderate hateful and violent content. "We use hundreds, maybe even thousands, of humans to train these models... and then we have hundreds or thousands of humans that are giving feedback to the models," Munsell told the INSA audience. "You gotta ask yourself at some point, what are we doing here?" So it's a tremendous advantage when an organization has access to a large amount of data that highly trained humans have already spent decades analyzing, verifying, cataloging, and commenting on. But archives like NGA's are far too huge for any one human mind to remember everything. AI opens up the possibility of training algorithms on the data and then being able to ask them to spot patterns, resemblances, and anomalies. "We'll be able to ask questions, historic questions," Munsell said. "'Hey, AI? Have you ever seen this particular activity, this kind of object, in this part of the world?'" "What a cool thing that will be for for our country," he enthused. Munsell's ultimate boss, NGA chief Vice Adm. Frank Whitworth, said at another panel today that the agency is already using AI to "triage" some of the workload of imagery analysis, but will continually need an AI "edge" to keep up as more and more data comes in from space-based sensors. The stakes are high to get it right, Munsell emphasized, saying an expert human should always be doublechecking the AI, especially if a report might be used for targeting a military strike. "The visual is the ultimate positive identification for our customers," he said. "In many cases they're making, they're acting upon that positive identification, they're acting upon the visual identity and the geolocation of what we're providing. And when artificial intelligence provides that, you have to take those extra steps to make...that thing is 100% correct." At NGA, he said, "literally for us, seeing is believing." Lee Ferran contributed to this story. Multifunction Infographic_22-071[1] Networks & Digital Warfare, Sponsored Multifunction solutions provide competitive advantage in ever-changing battlespaces Multifunction Infographic_22-071[1] Networks & Digital Warfare, Sponsored Multifunction solutions provide competitive advantage in ever-changing battlespaces Networks & Digital Warfare, Sponsored Multifunction solutions provide competitive advantage in ever-changing battlespaces Northrop Grumman has taken a page from commercial industry playbooks, producing sensor software, firmware and hardware in parallel, essentially folding the development timeline and accelerating sensor deliveries. From Breaking Defense Northrop Grumman has taken a page from commercial industry playbooks, producing sensor software, firmware and hardware in parallel, essentially folding the development timeline and accelerating sensor deliveries. From Breaking Defense PTDO USecAF Jones leads panel discussion "Driving Change with Speed" Recommended Air Force greenlights baseline for new NRO-Space Force satellites to track ground targets Calvelli's decision comes after a five-month delay necessary to hash out a reliable cost estimate for the NRO-Space Force development program. By Theresa Hitchens Recommended * PTDO USecAF Jones leads panel discussion "Driving Change with Speed" Air Force greenlights baseline for new NRO-Space Force satellites to track ground targets * Keyboard with China flag key NSA's China specialist: US at a loss to deter Chinese hackers * Topics: big data, cyber security, darpa, generative artificial intelligence, INSA Intelligence & National Security Summit 2024, large language models LLMs, Mark Munsell, multi-modal AI, National Geospatial Intelligence Agency, networks, Pentagon, Space Force, technology Latest from Breaking Defense Paris air show raytheon RTX State Department, RTX reach $200M settlement for export violations Ukrainian Offensive In Kursk Region Kursk incursion a 'clever' operation that makes Putin look 'sort of weak:' Polish Air Force chief LEBANON-UN-ISRAEL-PALESTINIAN-CONFLICT The UN's peacekeeping mission in Lebanon has been renewed, but amid constant clashes, will it help? Lawmakers Trying To Avert Fiscal Cliff To Prevent Short-Term Shock To The Economy Lockheed Martin COO Frank St. John on the defense budget, potential acquisitions and supply chain 2211_YPG-NATO-POD_DSC01463_screen Air Warfare, Sponsored Uncrewed aircraft will ensure NATO's readiness now and for the next 75 years 2211_YPG-NATO-POD_DSC01463_screen Air Warfare, Sponsored Uncrewed aircraft will ensure NATO's readiness now and for the next 75 years Air Warfare, Sponsored Uncrewed aircraft will ensure NATO's readiness now and for the next 75 years As the nations of the Alliance mark NATO's anniversary, they must do all they can to keep themselves and NATO ready. From GENERAL ATOMICS AERONAUTICAL SYSTEMS, INC. As the nations of the Alliance mark NATO's anniversary, they must do all they can to keep themselves and NATO ready. From GENERAL ATOMICS AERONAUTICAL SYSTEMS, INC. Recommended Army photo (82nd Airborne Division) 'So far, so good' on Army's radio frequency pilot, with industry outreach coming soon CP1 Army using 'transformation in contact' to make case for new weapons, formation decisions eSR-73_Motor_Test_Drone_Approved_076-21OpEdMain All Domain, army, Sponsored The L3Harris difference: Delivering on Aerojet Rocketdyne eSR-73_Motor_Test_Drone_Approved_076-21OpEdMain All Domain, army, Sponsored The L3Harris difference: Delivering on Aerojet Rocketdyne All Domain, army, Sponsored The L3Harris difference: Delivering on Aerojet Rocketdyne L3Harris is answering the Department of Defense's call for strengthened competition, safeguarding a future for the nation and democracy worldwide. From Ross Niebergall, President, Aerojet Rocketdyne, L3Harris Technologies L3Harris is answering the Department of Defense's call for strengthened competition, safeguarding a future for the nation and democracy worldwide. From Ross Niebergall, President, Aerojet Rocketdyne, L3Harris Technologies * * Sign up and get Breaking Defense news in your inbox. We will never sell or share your information without your consent. See our privacy policy. [logo] T2BETA_PROGRAM_REVIEWED1[1] Space, Sponsored Space Development Agency's global mesh network in space is moving forward, with speed T2BETA_PROGRAM_REVIEWED1[1] Space, Sponsored Space Development Agency's global mesh network in space is moving forward, with speed Space, Sponsored Space Development Agency's global mesh network in space is moving forward, with speed By focusing on delivering minimum viable products, the Space Development Agency is enabling a larger set of suppliers to rapidly field data transport and missile tracking systems. From Breaking Defense By focusing on delivering minimum viable products, the Space Development Agency is enabling a larger set of suppliers to rapidly field data transport and missile tracking systems. From Breaking Defense Breaking Defense In your inbox Want the latest defense industry news? Sign up for the Breaking Defense newsletter. We will never sell or share your information without your consent. See our privacy policy. [logo] x [logo] No thanks We will never sell or share your information without your consent. See our privacy policy. * Advertising & Marketing Solutions Our Sites * Breaking Defense * Breaking Energy * Breaking Gov * Above the Law * Dealbreaker * MedCity News Copyright (c) 2024 Breaking Media, Inc. All rights reserved. Registration or use of this site constitutes acceptance of our Terms of Service and Privacy Policy. Privacy Center | Do not sell my information DMCA compliant image Share this Article Friend's Email Address [ ] Your Name [ ] Your Email Address [ ] Comments [ ] Send Email Email sent! x