https://spectrum.ieee.org/digital-archive [ ] IEEE.orgIEEE Xplore Digital LibraryIEEE StandardsMore Sites Sign InJoin IEEE The April issue of IEEE Spectrum is here! Download PDF | Close bar How Digital Archivists Are Saving Public Information from the Memory Hole Share FOR THE TECHNOLOGY INSIDER Search: [ ] Explore by topic AerospaceAIBiomedicalClimate TechComputingConsumer ElectronicsEnergy History of TechnologyRoboticsSemiconductorsTelecommunications Transportation IEEE Spectrum FOR THE TECHNOLOGY INSIDER Topics AerospaceAIBiomedicalClimate TechComputingConsumer ElectronicsEnergy History of TechnologyRoboticsSemiconductorsTelecommunications Transportation Sections FeaturesNewsOpinionCareersDIYEngineering Resources More NewslettersSpecial ReportsCollectionsExplainersTop Programming LanguagesRobots Guide /IEEE Job Site / For IEEE Members Current IssueMagazine ArchiveThe InstituteThe Institute Archive For IEEE Members Current IssueMagazine ArchiveThe InstituteThe Institute Archive IEEE Spectrum About UsContact UsReprints & Permissions /Advertising / Follow IEEE Spectrum Support IEEE Spectrum IEEE Spectrum is the flagship publication of the IEEE -- the world's largest professional organization devoted to engineering and applied sciences. Our articles, podcasts, and infographics inform our readers about developments in technology, engineering, and science. Join IEEE Subscribe About IEEEContact & SupportAccessibilityNondiscrimination PolicyTerms IEEE Privacy PolicyCookie PreferencesAd Privacy Options (c) Copyright 2025 IEEE -- All rights reserved. A public charity, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. Enjoy more free content and benefits by creating an account Saving articles to read later requires an IEEE Spectrum account The Institute content is only available for members Downloading full PDF issues is exclusive for IEEE Members Downloading this e-book is exclusive for IEEE Members Access to Spectrum 's Digital Edition is exclusive for IEEE Members Following topics is a feature exclusive for IEEE Members Adding your response to an article requires an IEEE Spectrum account Create an account to access more content and features on IEEE Spectrum , including the ability to save articles to read later, download Spectrum Collections, and participate in conversations with readers and editors. For more exclusive content and features, consider Joining IEEE . Join the world's largest professional organization devoted to engineering and applied sciences and get access to all of Spectrum's articles, archives, PDF downloads, and other benefits. Learn more about IEEE - Join the world's largest professional organization devoted to engineering and applied sciences and get access to this e-book plus all of IEEE Spectrum's articles, archives, PDF downloads, and other benefits. Learn more about IEEE - CREATE AN ACCOUNTSIGN IN JOIN IEEESIGN IN Close Access Thousands of Articles -- Completely Free Create an account and get exclusive content and features: Save articles, download collections, and talk to tech insiders -- all free! For full access and benefits, join IEEE as a paying member. CREATE AN ACCOUNTSIGN IN ComputingMagazineOpinionApril 2025 How Digital Archivists Are Saving Public Information from the Memory Hole Through clever usage of APIs, the Library Innovation Lab at Harvard Law School has created an archive of Data.gov, home to 311,000 public datasets Harry Goldstein 01 Apr 2025 3 min read Harry Goldstein is Editor in Chief of IEEE Spectrum. An illustration of a filing cabinet on a laptop screen. James Steinberg In the three decades since Brewster Kahle spun up the nonprofit Internet Archive's Wayback Machine, it has scaled up to include government websites and datasets--many of which are essential to the engineering and scientific communities. U.S. government agencies like the National Science Foundation, Department of Energy, and NASA are critical sources of research data, technical specifications, and standards documentation in pretty much every area where IEEE Spectrum 's audience works--AI & computer science, biomedical devices, power and energy, semiconductors, telecommunications...the list goes on. Access to that governmental data directly affects the reproducibility of experiments, the validation of models, and the integrity of the scholarly record. So what happens if an entire dataset vanishes? Among other things, it can invalidate years of research built upon that foundation. Until recently, wholesale deletion of data has been rare. In the United States, presidential transitions typically involve some changes to government websites to reflect new policy priorities. And after 9/11, the George W. Bush administration removed "millions of bytes" of information from government sites for security reasons as well as hundreds of Department of Defense documents and "tens of thousands" of Federal Energy Regulation Commission files. The Obama and Biden administrations likewise made changes to government websites but didn't engage in large-scale removal of Web pages or datasets. Obama, in fact, expanded public access to government data in 2009 by launching Data.gov, whose stated mission is in part "to unleash the power of government open data to inform decisions by the public and policymakers." During President Donald J. Trump's first term, researchers at the Environmental Data & Governance Initiative found that some government sites became inaccessible, and the phrase "climate change" was purged from several government Web pages. Access to governmental data directly affects the reproducibility of experiments, the validation of models, and the integrity of the scholarly record. The second term has been different. In February, a few weeks after Trump was sworn in for his second term, The New York Times reported that his administration took down more than 8,000 Web pages and databases. Many of those pages have since reappeared, but some of the restored pages and files have had changes, including the erasure of terms like "climate change" (again) and "clean energy,"Grist reports. These moves have faced multiple court challenges; on 11 February, for instance, a federal judge ordered that public access to Web pages and datasets belonging to the Centers for Disease Control and Prevention and the Food and Drug Administration be restored. In our April issue, Spectrum Assistant Editor Gwendolyn Rak reports on efforts to preserve public access to information. In addition to the ongoing work at the Internet Archive, she describes how archivists at the Library Innovation Lab at Harvard Law School amassed a copy of the 16-terabyte archive of Data.gov, which includes more than 311,000 public datasets. That copied archive is being updated daily with new data hoovered up via automated queries to application programming interfaces (APIs). Archivists are the guardians of memory. We depend on them to help us stay in touch with our history, maintain our knowledge base, and provide context, allowing us to understand how we came to be where we are and to light the way forward. In the fields of science, engineering, and medicine, where today's innovations stand on the shoulders of yesterday's discoveries, these digital preservationists ensure that the circuit of human knowledge remains unbroken. This article appears in the April 2025 print issue as "Lots of Copies Keep Stuff Safe." Editor's note: This post was revised to match the print version. From Your Site Articles * Will Today's Digital Movies Exist in 100 Years? > * Saving Public Data Takes More Than Simple Snapshots > * Holy Grail: The Infinite Archive > Related Articles Around the Web * The Library Innovation Lab at Harvard Law School > * Internet Archive: Digital Library of Free & Borrowable Texts, Movies ... > digital archivesinternet archivegovernment datapublic datawebsites data preservation Harry Goldstein Harry Goldstein is Editor in Chief of IEEE Spectrum. The Conversation (0) A young woman writing notes in her home office during a video meeting. The InstituteCareersNews A Guide to IEEE Education Week's Events 4h 3 min read A 3D printed hexagon-shaped structure partially submerged in a tank of water. Wave patterns within the walls of the structure have successfully drawn in and trapped a floating foam ball at its center. Climate TechNewsClimate Change Scientists Use Sound to Generate and Shape Water Waves 11h 3 min read A new miniature pacemaker sits next to a grain of rice for scale. BiomedicalNews Tiny Pacemaker Dissolves After Use 02 Apr 2025 3 min read Related Stories ComputingMagazineHistory of TechnologyNewsApril 2025 Saving Public Data Takes More Than Simple Snapshots AIInterviewConsumer Electronics AI Has Created a Battle Over Web Crawling ComputingNewsClimate TechClimate Change COP28 Takeaway: Are Low-Carbon Websites Possible?