https://www.nature.com/articles/d41586-024-00616-5 Skip to main content Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript. Advertisement Advertisement Nature * View all journals * Search * Log in * Explore content * About the journal * Publish with us * Subscribe * Sign up for alerts * RSS feed 1. nature 2. news 3. article * NEWS * 04 March 2024 More than 2 million research papers have disappeared from the Internet An analysis of DOIs suggests that digital preservation is not keeping up with burgeoning scholarly knowledge. By * Sarah Wild 1. Sarah Wild View author publications You can also search for this author in PubMed Google Scholar * Twitter * Facebook * Email Old documents and books stored on shelves in a library's archive. A study identified more than two million articles that did not appear in a major digital archive, despite having an active DOI.Credit: Anna Berkut/Alamy More than one-quarter of scholarly articles are not being properly archived and preserved, a study of more than seven million digital publications suggests. The findings, published in the Journal of Librarianship and Scholarly Communication on 24 January^1, indicate that systems to preserve papers online have failed to keep pace with the growth of research output. "Our entire epistemology of science and research relies on the chain of footnotes," explains author Martin Eve, a researcher in literature, technology and publishing at Birkbeck, University of London. "If you can't verify what someone else has said at some other point, you're just trusting to blind faith for artefacts that you can no longer read yourself." Eve, who is also involved in research and development at digital-infrastructure organization Crossref, checked whether 7,438,037 works labelled with digital object identifiers (DOIs) are held in archives. DOIs -- which consist of a string of numbers, letters and symbols -- are unique fingerprints used to identify and link to specific publications, such as scholarly articles and official reports. Crossref is the largest DOI registration agency, allocating the identifiers to about 20,000 members, including publishers, museums and other institutions. The sample of DOIs included in the study was made up of a random selection of up to 1,000 registered to each member organization. Twenty-eight percent of these works -- more than two million articles -- did not appear in a major digital archive, despite having an active DOI. Only 58% of the DOIs referenced works that had been stored in at least one archive. The other 14% were excluded from the study because they were published too recently, were not journal articles or did not have an identifiable source. Preservation challenge Eve notes that the study has limitations: namely that it tracked only articles with DOIs, and that it did not search every digital repository for articles (he did not check whether items with a DOI were stored in institutional repositories, for example). Nevertheless, preservation specialists have welcomed the analysis. "It's been hard to know the real extent of the digital preservation challenge faced by e-journals," says William Kilbride, managing director of the Digital Preservation Coalition, headquartered in York, UK. The coalition publishes a handbook detailing good preservation practice. "Many people have the blind assumption that if you have a DOI, it's there forever," says Mikael Laakso, who studies scholarly publishing at the Hanken School of Economics in Helsinki. "But that doesn't mean that the link will always work." In 2021, Laakso and his colleagues reported^2 that more than 170 open-access journals had disappeared from the Internet between 2000 and 2019. Kate Wittenberg, managing director of the digital archiving service Portico in New York City, warns that small publishers are at higher risk of failing to preserve articles than are large ones. "It costs money to preserve content," she says, adding that archiving involves infrastructure, technology and expertise that many smaller organizations do not have access to. Eve's study suggests some measures that could improve digital preservation, including stronger requirements at DOI registration agencies and better education and awareness of the issue among publishers and researchers. "Everybody thinks of the immediate gains they might get from having a paper out somewhere, but we really should be thinking about the long-term sustainability of the research ecosystem," Eve says. "After you've been dead for 100 years, are people going to be able to get access to the things you've worked on?" doi: https://doi.org/10.1038/d41586-024-00616-5 References 1. Eve, M. P. J. Libr. Sch. Commun. 12, eP16288 (2024). Article Google Scholar 2. Laakso, M., Matthias, L. & Jahn, N. J. Assoc. Inf. Sci. Technol. 72, 1099-1112 (2021). Article Google Scholar Download references Reprints and permissions Subjects * Information technology * Scientific community * Publishing Latest on: Information technology Gender bias is more exaggerated in online images than in text Gender bias is more exaggerated in online images than in text News & Views 14 FEB 24 Computers make mistakes and AI will make things worse -- the law must recognize that Computers make mistakes and AI will make things worse -- the law must recognize that Editorial 23 JAN 24 How online misinformation exploits 'information voids' -- and what to do about it How online misinformation exploits 'information voids' -- and what to do about it Editorial 09 JAN 24 Scientific community My productivity waxes and wanes -- and I'm learning to account for it My productivity waxes and wanes -- and I'm learning to account for it Career Column 04 MAR 24 What science says about hybrid working -- and how to make it a success What science says about hybrid working -- and how to make it a success News Feature 04 MAR 24 Big science in Latin America: accelerate particles and progress Big science in Latin America: accelerate particles and progress Comment 04 MAR 24 Publishing Giant plume of plasma on the Sun's surface and more -- February's best science images Giant plume of plasma on the Sun's surface and more -- February's best science images News 01 MAR 24 Is ChatGPT making scientists hyper-productive? The highs and lows of using AI Is ChatGPT making scientists hyper-productive? The highs and lows of using AI News Explainer 28 FEB 24 Influential abortion-pill studies retracted: the science behind the decision Influential abortion-pill studies retracted: the science behind the decision News 27 FEB 24 Nature Careers Jobs * Associate or Senior Editor, Nature Machine Intelligence Position: Associate or Senior Editor, Nature Machine Intelligence Location: Shanghai, Beijing, or New York- Hybrid working model Deadline: 31, Marc... New York City, New York (US) Springer Nature Ltd [] * Associate or Senior Editor (Cancer epidemiology and imaging), Nature Communications About Springer Nature Group Springer Nature opens the doors to discovery for researchers, educators, clinicians and other professionals. Every day,... New York City, New York (US) Springer Nature Ltd [] * Postdoctoral Associate- Statistical Genetics Houston, Texas (US) Baylor College of Medicine (BCM) [] * Head of Biology, Bio-island Head of Biology to lead the discovery biology group. Guangzhou, Guangdong, China BeiGene Ltd. [] * Faculty Positions, Aging and Neurodegeneration, Westlake Laboratory of Life Sciences and Biomedicine Applicants with expertise in aging and neurodegeneration and related areas are particularly encouraged to apply. Hangzhou, Zhejiang, China Westlake Laboratory of Life Sciences and Biomedicine (WLLSB) [] You have full access to this article via your institution. Download PDF Subjects * Information technology * Scientific community * Publishing Advertisement Sign up to Nature Briefing An essential round-up of science news, opinion and analysis, delivered to your inbox every weekday. Email address [ ] [ ] Yes! Sign me up to receive the daily Nature Briefing email. I agree my information will be processed in accordance with the Nature and Springer Nature Limited Privacy Policy. Sign up * Close Nature Briefing Sign up for the Nature Briefing newsletter -- what matters in science, free to your inbox daily. Email address [ ] Sign up [ ] I agree my information will be processed in accordance with the Nature and Springer Nature Limited Privacy Policy. Close Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing Explore content * Research articles * News * Opinion * Research Analysis * Careers * Books & Culture * Podcasts * Videos * Current issue * Browse issues * Collections * Subjects * Follow us on Facebook * Follow us on Twitter * Subscribe * Sign up for alerts * RSS feed About the journal * Journal Staff * About the Editors * Journal Information * Our publishing models * Editorial Values Statement * Journal Metrics * Awards * Contact * Editorial policies * History of Nature * Send a news tip Publish with us * For Authors * For Referees * Language editing services * Submit manuscript Search Search articles by subject, keyword or author [ ] Show results from [All journals] Search Advanced search Quick links * Explore articles by subject * Find a job * Guide to authors * Editorial policies Nature (Nature) ISSN 1476-4687 (online) ISSN 0028-0836 (print) nature.com sitemap About Nature Portfolio * About us * Press releases * Press office * Contact us Discover content * Journals A-Z * Articles by subject * Protocol Exchange * Nature Index Publishing policies * Nature portfolio policies * Open access Author & Researcher services * Reprints & permissions * Research data * Language editing * Scientific editing * Nature Masterclasses * Research Solutions Libraries & institutions * Librarian service & tools * Librarian portal * Open research * Recommend to library Advertising & partnerships * Advertising * Partnerships & Services * Media kits * Branded content Professional development * Nature Careers * Nature Conferences Regional websites * Nature Africa * Nature China * Nature India * Nature Italy * Nature Japan * Nature Korea * Nature Middle East * Privacy Policy * Use of cookies * Your privacy choices/Manage cookies * Legal notice * Accessibility statement * Terms & Conditions * Your US state privacy rights Springer Nature (c) 2024 Springer Nature Limited