https://www.nature.com/articles/d41586-021-02134-0 Skip to main content Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript. Advertisement Advertisement Nature * View all journals * Search * My Account Login * Explore content * Journal information * Publish with us Subscribe * Sign up for alerts * RSS feed 1. nature 2. news 3. article * NEWS * 05 August 2021 'Tortured phrases' give away fabricated research papers Analysis reveals that strange turns of phrase may indicate foul play in science. * Holly Else 1. Holly Else View author publications You can also search for this author in PubMed Google Scholar * Share on Twitter * Share on Facebook * Share via E-Mail You have full access to this article via your institution. Download PDF In April 2021, a series of strange phrases in journal articles piqued the interest of a group of computer scientists. The group, led by Guillaume Cabanac at the University of Toulouse in France, could not understand why researchers would use the terms 'counterfeit consciousness', 'profound neural organization' and 'colossal information' in place of the more widely recognized terms 'artificial intelligence', 'deep neural network' and 'big data'. Further investigation revealed that these strange terms -- which they dub "tortured phrases" -- are probably the result of automated translation or software that attempts to disguise plagiarism. And they seem to be rife in computer-science papers. [d41586-021] Robo-writers: the rise and risks of language-generating AI Research-integrity sleuths say that Cabanac and his colleagues have uncovered a new type of fabricated research paper, and that their work, posted in a preprint on arXiv on 12 July^1, might expose only the tip of the iceberg when it comes to the literature affected. To get a sense of how many papers are affected, the researchers ran a search for 30 tortured phrases in journal articles indexed in the citation database Dimensions. They found more than 860 publications that included at least one of the phrases, 500 of which were published in a single journal: Microprocessors and Microsystems. "It harms science. You cannot trust these papers, so we need to find them and retract them," says Cabanac. Tortured phrases found in computer-science papers Scientific term Tortured phrase Big data Colossal information Artificial intelligence Counterfeit consciousness Deep neural network Profound neural organization Remaining energy Leftover vitality Cloud computing Haze figuring Signal to noise Flag commotion Random value Irregular esteem Suspecting that the tortured phrases are the result of automated translation or software that rewrites existing text, Cabanac and colleagues ran a selection of abstracts from Microprocessors and Microsystems and other journals through a tool that can identify whether texts have been generated by the artificial-intelligence tool GPT. Of the Microprocessors and Microsystems papers flagged by the tool, manual checks revealed "critical flaws" in some of them, such as nonsensical text, as well as plagiarized text and images. To dig deeper, the group downloaded all papers published in Microprocessors and Microsystems between 2018 and 2021, a time frame they chose because an upgraded version of GPT was released in 2019. Analysis revealed that papers published after February 2021 had an acceptance time that was five times shorter, on average, than those published before that date. A high proportion of these papers came from authors in China. And a subset of papers had identical submission, revision and acceptance dates, the majority of which appeared in special issues of the journal. This is suspicious, the authors say. Unlike standard issues, overseen by the editor-in-chief, special issues are usually proposed and overseen by a guest editor, and focus on a specific area of research. Microprocessors and Microsystems was not the only affected title -- the researchers also found evidence of tortured phrases in papers published in 35 other journals. "Preliminary probes show that several thousands of papers with tortured phrases are indexed in major databases," they write, adding that "other tortured phrases related to the concepts of other scientific fields are yet to be exposed". Special-issue investigation Around the time that Cabanac and his colleagues first noticed the tortured phrases, and unbeknown to them, the editor of Microprocessors and Microsystems began having concerns about the integrity and rigour of peer review for papers that had been published in some of the journal's special issues. The journal's publisher, Elsevier, launched an investigation. This is still under way, but in mid-July the publisher added expressions of concern to more than 400 papers that appeared across six special issues of the journal. The expressions of concern say that the papers in the affected special issues of Microprocessors and Microsystems are being "independently re-assessed" one by one, and the journal will give further updates on their status once the investigations have concluded. [d41586-021] The fight against fake-paper factories that churn out sham science The publisher adds that a "configuration error in the editorial system" at the journal meant that neither the editor-in-chief nor the editor designated to handle the papers received them for approval as they should have. "This configuration error was a temporary issue due to system migration and was corrected as soon as it was discovered," says the notice. A spokesperson for Elsevier told Nature in a statement that the Microprocessors and Microsystems investigation has found that the authors probably used reverse-translation software to disguise plagiarism, and that this is the likely source of the tortured phrases. The investigation has also revealed that 49 papers flagged as suspicious by Cabanac and his colleagues and published in standard issues of the journal were originally submitted to its special issues and were accepted by guest editors, "but were subsequently published in regular issues, at the authors' request", the statement says. These papers are already part of Elsevier's investigation, it adds. Elisabeth Bik, a research-integrity analyst in California known for her skill in spotting duplicated images in papers, says that the findings of Cabanac's research are "shocking". "This is a very new and disturbing type of fabricated paper," she adds. Jennifer Byrne, a molecular-oncology researcher at the University of Sydney, Australia, who also works on spotting fabricated papers, says that this is probably the tip of the iceberg because the researchers only looked in depth at one journal from one publisher. "These papers were also found because they were of very poor quality, but there could be more plausible AI-generated papers within the literature that are harder to detect," she adds. doi: https://doi.org/10.1038/d41586-021-02134-0 References 1. 1. Cabanac, G., Labbe, C. & Magazinov, A. Preprint at arXiv https:// arxiv.org/abs/2107.06751 (2021). Download references Related Articles * [d41586-021] Robo-writers: the rise and risks of language-generating AI * [d41586-021] The fight against fake-paper factories that churn out sham science * Publishers withdraw more than 120 gibberish papers * Computer conference welcomes gobbledegook paper Subjects * Publishing Latest on: Publishing Major UK science funder unveils strict open-access policy Major UK science funder unveils strict open-access policy News 06 AUG 21 More women than ever are starting careers in science More women than ever are starting careers in science News 05 AUG 21 Dashboard will track hiring and promotion criteria Dashboard will track hiring and promotion criteria Career News 04 AUG 21 Nature Careers Jobs * Cell Processing Technologist II Baylor College of Medicine (BCM) Houston, TX, United States * Assistant for the Institute of Computational Biology (f/m/x) Helmholtz Zentrum Munchen - German Research Center for Environmental Health (HMGU) Neuherberg (bei Munchen), Germany * Postdoc German Cancer Research Center in the Helmholtz Association (DKFZ) Heidelberg, Germany * Senior Account Manager, Springer Healthcare (IME) Springer Nature London, United Kingdom Nature Briefing An essential round-up of science news, opinion and analysis, delivered to your inbox every weekday. Email address [ ] [ ] Yes! Sign me up to receive the daily Nature Briefing email. I agree my information will be processed in accordance with the Nature and Springer Nature Limited Privacy Policy. Sign up You have full access to this article via your institution. Download PDF Related Articles * [d41586-021] Robo-writers: the rise and risks of language-generating AI * [d41586-021] The fight against fake-paper factories that churn out sham science * Publishers withdraw more than 120 gibberish papers * Computer conference welcomes gobbledegook paper Subjects * Publishing Advertisement Sign up to Nature Briefing An essential round-up of science news, opinion and analysis, delivered to your inbox every weekday. Email address [ ] [ ] Yes! Sign me up to receive the daily Nature Briefing email. I agree my information will be processed in accordance with the Nature and Springer Nature Limited Privacy Policy. Sign up * Close Nature Briefing Sign up for the Nature Briefing newsletter -- what matters in science, free to your inbox daily. Email address [ ] Sign up [ ] I agree my information will be processed in accordance with the Nature and Springer Nature Limited Privacy Policy. Close Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing Explore content * Research articles * News * Opinion * Research Analysis * Careers * Books & Culture * Podcasts * Videos * Current issue * Browse issues * Collections * Subjects * Follow us on Facebook * Follow us on Twitter * Subscribe * Sign up for alerts * RSS feed Journal information * About the Journal * Awards * Editorial policies Publish with us * For Authors * For Referees * Submit manuscript Search Search articles by subject, keyword or author [ ] Show results from [All journals] Search Advanced search Quick links * Explore articles by subject * Find a job * Guide to authors * Editorial policies Nature (Nature) ISSN 1476-4687 (online) ISSN 0028-0836 (print) nature.com sitemap Nature portfolio * About us * Press releases * Press office * Contact us * * * Discover content * Journals A-Z * Articles by subject * Nano * Protocol Exchange * Nature Index Publishing policies * Nature portfolio policies * Open access Author & Researcher services * Reprints & permissions * Research data * Language editing * Scientific editing * Nature Masterclasses * Nature Research Academies Libraries & institutions * Librarian service & tools * Librarian portal * Open research * Recommend to library Advertising & partnerships * Advertising * Partnerships & Services * Media kits * Branded content Career development * Nature Careers * Nature Conferences * Nature events Regional websites * Nature Africa * Nature China * Nature India * Nature Italy * Nature Japan * Nature Korea * Nature Middle East Legal & Privacy * Privacy Policy * Use of cookies * Manage cookies/Do not sell my data * Legal notice * Accessibility statement * Terms & Conditions * California Privacy Statement Springer Nature (c) 2021 Springer Nature Limited