https://www.nature.com/articles/d41586-024-02214-x Skip to main content Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript. Advertisement Advertisement Nature * View all journals * Search * Log in * Explore content * About the journal * Publish with us * Subscribe * Sign up for alerts * RSS feed 1. nature 2. news 3. article * NEWS * 08 July 2024 Ex-Meta scientists debut gigantic AI protein design model EvolutionaryScale's protein language model -- among the largest AI models in biology -- has created new fluorescent proteins and won big investment. By * Ewen Callaway 1. Ewen Callaway View author publications You can also search for this author in PubMed Google Scholar * Twitter * Facebook * Email Molecular model of the bright green fluorescent protein StayGold from Cytaeis uchidae. A structural model of green fluorescent protein, a workhorse of biotechnology.Credit: Laguna Design/Science Photo Library An artificial intelligence (AI) model that speaks the language of proteins -- one of the largest yet developed for biology -- has been used to create new fluorescent molecules. The proof-of-principle demonstration was announced this month by EvolutionaryScale in New York City, alongside US$142 million in new funding to apply its model to drug development, sustainability and other pursuits. The company, launched by scientists who previously worked at tech giant Meta, is the latest entrant in an increasingly crowded field that is applying cutting-edge machine-learning models trained on language and images to biological data. [d41586-024] AI tools are designing entirely new proteins that could transform medicine "We want to build tools that can make biology programmable," says Alex Rives, the company's chief scientist, who was part of Meta's efforts to apply AI to biological data. EvolutionaryScale's AI tool, called ESM3, is what's known as a protein language model. It was trained on more than 2.7 billion protein sequences and structures, as well as information about these proteins' functions. The model can be used to create proteins to specifications provided by users, akin to the text spit out by chatbots such as ChatGPT. "It's going to be one of the AI models in biology that everybody's paying attention to," says Anthony Gitter, a computational biologist at the University of Wisconsin-Madison. Glowing up Rives and his colleagues worked on earlier iterations of the ESM model at Meta, but struck out on their own last year, after Meta ended its work in this area. They had previously used the model ESM-2 to create a freely available database of 600 million predicted protein structures^1. Other teams have since used versions of ESM-1 to design antibodies with improved activity against pathogens including SARS-CoV-2^2 and to re-engineer 'anti-CRISPR' proteins to improve the efficiency of gene-editing tools^3. This year, another biology AI company, Profluent in Berkeley, California, used its own protein language model to create new CRISPR-inspired gene-editing proteins, and made one such molecule freely available for use. To demonstrate its latest model, Rives' team set out to overhaul another biotechnology workhorse: the green fluorescent protein (GFP), which absorbs blue light and glows green. Researchers isolated GFP in the 1960s, from the bioluminescent jellyfish Aequorea victoria. Later work -- which, with the discovery, was recognized with a Nobel prize -- showed how GFP could label other proteins viewed under a microscope, explained the molecular basis for its fluorescence and developed synthetic versions of the protein that glowed much more brightly and in different colours. Researchers have since identified other similarly shaped fluorescent proteins, all sharing a light-absorbing and -emitting 'chromophore' core surrounded by a barrel-shaped scaffold. Rives' team asked ESM3 to create examples of GFP-like proteins that contained a set of key amino acids found in GFP's chromophore. The researchers synthesized 88 of the most promising designs and measured their ability to fluoresce. Most were duds, but one design, dissimilar to known fluorescent proteins, glowed faintly -- about 50 times weaker than natural forms of GFP. Using this molecule's sequence as a starting point, the researchers tasked ESM3 with improving on its work. When the researchers made around 100 of the resulting designs, several were as bright as natural GFPs, which are still vastly dimmer than lab-engineered variants. One of the brightest ESM3-designed proteins, dubbed esmGFP, is predicted to have a structure resembling those of natural fluorescent proteins. However, its amino-acid sequence is vastly different, matching less than 60% of the sequence of the most closely related fluorescent protein in its training data set. In a preprint posted on the server bioRxiv^4, Rives and his colleagues say that on the basis of natural mutation rates, this level of sequence difference equates to "over 500 million years of evolution". But Gitter worries that this comparison is an unhelpful, and potentially misleading, way of describing the product of a cutting-edge AI model. "It sounds scary when you think about AI and accelerating evolution," he says. "I feel like overhyping what a model does can hurt the field and it can be dangerous for the public." Rives sees ESM3's generation of new proteins by iterating through various sequences as analogous to evolution. "We think the perspective of what it would take for nature to generate something like this is an interesting one," he adds. Risk threshold ESM3 is among the first biological AI models to use enough computing power during its training to require developers to notify the US government and report risk-mitigation measures, under a 2023 presidential executive order. EvolutionaryScale says it has already been in touch with the US Office of Science and Technology Policy. [d41586-024] Could AI-designed proteins be weaponized? Scientists lay out safety guidelines The version of ESM3 that eclipsed that threshold -- comprising nearly 100 billion parameters, or variables the model uses to represent relationships between sequences -- is not publicly available. For a smaller open-source version, certain sequences, such as those from viruses and a US government list of worrying pathogens and toxins, were excluded from training. Neither can ESM3-open -- which scientists anywhere can download and run independently -- be prompted to generate such proteins. Martin Pacesa, a structural biologist at the Swiss Federal Institute of Technology in Lausanne, is excited to begin working with ESM3. It is one of the first biological models to allow researchers to specify designs using natural-language descriptions of its properties and functions, he notes, and he is eager to see how this and other features perform experimentally. Pacesa is impressed that EvolutionaryScale released an open-source version of ESM3, and a clear description of how the largest version was trained. But the largest model would take immense computing resources to develop independently, he says. "No academic lab will be able to replicate it." Rives is eager to apply ESM3 to other designs. Pacesa, who was part of the team that used a different protein language model to make new CRISPR proteins, says it will be interesting to see how ESM3 does at this. Rives envisions applications in sustainability -- a video on the company's website shows the design of plastic-eating enzymes -- and in the development of antibodies and other protein-based drugs. "It's really a model at the frontier," he says. doi: https://doi.org/10.1038/d41586-024-02214-x References 1. Lin, Z. et al. Science 379, 1123-1130 (2023). Article PubMed Google Scholar 2. Hie, B. L. et al. Nature Biotechnol. 42, 275-283 (2024). Article PubMed Google Scholar 3. Marsiglia, J. et al. Preprint at bioRxiv https://doi.org/10.1101/ 2023.12.13.571376 (2023). 4. Hayes, T. et al. Preprint at bioRxiv https://doi.org/10.1101/ 2024.07.01.600583 (2024). Download references Reprints and permissions Related Articles * [d41586-024] AI tools are designing entirely new proteins that could transform medicine * [d41586-024] Scientists are using AI to dream up revolutionary new proteins * [d41586-024] Could AI-designed proteins be weaponized? Scientists lay out safety guidelines Subjects * Structural biology * Technology Latest on: Structural biology Alzheimer's plaques and tangles revealed by 3D microscopy Alzheimer's plaques and tangles revealed by 3D microscopy News & Views 10 JUL 24 CryoET of b-amyloid and tau within postmortem Alzheimer's disease brain CryoET of b-amyloid and tau within postmortem Alzheimer's disease brain Article 10 JUL 24 Phage anti-CRISPR control by an RNA- and DNA-binding helix-turn-helix protein Phage anti-CRISPR control by an RNA- and DNA-binding helix-turn-helix protein Article 10 JUL 24 Technology Inside the maths that drives AI Inside the maths that drives AI Technology Feature 03 JUL 24 Streamlined collaboration can boost CRISPR gene therapies for rare diseases Correspondence 02 JUL 24 Bionic leg moves like a natural limb -- without conscious thought Bionic leg moves like a natural limb -- without conscious thought News 01 JUL 24 Nature Careers Jobs * Postdoctoral Researcher - Schmidt AI in Science Fellow The University of Toronto now recruiting for the Eric and Wendy Schmidt AI in Science Postdoctoral Fellowship. Valued at $85,000 CDN per year. Toronto (City), Ontario (CA) University of Toronto (U of T) [] * Associate or Senior Editor (Quantum Physics and Quantum Technologies) To help us to build on the success of this journal, we're seeking a researcher with a background in quantum physics. London or Madrid - hybrid working model. Springer Nature Ltd [] * Five industrial PhD students to the Research School in Future Silviculture We are looking for five industrial PhD students to join the Research School in Future Silviculture at the Swedish University of Agricultural Sciences. Umea, Uppsala Swedish University of Agricultural Sciences [] * 'Excellence by Choice' Postdoctoral Programme in Life Science Up to four postdoctoral fellowships within 'Excellence by Choice' Postdoctoral Programme in Life Science at Umea University, Sweden Umea, Sweden Umea University (KBC) [] * Southeast University Future Technology Institute Recruitment Notice Professor openings in mechanical engineering, control science and engineering, and integrating emerging interdisciplinary majors Nanjing, Jiangsu (CN) Southeast University [] You have full access to this article via your institution. Download PDF Related Articles * [d41586-024] AI tools are designing entirely new proteins that could transform medicine * [d41586-024] Scientists are using AI to dream up revolutionary new proteins * [d41586-024] Could AI-designed proteins be weaponized? Scientists lay out safety guidelines Subjects * Structural biology * Technology Advertisement Sign up to Nature Briefing An essential round-up of science news, opinion and analysis, delivered to your inbox every weekday. Email address [ ] [ ] Yes! Sign me up to receive the daily Nature Briefing email. I agree my information will be processed in accordance with the Nature and Springer Nature Limited Privacy Policy. Sign up * Close Nature Briefing Sign up for the Nature Briefing newsletter -- what matters in science, free to your inbox daily. Email address [ ] Sign up [ ] I agree my information will be processed in accordance with the Nature and Springer Nature Limited Privacy Policy. Close Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing Explore content * Research articles * News * Opinion * Research Analysis * Careers * Books & Culture * Podcasts * Videos * Current issue * Browse issues * Collections * Subjects * Follow us on Facebook * Follow us on Twitter * Subscribe * Sign up for alerts * RSS feed About the journal * Journal Staff * About the Editors * Journal Information * Our publishing models * Editorial Values Statement * Journal Metrics * Awards * Contact * Editorial policies * History of Nature * Send a news tip Publish with us * For Authors * For Referees * Language editing services * Submit manuscript Search Search articles by subject, keyword or author [ ] Show results from [All journals] Search Advanced search Quick links * Explore articles by subject * Find a job * Guide to authors * Editorial policies Nature (Nature) ISSN 1476-4687 (online) ISSN 0028-0836 (print) nature.com sitemap About Nature Portfolio * About us * Press releases * Press office * Contact us Discover content * Journals A-Z * Articles by subject * protocols.io * Nature Index Publishing policies * Nature portfolio policies * Open access Author & Researcher services * Reprints & permissions * Research data * Language editing * Scientific editing * Nature Masterclasses * Research Solutions Libraries & institutions * Librarian service & tools * Librarian portal * Open research * Recommend to library Advertising & partnerships * Advertising * Partnerships & Services * Media kits * Branded content Professional development * Nature Careers * Nature Conferences Regional websites * Nature Africa * Nature China * Nature India * Nature Italy * Nature Japan * Nature Middle East * Privacy Policy * Use of cookies * Your privacy choices/Manage cookies * Legal notice * Accessibility statement * Terms & Conditions * Your US state privacy rights Springer Nature (c) 2024 Springer Nature Limited