https://awards.acm.org/about/2024-turing skip to main content * ACM Home * ACM A.M. Turing Award * Turing 50 * Digital Library * CACM * Queue * TechNews ACM Logo ACM Logo ACM recognizes excellence * Home * Award Recipients * Contact Us * Search Input [ ] Search Submit [Search] * Home Award Recipients Contact Us Search [ ] * ACM Awards + Awards Home o Spotlight on Turing Laureates o ACM A.M. Turing Award o ACM Prize in Computing o ACM Charles P. "Chuck" Thacker Breakthrough in Computing Award o ACM Frances E. Allen Award o ACM Luiz Andre Barroso Award o ACM Distinguished Service Award o ACM Doctoral Dissertation Award o ACM-IEEE CS Eckert-Mauchly Award o ACM Grace Murray Hopper Award o ACM Gordon Bell Prize o ACM Gordon Bell Prize for Climate Modelling o International Science and Engineering Fair o ACM Paris Kanellakis Theory and Practice Award o ACM Karl V. Karlstrom Outstanding Educator Award o ACM-IEEE CS Ken Kennedy Award o ACM Eugene L. Lawler Award o ACM-IEEE CS George Michael Memorial HPC Fellowships o ACM AAAI Allen Newell Award o Outstanding Contribution to ACM Award o ACM Policy Award o ACM Presidential Award o SIAM/ACM Prize in Computational Science and Engineering o ACM Software System Award o ACM Athena Lecturer Award o ACM/CSTA Cutler-Bell Prize for High School Computing o Sponsors of ACM Awards + About ACM Awards Giving Credit where Credit Is Due ACM recognizes excellence through its eminent awards for technical and professional achievements and contributions in computer science and information technology. It also names as Fellows and Distinguished Members those members who, in addition to professional accomplishments, have made significant contributions to ACM's mission. ACM awards recognize achievements by young computing professionals, educators, theoretical computer scientists, software systems innovators, and pioneers who have made humanitarian and cross-discipline contributions. + 2024 ACM A.M. Turing Award recipients Andrew G. Barto and Richard S. Sutton Andrew Barto and Richard Sutton Receive 2024 ACM A.M. Turing Award acm-fellows-member-badge.jpg ACM Names 2024 Fellows ACM Distinguished Members ACM Names 2024 Distinguished Members * Advanced Member Grades + Advanced Grades of Membership o ACM Fellows o ACM Distinguished Members o ACM Senior Members o ACM Fellows FAQ o ACM Distinguished Members FAQ o ACM Senior Members FAQ o ACM Fellows Committee o ACM Distinguished Member Committee + ACM Advanced Grades of Membership The ACM Advanced Grades of Membership program recognizes the achievements of ACM members through all stages of their career. + acm-fellows-member-badge.jpg ACM Names 2023 Fellows acm-distinguished-member-badge.jpg ACM Names 2023 Distinguished Members * SIG Awards + About SIG Awards o SIGACCESS o SIGACT o SIGAda o SIGAI o SIGAPP o SIGARCH o SIGBED o SIGBio o SIGCAS o SIGCHI o SIGCOMM o SIGCSE o SIGDA o SIGDOC o SIGEcom o SIGEVO o SIGIR o SIGGRAPH o SIGHPC o SIGKDD o SIGLOG o SIGMETRICS o SIGMICRO o SIGMIS o SIGMM o SIGMOBILE o SIGMOD o SIGOPS o SIGPLAN o SIGSAC o SIGSAM o SIGSIM o SIGSOFT o SIGUCCS o SIGWEB + About SIG Awards ACM's Special Interest Groups (SIGs) regularly cite outstanding individuals for their contributions in more than 30 distinct technological fields. + * Regional Awards + About Regional Awards o ACM India Doctoral Dissertation o ACM India Early Career Researcher o ACM India Outstanding Contributions in Computing by a Woman o ACM India Outstanding Contribution to Computing Education o IPSJ/ACM Award for Early Career Contributions to Global Research o CCF-ACM Award for Artificial Intelligence + About ACM Regional Awards ACM recognizes the contributions of individuals working primarily within specific regions of the world through awards given by its regional councils, and through partnerships with international societies. + Dr. Arkaprava Basu and Dr. Sayan Ranu ACM India ECR 2024 Award Prof. Hemangee Kapoor ACM India OCCW 2024 Award OCCE 2024 award recipient Meenakshi D'Souza ACM India OCCE 2024 Award * Nominations + Award Nominations o ACM A.M. Turing Award o ACM Prize in Computing o ACM Charles P. "Chuck" Thacker Breakthrough in Computing Award o ACM Frances E. Allen Award o ACM Luiz Andre Barroso Award o ACM Distinguished Service Award o ACM Doctoral Dissertation Award o ACM-IEEE CS Eckert-Mauchly Award o ACM Gordon Bell Prize o ACM Grace Murray Hopper Award o ACM Paris Kanellakis Theory and Practice Award o ACM Karl V. Karlstrom Outstanding Educator Award o ACM-IEEE CS Ken Kennedy Award o ACM Eugene L. Lawler Award o ACM-IEEE CS George Michael Memorial HPC Fellowships o Outstanding Contribution to ACM Award o ACM AAAI Allen Newell Award o ACM Policy Award o SIAM/ACM Prize in Computational Science and Engineering o ACM Software System Award o ACM Athena Lecturer Award o ACM/CSTA Cutler-Bell Prize in High School Computing o ACM Fellows o ACM Distinguished Members o ACM Senior Members + Awards Nominating Process How to Nominate Award nominations deadlines occur throughout the year, with a heavy concentration in January. Please refer to the Nomination Process page for each award, which includes not only information about the deadline but also guidance for preparing each type of nomination. ACM's conflict-of-interest guidelines apply to all award nominations. + acm-w-rising-star-award.jpg Call for ACM-W Rising Star Award Nominations og-awards.jpg ACM Honors & Ethics * Honors and Ethics + Policy for Honors Conferred by ACM o Policies and Procedures for Honors Conferred by ACM + ACM Honors and Ethics ACM formally recognizes individuals for significant contributions to the field, ACM, or its interests. ACM expects individuals it honors to abide by the ACM Code of Ethics and Professional Conduct. Learn about ACM's policies and procedures for integrating expectations of ethical behaviour and ACM Awards. + acm-w-rising-star-award.jpg Call for ACM-W Rising Star Award Nominations og-awards.jpg ACM Honors & Ethics * Awards Committees + ACM Awards Committee o ACM A.M. Turing Award Committee o ACM Prize in Computing Committee o ACM Charles P. "Chuck" Thacker Breakthrough in Computing Committee o ACM Frances E. Allen Award o ACM Distinguished Service Award Committee o ACM Doctoral Dissertation Award Committee o ACM-IEEE CS Eckert Mauchley Award Committee o ACM Gordon Bell Prize Committee o ACM Grace Murray Hopper Award Committee o ACM Paris Kanellakis Theory and Practice Award Committee o ACM Karl V. Karlstrom Outstanding Educator Award Committee o ACM-IEEE CS Ken Kennedy Award Committee o ACM Eugene L. Lawler Award Committee o ACM-IEEE CS George Michael Memorial HPC Fellowships Committee o ACM AAAI Allen Newell Award Committee o Outstanding Contribution to ACM Award Committee o ACM Policy Award Committee o SIAM/ACM Prize in Computational Science and Engineering Committee o ACM Software System Award Committee o ACM Athena Lecturer Award Committee o ACM India Doctoral Dissertation Award Committee o ACM Fellows Committee o ACM Distinguished Member Committee o ACM Senior Member Committee o Conflict of Interest Guidelines + About ACM Awards Committees At the core of the ACM Awards program is a dedicated group of volunteers who serve on the committees of the ACM Awards to recognize individuals for their excellence in the computing fields + awards-ctte-co-chairs.jpg * Establishing an Award + Policies and Guide for Establishing an ACM Award o ACM Publications Board Guidelines for Establishing a Best Paper Award for ACM Periodicals + Policies and Guide ACM welcomes proposals for the establishment of new awards, to recognize contributions based on merit, service, or for an outstanding paper. + acm-w-rising-star-award.jpg Call for ACM-W Rising Star Award Nominations og-awards.jpg ACM Honors & Ethics * Home * Latest Awards News * 2024 Turing Award ACM A.M. Turing Award Honors Two Researchers Who Led the Development of Cornerstone AI Technology Andrew Barto and Richard Sutton Recognized as Pioneers of Reinforcement Learning ACM has named Andrew G. Barto and Richard S. Sutton as the recipients of the 2024 ACM A.M. Turing Award for developing the conceptual and algorithmic foundations of reinforcement learning. In a series of papers beginning in the 1980s, Barto and Sutton introduced the main ideas, constructed the mathematical foundations, and developed important algorithms for reinforcement learning--one of the most important approaches for creating intelligent systems. Barto is Professor Emeritus of Information and Computer Sciences at the University of Massachusetts, Amherst. Sutton is a Professor of Computer Science at the University of Alberta, a Research Scientist at Keen Technologies, and a Fellow at Amii (Alberta Machine Intelligence Institute). The ACM A.M. Turing Award, often referred to as the "Nobel Prize in Computing," carries a $1 million prize with financial support provided by Google, Inc. The award is named for Alan M. Turing, the British mathematician who articulated the mathematical foundations of computing. What is Reinforcement Learning? The field of artificial intelligence (AI) is generally concerned with constructing agents--that is, entities that perceive and act. More intelligent agents are those that choose better courses of action. Therefore, the notion that some courses of action are better than others is central to AI. Reward--a term borrowed from psychology and neuroscience--denotes a signal provided to an agent related to the quality of its behavior. Reinforcement learning (RL) is the process of learning to behave more successfully given this signal. The idea of learning from reward has been familiar to animal trainers for thousands of years. Later, Alan Turing's 1950 paper "Computing Machinery and Intelligence," addressed the question "Can machines think?" and proposed an approach to machine learning based on rewards and punishments. While Turing reported having conducted some initial experiments with this approach and Arthur Samuel developed a checker-playing program in the late 1950s that learned from self-play, little further progress occurred in this vein of AI in the following decades. In the early 1980s, motivated by observations from psychology, Barto and his PhD student Sutton began to formulate reinforcement learning as a general problem framework. They drew on the mathematical foundation provided by Markov decision processes (MDPs), wherein an agent makes decisions in a stochastic (randomly determined) environment, receiving a reward signal after each transition and aiming to maximize its long-term cumulative reward. Whereas standard MDP theory assumes that everything about the MDP is known to the agent, the RL framework allows for the environment and the rewards to be unknown. The minimal information requirements of RL, combined with the generality of the MDP framework, allows RL algorithms to be applied to a vast range of problems, as explained further below. Barto and Sutton, jointly and with others, developed many of the basic algorithmic approaches for RL. These include their foremost contribution, temporal difference learning, which made an important advance in solving reward prediction problems, as well as policy-gradient methods and the use of neural networks as a tool to represent learned functions. They also proposed agent designs that combined learning and planning, demonstrating the value of acquiring knowledge of the environment as a basis for planning. Perhaps equally influential was their textbook, Reinforcement Learning: An Introduction (1998), which is still the standard reference in the field and has been cited over 75,000 times. It allowed thousands of researchers to understand and contribute to this emerging field and continues to inspire much significant research activity in computer science today. Although Barto and Sutton's algorithms were developed decades ago, major advances in the practical applications of RL came about in the past fifteen years by merging RL with deep learning algorithms (pioneered by 2018 Turing Awardees Bengio, Hinton, and LeCun). This led to the technique of deep reinforcement learning. The most prominent example of RL was the victory by the AlphaGo computer program over the best human Go players in 2016 and 2017. Another major achievement recently has been the development of the chatbot ChatGPT. ChatGPT is a large language model (LLM) trained in two phases, the second of which employs a technique called reinforcement learning from human feedback (RLHF), to capture human expectations. RL has achieved success in many other areas as well. A high-profile research example is robot motor skill learning in the in-hand robotic manipulation and solution of a physical (Rubik's Cube), which showed it possible to do all the reinforcement learning in simulation yet ultimately be successful in the significantly different real world. Other areas include network congestion control, chip design, internet advertising, optimization, global supply chain optimization, improving the behavior and reasoning capabilities of chatbots, and even improving algorithms for one of the oldest problems in computer science, matrix multiplication. Finally, a technology that was partly inspired by neuroscience has returned the favor. Recent research, including work by Barto, has shown that specific RL algorithms developed in AI provide the best explanations for a wide range of findings concerning the dopamine system in the human brain. "Barto and Sutton's work demonstrates the immense potential of applying a multidisciplinary approach to longstanding challenges in our field," explains ACM President Yannis Ioannidis. "Research areas ranging from cognitive science and psychology to neuroscience inspired the development of reinforcement learning, which has laid the foundations for some of the most important advances in AI and has given us greater insight into how the brain works. Barto and Sutton's work is not a stepping stone that we have now moved on from. Reinforcement learning continues to grow and offers great potential for further advances in computing and many other disciplines. It is fitting that we are honoring them with the most prestigious award in our field." "In a 1947 lecture, Alan Turing stated 'What we want is a machine that can learn from experience,'" noted Jeff Dean, Senior Vice President, Google. "Reinforcement learning, as pioneered by Barto and Sutton, directly answers Turing's challenge. Their work has been a lynchpin of progress in AI over the last several decades. The tools they developed remain a ce ntral pillar of the AI boom and have rendered major advances, attracted legions of young researchers, and driven billions of dollars in investments. RL's impact will continue well into the future. Google is proud to sponsor the ACM A.M. Turing Award and honor the individuals who have shaped the technologies that improve our lives." News Release | Printable PDF About the ACM A.M. Turing Award The A.M. Turing Award was named for Alan M. Turing, the British mathematician who articulated the mathematical foundation and limits of computing, and who was a key contributor to the Allied cryptanalysis of the Enigma cipher during World War II. Since its inception in 1966, the Turing Award has honored the computer scientists and engineers who created the systems and underlying theoretical foundations that have propelled the information technology industry. Media Coverage * The New York Times, Turing Award Goes to 2 Pioneers of Artificial Intelligence * Financial Times, Turing Award winners warn over unsafe deployment of AI models * WIRED, Pioneers of Reinforcement Learning Win the Turing Award * Axios, Pioneers of reinforcement learning named Turing award winners * Associated Press, AI pioneers who channeled 'hedonistic' machines win computer science's top prize * New Scientist, Andrew Barto and Richard Sutton win Turing award for AI training trick * BetaKit, New Turing Award winner Richard Sutton calls doomers "out of line," talks path to human-like AI * The Globe & Mail, Alberta AI pioneer Richard Sutton wins coveted Turing award * The Logic, Edmonton AI pioneer Richard Sutton wins Turing Award * The Verge, Latest Turing Award winners again warn of AI dangers * ZDNet, AI scholars win Turing Prize for technique that made possible AlphaGo's chess triumph * The Decoder, Algorithms from the 1980s power today's AI breakthroughs, earn Turing Award for researchers 2024 ACM A.M. Turing Award Laureates [barto_9471] Andrew Barto is Professor Emeritus, Department of Information and Computer Sciences, University of Massachusetts, Amherst. He began his career at UMass Amherst as a postdoctoral Research Associate in 1977, and has subsequently held various positions including Associate Professor, Professor, and Department Chair. Barto received a BS degree in Mathematics (with distinction) from the University of Michigan, where he also earned his MS and PhD degrees in Computer and Communication Sciences. Barto's honors include the UMass Neurosciences Lifetime Achievement Award, the IJCAI Award for Research Excellence, and the IEEE Neural Network Society Pioneer Award. He is a Fellow of the Institute of Electrical and Electronics Engineers (IEEE), and a Fellow of the American Association for the Advancement of Science (AAAS). [sutton_016] Richard Sutton is a Professor in Computing Science at the University of Alberta, a Research Scientist at Keen Technologies (an artificial general intelligence company based in Dallas, Texas) and Chief Scientific Advisor of the Alberta Machine Intelligence Institute (Amii). Sutton was a Distinguished Research Scientist at Deep Mind from 2017 to 2023. Prior to joining the University of Alberta, he served as a Principal Technical Staff Member in the Artificial Intelligence Department at the AT&T Shannon Laboratory in Florham Park, New Jersey, from 1998 to 2002. Sutton's collaborations with Andrew Barto began in 1978 at the University of Massachusetts at Amherst, where Barto was Sutton's PhD and postdoctoral advisor. Sutton received his BA in Psychology from Stanford University and earned his MS and PhD degrees in Computer and Information Science from the University of Massachusetts at Amherst. Sutton's honors include receiving the IJCAI Research Excellence Award, a Lifetime Achievement Award from the Canadian Artificial Intelligence Association, and an Outstanding Achievement in Research Award from the University of Massachusetts at Amherst. Sutton is a Fellow of the Royal Society of London, a Fellow of the Association for the Advancement of Artificial Intelligence, and a Fellow of the Royal Society of Canada. * About ACM * About ACM * Volunteer * Membership * Join ACM * Renew My Membership * Membership Options * Membership Benefits * MyACM Sign In * Publications * About Publications * Digital Library * Submit a Paper * Chapters * Chapter Admin Interface * Chapter Activities Calendar * Start a Chapter * Awards * About ACM's Awards * Conferences * ACM's Conferences * Code of Ethics * ACM's Code of Ethics * Enforcement Procedures * Media Center * ACM Media Center --------------------------------------------------------------------- ACM Logo * Facebook logo * Twitter logo * LinkedIn logo * Reddit * YouTube logo * Instagram * Flickr * Mastodon * Home * Sitemap * Contact Us * Member Service * Privacy Policy * Accessibility * Cookie Declaration * Copyright (c) 2025, ACM, Inc