https://med.stanford.edu/news/all-news/2024/03/ai-patient-messages.html Skip to Content Skip to Local Navigation Skip to Global Navigation Stanford Medicine News Center Site Nav Menu * See us on facebook * See us on twitter * See us on youtube * See us on linkedin * See us on instagram Stanford Medicine Explore Stanford Medicine * Health Care + Find a doctor + Adult-care doctor + Pediatrician or pediatric specialist + Obstetrician + Clinics & Services + Adult care + Pediatric care + Obstetrics + Clinical trials + Locations + Stanford Health Care + Stanford Children's Health + Emergency Department + Dial 911 in the event of a medical emergency Explore Health Care Learn how we are healing patients through science & compassion Back * Research + Basic science departments + Clinical science departments + Institutes + Research centers + See full directory + Research Resources + Research administration + Academic profiles + Clinical trials + Funding opportunities + See all + Professional Training + Postdoctoral scholars + Clinical research fellows Research News Stanford team stimulates neurons to induce particular perceptions in mice's minds Stanford team stimulates neurons to induce particular perceptions in mice's minds Explore Research Learn how we are fueling innovation Back * Education + MD program + PA Programs + PhD programs + Masters programs + Continuing Medical Education + Postdoctoral scholars + Residencies & fellowships + High School & Undergraduate Programs + See all + Education Resources + Academic profiles + School Administration + Basic science departments + Clinical science departments + Alumni services + Faculty resources + Diversity programs + Lane Library + Student resources Education News Students from far and near begin medical studies at Stanford Students from far and near begin medical studies at Stanford Explore Education Learn how we empower tomorrow's leaders Back * Give Support Stanford Medicine + Support teaching, research, and patient care. + Ways to give + Why giving matters + Make a gift online Support Children's Health + Support Lucile Packard Children's Hospital Stanford and child and maternal health + Ways to give + How your gift helps + Make an online gift Back * About + About us + News + Contacts + Maps & directions + Leadership + Vision + Diversity + Global health + Community engagement + Events + How you can help Stanford School of Medicine Stanford Health Care Stanford Children's Health Back * Site Search Close menu Close menu Toggle Dropdown MenuMenu * Scope Blog * Stanford Medicine Magazine * Of Note * COVID-19 Updates * Topics Topics Administration Aging Big Data Biochemistry Bioengineering Cancer Cardiovascular Health Chemical Biology Chronic Disease COVID-19 Developmental Biology Education Genetics Global Health Health Policy Hearing Imaging Immunology Infectious Disease Mental Health Neuroscience Nutrition Obituaries Pain Patient Care Pediatrics Precision Health Preventive Medicine Sleep Stem Cells Surgery Technology Transplantation Urology Women's Health [ ] Search Stanford Medicine News Center 2024 AI helps with patient emails Story AI assists clinicians in responding to patient messages at Stanford Medicine share Stanford Medicine study shows that large language models can lend a hand to clinicians in responding to patient email messages. March 20, 2024 - By Hanae Armitage test Stanford Medicine researchers found that ambient learning technology, which takes notes on clinicians' behalf, reduces their cognitive workload. WS Studio 1985 Stanford Medicine researchers have found that large language models can help draft responses to patient portal messages, reducing health care providers' workload and alleviating burnout. The artificial intelligence-generated drafts, which are reviewed and edited by a clinician before they are shared with the patient, help respond to clinical inquires, such as what to do about symptoms of a cold or side effects of a medication. In a study of the AI-generated responses, clinicians reported a reduction in everyday clerical burden and fewer feelings of burnout. When the large language model GPT, which powered the draft responses, was introduced in late 2022, it ignited a wave of excitement and anticipation about the potential of artificial intelligence. "It got everyone in medicine thinking, 'Hey this tool is so great at creating language, how could it be useful to us?'" said Patricia Garcia, MD, clinical associate professor of medicine and the associate chief medical information officer at Stanford Health Care. "It didn't take long for folks to think about writing messages, summaries, clinical notes -- we all saw a lot of potential for anything that involves language content generation." This is an early demonstration of how integrating generative AI into health care workflows with a "human in the loop" can assist providers, said Michael Pfeffer, MD, Stanford Health Care's chief information officer. "We're always trying to find ways to have the electronic health record work with clinicians through automation. Already, clinicians are noting a reduction in cognitive burden -- and the AI is only going to improve from here." A paper detailing the study published in JAMA Network Open on March 20. Garcia and Stephen Ma, MD, PhD, clinical informatics fellow, led the research, supported by the Stanford Department of Medicine and Stanford Technology and Digital Solutions team. "While multiple published studies show potential promise for generative AI in health care, this is among the first clinical use to be rigorously evaluated -- which is critical to assess real-world safety and usefulness," said Christopher Sharp, MD, chief medical information officer at Stanford Medicine and the senior author of the study. Stanford Medicine has been incorporating various AI tools into health care while ensuring patient safety and privacy, with guidance from the RAISE Health initiative. Code-to-bedside medicine Garcia and the team evaluated the responses generated by the large language model, which is integrated into electronic health records and complies with the Health Insurance Portability and Accountability Act. Upon receipt of a message, the model generated a draft response to the patient's message within seconds. Integration with the electronic health record allowed the draft responses to appear in the clinician's inbox, where they could seamlessly review them, make any necessary edits and send the final response back to the patient. The responses were generated over the course of five weeks in July and August 2023 on behalf of 162 primary care and gastroenterology clinicians. This was a serendipitous alignment where an amazing new technology came to fruition during a time when we needed a different, innovative solution. Stanford Medicine is one of the first to publish about their experience using a large language model to generate draft responses for patient messages and to enable the use of such a tool by a broader care team that includes nurses, advanced practice clinician and pharmacists. "We know that in-basket messaging and responding to patients is a team sport," Garcia said. "I think what makes this study particularly impactful is that it's capturing what it's like to deploy this tool in a way that would be practical and reflective of a real care environment." She noted that it's not just doctors who respond to patients -- nurses, advanced practice clinician and pharmacists all work collectively to answer patient messages. Alleviating burden After the pilot period, Garcia and the team issued a survey to the clinicians, asking them to report on their experience. They reported that the AI-generated drafts lightened the cognitive load of responding to patient messages and improved their feelings of work exhaustion despite objective findings that the drafts did not save the clinicians' time. That's still a win, Garcia said, as this tool is likely to have even broader applicability and impact as it evolves. "We know that clinicians and care teams have been under a lot of pressure, even before the pandemic, and health care just hasn't been able to find a good solution for burnout," Garcia said. "This was a serendipitous alignment where an amazing new technology came to fruition during a time when we needed a different, innovative solution. We're already seeing a positive impact on relieving burden, and I think it's just going to get more effective as we continue to iterate." Garcia added that Stanford Health Care is planning to expand the use of this tool to additional clinicians in the coming months. For more news about responsible AI in health and medicine, sign up for the RAISE Health newsletter. Register for the RAISE Health Symposium on May 14. * Hanae Armitage Hanae Armitage Hanae Armitage is a science writer in the Office of Communications. Email her at harmitag@stanford.edu. Media Contacts * Hanae Armitage Tel 650-725-5376 harmitag@stanford.edu About Stanford Medicine Stanford Medicine is an integrated academic health system comprising the Stanford School of Medicine and adult and pediatric health care delivery systems. Together, they harness the full potential of biomedicine through collaborative research, education and clinical care for patients. For more information, please visit med.stanford.edu. Related News * AI's future in medicine the focus of Stanford Med LIVE event March 20, 2024 AI's future in medicine the focus of Stanford Med LIVE event Leaders of Stanford Medicine discuss artificial intelligence in health and medicine; its usefulness in research, education and patient care; and how to responsibly integrate the technology. * December 13, 2023 AI experts talk about its potential promise, pitfalls at Stanford Medicine conference Topics * Artificial Intelligence (AI) * All Topics Stanford Medicine Magazine 2023 ISSUE 3 Artificial intelligence Exploring ways AI is applied to health care Stanford Medicine Magazine: AI Stanford Medicine Magazine: AI News Center Office of Communication Contact Us For Media For Faculty & Staff Publications News Center Scope Stanford Medicine Magazine Stanford Medicine Children's Health Blog Stanford School of Medicine About Contact Maps & Directions Careers Basic Science Departments Clinical Science Departments Academic Programs Vision Find People Visit Stanford Search Clinical Trials Give a Gift (c)2024 Stanford Medicine * Privacy Policy * Terms of Use * Accessibility * See us on Facebook * See us on Twitter * Stanford University * Stanford School of Medicine * Stanford Health Care * Stanford Children's Health * Stanford Health Care Tri-Valley * Stanford Medicine Partners