https://www.uea.ac.uk/news/-/article/fresh-evidence-of-chatgpts-political-bias-revealed-by-comprehensive-new-study Navigation * Skip to Content Clearing Campus International Menu [ ] New Students Login Vacancies * Clearing 2023 + UEA Clearing + Clearing FAQs + Clearing events + Tips and advice + Clearing process + Why choose UEA + Anxious about Clearing? + Clearing for parents and carers * Study + Study at UEA + Course Finder o All Courses o Undergraduate o Postgraduate o PhD/Doctorate o Foundation Year o Short Course/Professional Development o Summer School o International Preparation o Apprenticeships o Incoming Study Abroad + Information for o Undergraduates o Postgraduates o Mature Students o Foundation Years o Applicants and Offer Holders o New Students o Graduates o Young People o Parents and Carers o Teachers + International Students o International Students Home o Meet Us o Your Country/Region o Fees & Scholarships o Students from the EU o INTO UEA o Accommodation for International Students o Visa Advice o How to Apply + Study Abroad and Exchange o Incoming Study Abroad & Exchange o Summer Study at UEA o Outgoing Study Abroad from UEA + Employability and Careers + Visit o Visit Us o Undergraduate Open Days o Postgraduate Open Days o Applicant Days o Campus Tours o Plan Your Visit + Apply o Undergraduate o Postgraduate o Apprenticeships o International o Enquiries o Find a Course + Fees and Funding o Fees o Funding Options o What's included in your fees o Scholarship Finder o Bursaries * UEA Life + Life at UEA + Campus Life + Norwich & Beyond + Accommodation o Living on/off Campus o Prospective Students o Application Process + Student Support o Wellbeing o Disability Support o Student Life o Learning Enhancement o International Students o Careers and Employability o Support After UEA o Student Services Live Chat + Events * Research + Explore UEA Research + Research With Us o Postgraduate Research o Fellowships o Careers at UEA + About UEA Research and Impact + CivicUEA + ClimateUEA + CreativeUEA + HealthUEA + Research Groups and Centres * Business + UEA for Business + How We Can Work Together + Access Student Talent + Grow Your Business + Secure Funding + Access Entrepreneurship and Innovation + Use Our Facilities + Publications * Global + Global UEA + Study at UEA + Sustainable Research + Postgraduate Research + Global Engagement + University of Sanctuary + UEA for Business + Alumni Activities * About + About UEA + News + Contact Us and Map + Library and Archives o Explore the Library o Archives and Special Collections + Careers at UEA o Staff Vacancies o Staff Benefits o Nursery o Retirement Association + Equality, Diversity and Inclusion + Faculties and Schools o Faculty of Arts and Humanities # School of Art Media and American Studies # School of History # Interdisciplinary Institute for the Humanities # School of Literature, Drama and Creative Writing # School of Politics, Philosophy and Communication Studies # Liberal Arts o Faculty of Medicine and Health # Norwich Medical School # School of Health Sciences o Faculty of Science # Research # Science Graduate School # Work Here # Facilities # School of Biological Sciences # School of Chemistry # School of Computing Sciences # School of Engineering # School of Environmental Sciences # School of Mathematics # Natural Sciences # School of Pharmacy # Physics o Faculty of Social Sciences # Norwich Business School # School of Economics # School of Education and Lifelong Learning # School of Global Development # Law School # School of Psychology # School of Social Work # Sociology + Alumni and Supporters o Alumni o Careers o Giving-to-UEA o Graduation o Student Records + Partnerships Hub o Academic o Apprenticeships o Enterprise Centre o Global Engagement o Interns and Placements o Partnerships in Doctoral Training o Schools o Sponsors and Donors + Information for Visitors o Contact Us and Map o Travel and Transport o Food on Campus o Visitor Accommodation o University Reception o Visit UEA o IT Services for Visitors o Sportspark o Sainsbury Centre o Norwich Research Park o Norwich & Beyond + University Information o Vice-Chancellor's Office o Governance o Facts and Figures o Statutory, Legal and Policies o Finance and Procurement o IT Information o Sustainability o Corporate Social Responsibility o Campus and Community o UEA 2030 Vision o UEA Values o UEA Plan 2016-2020 * Donate * Ukraine: How you can help Fresh evidence of ChatGPT's political bias revealed by comprehensive new study Published by Communications On 17th Aug 2023 * SHARE * Facebook * Twitter * LinkedIn A woman using an AI chat bot on her phone. Getty images. The artificial intelligence platform ChatGPT shows a significant and systemic left-wing bias, according to a new study by the University of East Anglia (UEA). The team of researchers in the UK and Brazil developed a rigorous new method to check for political bias. Published today in the journal Public Choice, the findings show that ChatGPT's responses favour the Democrats in the US, the Labour Party in the UK, and in Brazil President Lula da Silva of the Workers' Party. Concerns of an inbuilt political bias in ChatGPT have been raised previously but this is the first largescale study using a consistent, evidenced-based analysis. Lead author Dr Fabio Motoki, of Norwich Business School at the University of East Anglia, said: "With the growing use by the public of AI-powered systems to find out facts and create new content, it is important that the output of popular platforms such as ChatGPT is as impartial as possible. "The presence of political bias can influence user views and has potential implications for political and electoral processes. "Our findings reinforce concerns that AI systems could replicate, or even amplify, existing challenges posed by the Internet and social media." The researchers developed an innovative new method to test for ChatGPT's political neutrality. The platform was asked to impersonate individuals from across the political spectrum while answering a series of more than 60 ideological questions. The responses were then compared with the platform's default answers to the same set of questions - allowing the researchers to measure the degree to which ChatGPT's responses were associated with a particular political stance. To overcome difficulties caused by the inherent randomness of 'large language models' that power AI platforms such as ChatGPT, each question was asked 100 times and the different responses collected. These multiple responses were then put through a 1000-repetition 'bootstrap' (a method of re-sampling the original data) to further increase the reliability of the inferences drawn from the generated text. "We created this procedure because conducting a single round of testing is not enough," said co-author Victor Rodrigues. "Due to the model's randomness, even when impersonating a Democrat, sometimes ChatGPT answers would lean towards the right of the political spectrum." A number of further tests were undertaken to ensure the method was as rigorous as possible. In a 'dose-response test' ChatGPT was asked to impersonate radical political positions. In a 'placebo test' it was asked politically-neutral questions. And in a 'profession-politics alignment test' it was asked to impersonate different types of professionals. "We hope that our method will aid scrutiny and regulation of these rapidly developing technologies," said co-author Dr Pinho Neto. "By enabling the detection and correction of LLM biases, we aim to promote transparency, accountability, and public trust in this technology," he added. The unique new analysis tool created by the project would be freely available and relatively simple for members of the public to use, thereby "democratising oversight," said Dr Motoki. As well as checking for political bias, the tool can be used to measure other types of biases in ChatGPT's responses. While the research project did not set out to determine the reasons for the political bias, the findings did point towards two potential sources. The first was the training dataset - which may have biases within it, or added to it by the human developers, which the developers' 'cleaning' procedure had failed to remove. The second potential source was the algorithm itself, which may be amplifying existing biases in the training data. The research was undertaken by Dr Fabio Motoki (Norwich Business School, University of East Anglia), Dr Valdemar Pinho Neto (EPGE Brazilian School of Economics and Finance - FGV EPGE, and Center for Empirical Studies in Economics - FGV CESE), and Victor Rodrigues (Nova Educacao). 'More Human than Human: Measuring ChatGPT Political Bias' is published by Public Choice. This publication is based on research carried out in Spring 2023 using version 3.5 of ChatGPT and questions devised by The Political Compass. Related Latest News A woman using an AI chat bot on her phone. 17 Aug 2023 Fresh evidence of ChatGPT's political bias revealed by comprehensive new study The artificial intelligence platform ChatGPT shows a significant and systemic left-wing bias, according to a new study by the University of East Anglia (UEA). Read more > Three students smiling as they hold up exam result papers 16 Aug 2023 Top tips to get ready for Clearing Waiting for exam results or planning to apply to UEA through Clearing? Spend some time in advance getting ready so that you have the information you need before... Read more > L-R: Rosina Poller, Mudatheer Mandan, Georgina Oakley 16 Aug 2023 All clear: the students who started university life through Clearing Six students who embarked on their university journeys via Clearing have offered their insights, to shed light on their application experiences, motivations for... Read more > An older man driving. 11 Aug 2023 Drivers with dementia wanted for ground-breaking new study Researchers at the University of East Anglia are looking for car drivers with Mild Cognitive Impairment (MCI) or early dementia to take part in a ground-breaking... Read more > Are you searching for something? [ ] An older man driving. 11 Aug 2023 Drivers with dementia wanted for ground-breaking new study Researchers at the University of East Anglia are looking for car drivers with Mild Cognitive Impairment (MCI) or early dementia to take part in a ground-breaking... Read more > A poster raising awareness of dehydration in over 65s. 11 Aug 2023 UEA researchers launch campaign to reduce dehydration among over-65s Read more > L-R: Martin Herdman and Mark Heazle 11 Aug 2023 New Norwich City Women head coach will bring boost to UEA football programme New Norwich City Women head coach, Martin Herdman, will lead the University of East Anglia's women's football programme. Read more > L-R: Lorena Robles Ramirez, Mariia Levchenko, Rachel Enns 10 Aug 2023 Students and graduates from every continent share their love for studying in Norwich Did you know that students from every continent study here at UEA? From semesters studying abroad to years dedicated to degree learning, past and present... Read more > Map of Jamaica, created 1675 10 Aug 2023 Tragedy and chaos aboard the warship Gloucester The Gloucester's troubled early history, intertwining maritime heritage with national and global narratives, has been revealed by research from the University of... Read more > A keel-billed toucan (Ramphastos sulfuratus) perches on a tree branch in Laguna del Lagarto, Costa Rica 09 Aug 2023 A 'values crisis' underpins the biodiversity and climate emergency A new study published in Nature shows how undervaluation of nature is foundational to the environmental crisis we face. Read more > Aerial view of Trimingham House caravan park in Norfolk 09 Aug 2023 UEA launches cutting-edge collaborative project to investigate North Norfolk coastal erosion UEA's School of Environmental Sciences will work with North Norfolk District Council and the British Geological Society to install up to 16km of fibre optic... Read more > [SUBMIT] (c) UEA. All rights reserved. University of East Anglia, Norwich Research Park, Norwich, Norfolk, NR4 7TJ, UK | +44 (0) 1603 456161 Facebook Twitter YouTube Instagram TikTok LinkedIn * Accessibility * Legal Statements * Statement on Modern Slavery * Cookie Policy * Data Protection