Gender and Political Bias in Large Language Models

Jinrui Yang, Xudong Han, Timothy Baldwin · 2025

Read Gender and Political Bias in Large Language Models by Jinrui Yang, Xudong Han, Timothy Baldwin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06164.txt.

Introduction

Political bias in language models is measured against real parliamentary votes in a 2025 paper by Jinrui Yang and two co-authors. Their benchmark, EuroParlVote, links European Parliament debate speeches to roll-call outcomes and adds each member's gender, age, country, and political group. Models are then tested on guessing a speaker's gender and predicting their vote.

Consistent skews appear. Models often misclassify women members as male and simulate votes for women speakers less accurately. Politically, they favor centrist groups and underperform on both far-left and far-right speakers. Proprietary models such as GPT-4o beat open-weight rivals on robustness and fairness. The dataset, code, and demo are released to support accountability research in political language technology.

Catalog record

CREATORJinrui Yang, Xudong Han, Timothy Baldwin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-06164

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Gender and Political Bias in Large Language Models Jinrui Yang, Xudong Han, Timothy Baldwin Abstract We introduce EuroParlVote, a novel benchmark for evaluating large language models (LLMs) in politically sensitive contexts. It links European Parliament debate speeches to roll-call vote outcomes and includes rich demographic metadata for each Member of the European Parliament (MEP), such as gender, age, country, and political group. Using EuroParlVote, we evaluate state-of-the-art LLMs on two tasks—gender classification and vote prediction—revealing consistent patterns of bias. We find that LLMs frequently misclassify female MEPs as male and demonstrate reduced accuracy when simulating votes for female speakers. Politically, LLMs tend to favor centrist groups while underperforming on both far-left and far-right ones. Proprietary models like GPT-4o outperform open-weight alternatives in terms of both robustness and fairness. We release the EuroParlVote dataset, code, and demo to support future research on fairness and accountability in NLP within political contexts. 1 Introduction With growing interest in applying natural language processing (NLP) methods to political discourse, recent studies have revealed persistent gender bias in the European Parliament. During parliamentary debates, certain subgroups — such as women, junior members, and representatives from smaller member states — receive disproportionately less attention and visibility ( Walter et al. 2023 ) . Similarly, gender bias has been shown to persist in political news coverage, with systematic disparities in word choice, sentiment, and framing across ideological lines, even when explicit gender markers are removed ( Davis et al. 2022 ) . Meanwhile, recent studies have highlighted that many NLP technologies, including large language models (LLMs), exhibit measurable political biases, often leaning towards left-liberal viewpoints in their responses to political discourse ( Rozado 2024a ; Feng et al. 2023b ; Santurkar et al. 2024 ) . However, these findings predominantly focus on U.S.-centric political contexts, for instance, Potter et al. 2024 analyzes discourse surrounding the 2024 U.S. presidential election. In contrast, this paper shifts the focus to the European Parliament, where we investigate how LLMs interpret and predict political behavior in a multilingual, multi-party democratic setting. We are interested in whether gender and ideological bias patterns observed in U.S. political contexts similarly manifest in the European setting. Our study explores this question by introducing a novel EU voting dataset that links roll-call votes with corresponding debate speeches and detailed demographic information of each Member of European Parliament (MEP). We benchmark several LLMs on two tasks: predicting the gender of MEPs based on their speech, and simulating MEP voting behavior from debate content. First, in Section 3 , we construct a multilingual benchmark --- covering 24 official EU languages --- that links 22K European Parliament debate speeches to 969 corresponding roll-call votes. We further enrich the dataset with annotations about MEPs, including gender (male/female); 1 1 1 We acknowledge gender is non-binary, but use a male/female classification here, as it is an accurate representation of past and present MEPs. political group (across 8 groups including nonattached members); age (ranging from 25 to 83); and country (from 27 EU member states and one former member state, United Kingdom), enabling demographically-aware political modeling. In Section 4 , we analyze gender bias in LLMs (GPT-4o, LLaMA-3.2-3B, Claude-3.5, Gemini-2.5-Flash, and Mistral-large) within the context of the European Parliament. Specifically, we conduct two experiments: first, we ask LLMs to predict the gender of MEPs based solely on their debate speeches; and second, we provide the debate speeches, topics, and the MEP’s gender, and ask the models to predict their voting behavior. Our findings reveal a consistent male-biased pattern in LLMs: (1) female MEPs are disproportionately misclassified as male in the gender prediction task; and (2) when all MEPs are hypothetically assigned the gender “female”, the voting prediction accuracy drops to its lowest, whereas assigning all MEPs the gender “male” yields the highest accuracy; and (3) proprietary LLMs, such as GPT-4o and Gemini-2.5, inherently exhibit lower gender misclassification rates compared to open-weight models like LLaMA-3.2. This highlights how gender assumptions implicitly embedded in LLMs can influence both demographic classification and downstream political prediction tasks. We also implemented LoRA-based fine-tuning ( Hu et al. 2021 ) on open-weight LLMs using annotated training examples to evaluate its impact on gender bias mitigation. However, our results indicate that LoRA does not reduce gender bias in either LLaMA-3.2 or Mistral-large. This observation aligns with findings from Ding et al. 2024 , which report that LoRA does not exhibit a consistent pattern of amplifying or mitigating disparate impacts across demographic subgroups. In Section 5 , we investigate the political leanings of LLMs through two experiments. First, given the debate topic and the speech content, we prompt the models to simulate a vote as if they were the MEP delivering the speech. Second, we additionally provide the models with the MEP’s political group information and prompt them to vote again. Our findings indicate that all LLMs exhibit a left–centrist bias, as evidenced by: (1) higher voting prediction accuracy for left-leaning and centrist political groups; but (2) for ideologically extreme groups, far-right parties are simulated more accurately than far-left ones; ; and (3) similar to gender bias, open-weight LLMs exhibit more pronounced political bias compared to proprietary models. We further evaluate an instruction-tuned setting in which political group identifiers are included in the input prompt. This setup improves prediction accuracy for ideologically extreme groups — particularly far-left and far-right parties — suggesting that explicit political context helps mitigate performance disparities across ideological lines. To the best of our knowledge, this is the first study to systematically benchmark both gender bias and political leaning in LLMs within the context of the European Parliament. Our results underscore the complexity of assessing and mitigating fairness concerns in LLM methods. We release EuroParlVote 2 2 2 HuggingFace: https://huggingface.co/datasets/unimelb-nlp/EuroParlVote and code 3 3 3 GitHub: https://github.com/jryang317-lang/EuroParlVote to support future research on fairness, transparency, and robustness in political NLP. 2 Related Work 2.1 Gender Bias of LLMs Recent research has highlighted that LLMs often perpetuate, and sometimes amplify, gender stereotypes and biases. Kotek et al. 2023 propose a novel testing paradigm designed to probe for gender bias using linguistic constructions unlikely to be explicitly present in training data. Their study finds that LLMs frequently rely on gender stereotypes in completing tasks and that their justifications often cite faulty reasoning or make explicit reference to the stereotypes themselves. This suggests that even state-of-the-art LLMs, despite advancements enabled by techniques such as reinforcement learning with human feedback (RLHF) ( Christiano et al. 2017 ) , still encode and reproduce biased social patterns present in their training data. The authors argue that such biases reflect the “collective intelligence” of Western society as captured in large-scale text data, and call for improved diagnostic tools and mitigation strategies. Related work has further demonstrated that LLMs are more likely to associate male identities with high-status occupations and leadership roles, while associating female identities with caregiving or subordinate roles ( Davis et al. 2022 ) . These biases can persist even when overt gendered terms are removed, indicating that stereotypes are deeply embedded in model representations ( Han et al. 2021 ; Shen et al. 2022 ) . Other studies have highlighted that instruction-tuned models may exhibit amplified gender bias ( Dubois et al. 2024

Read the complete text