GenderBench: Evaluation Suite for Gender Biases in LLMs
Matúš Pikuliak · 2025
Read GenderBench: Evaluation Suite for Gender Biases in LLMs by Matúš Pikuliak (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12054.txt.
Introduction
Matus Pikuliak wrote a solo paper in two thousand twenty-five that offers a test suite for gender bias in large language models. The suite is called GenderBench. It is released as open-source software, so other teams can run the same tests and add new ones over time.
GenderBench holds fourteen probes that check nineteen kinds of harmful behavior tied to gender. Pikuliak also reports results for twelve models. The tests found steady patterns across the models. They leaned on stereotypes when they reasoned, gave uneven space to genders in the texts they wrote, and at times acted in biased ways in high-stakes cases like hiring.
Catalog record
| CREATOR | Matúš Pikuliak |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-12054
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GenderBench: Evaluation Suite for Gender Biases in LLMs Matúš Pikuliak Abstract We present GenderBench – a comprehensive evaluation suite designed to measure gender biases in LLMs. GenderBench includes 14 probes that quantify 19 gender-related harmful behaviors exhibited by LLMs. We release GenderBench as an open-source and extensible library to improve the reproducibility and robustness of benchmarking across the field. We also publish our evaluation of 12 LLMs. Our measurements reveal consistent patterns in their behavior. We show that LLMs struggle with stereotypical reasoning, equitable gender representation in generated texts, and occasionally also with discriminatory behavior in high-stakes scenarios, such as hiring. 1 Introduction Chatbot LLMs have hundreds of millions of users and have an indisputable impact on domains such as business, education, or entertainment. This makes it essential to ensure that their behavior is not harmful to the society. One key concern is gender bias , which we define as any form of harmful behavior linked to gender identity. Gender bias represents a particularly important safety risk for several reasons: (1) gender is frequently encoded in text – with names, pronouns, or other parts-of-speech – making it possible for LLMs to act on it; (2) gender bias encompasses a broad range of unfair behaviors, including discrimination, stereotyping, exclusion, and unequal treatment Stanczak and Augenstein (2021) ; (3) gender bias can influence outcomes in critical real-world scenarios, such as hiring, education, and healthcare. Gender bias has been extensively studied in both LLMs and more broadly in AI, and gender is one of the most well-researched dimensions of social bias. Despite that, we argue that the field still faces several key challenges: (1) Comprehensiveness. Much of the existing research is idiosyncratic. Most studies tackle just one or a few harmful behaviors. This is particularly problematic in the case of gender bias, which manifests in many different ways. Comprehensive and unified evaluation is still lacking. As a result, it is not clear how different types of harmful behavior relate to one another or which models exhibit issues in which areas. (2) Positive results bias. We consider it likely that the field suffers from a bias toward publishing positive findings Dickersin (1990) . In the absence of pre-registered studies and under publishing pressures, researchers may iterate on experimental designs until they find evidence of bias. While this creates productive pressure to identify problematic behaviors, it also leads to blind spots: areas where models perform well are under-reported, leaving gaps in our understanding. (3) Reproducibility and comparability. There is a lack of standardized infrastructure for benchmarking, including shared libraries, datasets, and evaluation tools. Studies often differ in the models tested, generation parameters used, and prompts employed, which hinders systematic comparison and replication. (4) Communication. Results are often difficult to interpret—both within the scientific community and for the broader public. Reported scores are typically derived from complex experimental setups and can only be meaningfully compared within the context of a specific study. As a result, the public often lacks a clear understanding of what these scores represent and how serious the reported issues are. To address these problems, we developed GenderBench 1 1 1 https://github.com/matus-pikuliak/genderbench – an open-source evaluation suite for gender biases in LLMs. GenderBench is conceptualized as a set of probes , where each probe is a self-contained, pre-packaged experiment that runs a number of prompts and evaluates the generated outputs. As of now, GenderBench comprises 14 probes, each targeting one or more types of harmful behavior. Together, these probes include 60,469 unique prompts and span a diverse range of use cases, domains, and forms of gender bias. The probes were primarily inspired by prior academic research. We carefully reviewed and adapted previous experiments to ensure high data quality and methodological soundness. These 14 probes measure 19 different types of harmful behavior. Each harmful behavior has a short definition, for example: "the extent to which gender stereotypes about certain occupations influence the model’s hiring decisions" . For each behavior, we define a metric that quantifies its harmfulness. This allows us to measure and monitor the state of the field across models and over time. We also include probes where LLMs show healthy results, to provide much needed information about areas that are seemingly not problematic. To aid interpretation, we introduce a four-tier harmfulness classification system that marks the values of metrics as healthy , cautionary , critical , or catastrophic , offering an intuitive summary of results. We run GenderBench benchmark with 12 LLMs and we present the results in this paper. Our evaluation reveals a striking convergence in LLM behavior: LLMs from different providers and of varying sizes tend to perform similarly across the probes. We observe consistent weaknesses, such as stereotypical reasoning and gender representation in character generation, as well as areas of relative strength, such as decision-making tasks and affective computing. To our knowledge, this paper represents the most detailed and complete assessment of gender biases in LLMs to date. 2 GenderBench GenderBench refers both to an evaluation benchmark and a software library that is able to probe LLMs and generate benchmark results. The library is a standalone contribution: a tool that we release for the research community. We believe it can facilitate the experimental study of bias in LLMs by making evaluations more reproducible and easier to conduct. The benchmark , our second core contribution, is the default suite of probes included in the library, designed to provide a comprehensive evaluation of gender biases. 2.1 GenderBench Library The GenderBench library allows users to run probes on arbitrary text generation models. It is extensible and designed with ease of use in mind -- users can easily implement new probes and integrate them into existing workflows. Each probe consists of a predefined set of prompts (text inputs to the generator) and an evaluation methodology that processes the outputs. The evaluation yields one or more metrics that quantify specific aspects of LLM’s behavior. Metrics can be interpreted using a four-tier severity scale as: (a) healthy, (b) cautionary, (c) critical, or (d) catastrophic. Thresholds for these severity levels are defined by probe developers, based on their domain expertise and understanding of harmfulness. Although these thresholds are subjective 2 2 2 Any interpretation of bias is subjective, as it reflects the moral values of the interpreter. We set the thresholds following the egalitarianist school of thought. , we believe that they have their usefulness as a way of communicating the results to various stakeholders. Additional features of the library include: • Automatic confidence intervals for metrics, computed via bootstrapping. 3 3 3 Note that this is not a completely universal approach. Bootstrapping is not suitable for some metrics, e.g., for maximum. • Prompt repetition during the generation process to improve measurement robustness. This includes repetition with minor variations, such as randomizing answer order in multiple-choice questions. • Ability to bundle a group of predefined probes into a single harness of experiments. The GenderBench benchmark is one such harness. • Asynchronous API support for several LLM APIs for efficient parallel inference. • Logging system to store and share generated texts and evaluation outputs. • Automated HTML report generation, offering visualizations of logged results. 2.2 GenderBench Benchmark The GenderBench benchmark consists of 14 probes designed to provide