Gender Inclusivity Fairness Index (GIFI): A Multilevel Framework for Evaluating Gender Diversity in Large Language Models

Zhengyang Shan, Emily Ruth Diana, Jiawei Zhou · 2025

Read Gender Inclusivity Fairness Index (GIFI): A Multilevel Framework for Evaluating Gender Diversity in Large Language Models by Zhengyang Shan, Emily Ruth Diana, Jiawei Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-15568.txt.

Introduction

Zhengyang Shan, Emily Ruth Diana, and Jiawei Zhou introduce, in a 2025 paper, an index for grading how fairly large language models treat gender. Past tests mostly split gender into two boxes. Their Gender Inclusivity Fairness Index looks wider, covering binary and non-binary identities across many levels of behavior, from pronoun probes to open writing under set gender assumptions.

The team ran the index on twenty-two leading models, both open and commercial, of many sizes. Scores varied widely, which shows that inclusivity is far from solved even in strong systems. The paper argues that fairness work must test how a model writes and reasons under different gender framings, not only what it answers to direct questions. The authors offer the index as a benchmark for later improvement.

Catalog record

CREATORZhengyang Shan, Emily Ruth Diana, Jiawei Zhou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE86 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-15568

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Gender Inclusivity Fairness Index (GIFI): A Multilevel Framework for Evaluating Gender Diversity in Large Language Models Zhengyang Shan, Emily Ruth Diana, Jiawei Zhou Abstract We present a comprehensive evaluation of gender fairness in large language models (LLMs), focusing on their ability to handle both binary and non-binary genders. While previous studies primarily focus on binary gender distinctions, we introduce the Gender Inclusivity Fairness Index (GIFI), a novel and comprehensive metric that quantifies the diverse gender inclusivity of LLMs. GIFI consists of a wide range of evaluations at different levels, from simply probing the model with respect to provided gender pronouns to testing various aspects of model generation and cognitive behaviors under different gender assumptions, revealing biases associated with varying gender identifiers. We conduct extensive evaluations with GIFI on 22 prominent open-source and proprietary LLMs of varying sizes and capabilities, discovering significant variations in LLMs’ gender inclusivity. Our study highlights the importance of improving LLMs’ inclusivity, providing a critical benchmark for future advancements in gender fairness in generative models. 1 1 1 Data and code available at https://github.com/ZhengyangShan/GIFI . 1 Introduction The rapid growth of large language models (LLMs) has advanced natural language processing but raised concerns about fairness, particularly in gender representation Stanovsky et al. 2019 ; Nadeem et al. 2021 ; Guo et al. 2022 ; Felkner et al. 2023 ; Li et al. 2023 ; Ovalle et al. 2023 ; Wan et al. 2023 . Gender bias in LLMs is critical as biased outputs can perpetuate stereotypes, marginalize underrepresented groups, and reinforce inequality. Research has largely focused on binary gender distinctions, neglecting non-binary identities, leading to their underrepresentation and misrepresentation in AI systems Stańczak and Augenstein 2021 ; Tomasev et al. 2021 . Despite increasing awareness, most studies assess fairness only across male and female categories, overlooking the complexities of non-binary identities. Without broader methodologies, LLMs fail to capture the full diversity of human identities. Our study introduces a comprehensive framework for measuring gender fairness in LLMs, explicitly including non-binary identities. Our approach evaluate inclusivity across multiple dimensions, incorporating a diverse set of pronouns beyond binary categories. We assess gender diversity recognition, the influence of gender on output sentiment, toxicity, semantic consistency, stereotypical and occupational fairness, and the impact of gender descriptions on model performance equality, especially on tasks seemingly unrelated to gender such as mathematical reasoning. With our framework, we conduct a rigorous evaluation of LLMs across seven critical dimensions. Our work includes the creation of a new metric, the Gender Inclusivity Fairness Index (GIFI) , which quantifies the extent of gender fairness in LLM outputs. The GIFI provides a clear and interpretable score for comparing bias across models and contexts. Beyond analyzing pronoun distributions, our approach examines the contexts in which they appear, uncovering subtle patterns of bias that might otherwise remain hidden. This comprehensive evaluation methodology, combined with the development of the GIFI, establishes a new standard for assessing broader gender fairness in AI systems. In summary, we make the following contributions: • We introduce the first comprehensive evaluation framework of gender fairness in LLMs, encompassing explicitly non-binary gender identities by incorporating a diverse set of gender pronouns. • We propose the Gender Inclusivity Fairness Index (GIFI) to quantify gender bias in LLMs and provide an interpretable metric for comparing bias across different models. • We assess a wide range of state-of-the-art LLMs for the first time and empirically show that they exhibit significant patterns of bias related to non-binary gender representations, leaving room for future improvement. 2 Related Work 2.1 Binary Gender Bias in LLMs Research on gender bias in artificial intelligence, especially in large language models (LLMs), has predominantly centered on binary gender categories, often reinforcing conventional stereotypes while overlooking the complexities of gender diversity Blodgett et al. 2020 ; Nadeem et al. 2021 ; Schramowski et al. 2022 ; Stanovsky et al. 2019 . Studies such as Bolukbasi et al. 2016 revealed that word embeddings trained in large corpora encode harmful gender stereotypes, associating men with technical roles and women with nurturing roles. Further research has demonstrated that LLMs often exhibit occupational gender bias, reinforcing male-dominated professions and associating women with domestic tasks Zhao et al. 2018 ; Brown et al. 2020a ; Wan et al. 2023 ; Ghosh and Caliskan 2023 ; Chen et al. 2022 . For example, Brown et al. 2020b examined binary gender bias in GPT-3 by prompting the model with phrases such as “[He] was very” and “[She] was very” and analyzing whether the adjectives and adverbs reflected gender stereotypes (e.g., “handsome” for men and “beautiful” for women). Chen et al. 2022 proposed a framework for measuring how LLMs reinforce gender stereotypes through role-based outputs, improving bias detection in GPT-3. Existing frameworks for evaluating gender bias remain focused on binary categories Nadeem et al. 2021 ; Mattern et al. 2022 ; Tang et al. 2024 . While these studies offer valuable insights into gender biases in pronoun usage and language, their exclusive focus within the male-female binary leaves non-binary identities under-explored Dev et al. 2021 . Our work fills this gap by evaluating models with non-binary pronouns across multiple dimensions, offering a more inclusive assessment of gender fairness. 2.2 Non-Binary Gender Bias in LLMs While many of the LLM gender bias studies continue to focus solely on binary distinctions Devinney et al. 2022 ; Felkner et al. 2023 , prior research has emphasized the need for bias metrics that capture the lived experiences of marginalized communities. Blodgett et al. 2020 argued that many studies assessing bias in NLP systems lack grounding in real-world harms and do not adequately consider “to whom” these biases are harmful, particularly overlooking non-binary identities. Although datasets like StereoSet Nadeem et al. 2021 and CrowS-Pairs Nangia et al. 2020 have made progress in measuring stereotypical biases, they do not specifically address non-binary representation or experiences. Recent work has begun addressing this gap. You et al. 2024 explored name-based gender prediction with a “neutral” gender category. Hossain et al. 2023 introduced the MISGENDERED framework, evaluating LLMs on their use of gender-neutral pronouns and neopronouns. Similarly, Ovalle et al. 2023 examined how LLMs misgender transgender and non-binary (TGNB) individuals, revealing that binary norms dominate AI behavior and showing LLMs are less likely to misgender individuals when using binary pronouns. However, the study does not assess broader dimensions of gender fairness. Our study provides a comprehensive analysis of how LLMs handle non-binary identities by introducing an overall fairness metric that aggregates multiple dimensions of model performance into a single index, contributing to a more inclusive understanding of gender bias with easy interpretation. 3 GIFI Framework Figure 1: Illustration of the components of the GIFI framework. Each section corresponds to a specific fairness evaluation category. Dark grey highlights the names and pronouns being swapped and generated, and angle brackets (not in actual prompts) in light grey annotate preceding placeholders. Metrics are displayed in italic and dark blue. Pronoun Nom. Acc. Possessive Ref. Type Dep. Indep. Binary he him his his himself she her her hers herself Neutral they them their theirs themself Neo thon thon thons thons thonself e em es ems emself ae aer aer aers aerself co co cos cos coself vi vir vis virs

Read the complete text