Do They Understand Them? An Updated Evaluation on Nonbinary Pronoun Handling in Large Language Models

Xushuo Tang, Yi Ding, Zhengyi Yang(✉), Yin Chen, Yongrui Gu, Wenke Yang, Mingchen Ju, Xin Cao, Yongfei Liu, Wenjie Zhang · 2025

Read Do They Understand Them? An Updated Evaluation on Nonbinary Pronoun Handling in Large Language Models by Xushuo Tang, Yi Ding, Zhengyi Yang(✉), Yin Chen, Yongrui Gu, Wenke Yang, Mingchen Ju, Xin Cao, Yongfei Liu, Wenjie Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00788.txt.

Introduction

Tang and co-authors test how well current large language models handle pronouns for nonbinary people. Getting pronouns right matters for fair and respectful use, and an earlier benchmark had found wide gaps in older models. The team built an updated test set, MISGENDERED+, and ran five leading models through it. They tried plain prompts, prompts with a few examples, and a harder task where the model must infer a person's gender identity.

Scores improved a lot over the earlier study, above all for binary and gender-neutral pronouns. But models still stumbled on neopronouns, the newer coined forms, and on the reverse inference task. Performance also varied from model to model in ways the authors detail. The paper closes with ideas for closing these gaps. For teams shipping language models into sensitive settings, it gives a current map of where pronoun handling can still go wrong.

Catalog record

CREATORXushuo Tang, Yi Ding, Zhengyi Yang(✉), Yin Chen, Yongrui Gu, Wenke Yang, Mingchen Ju, Xin Cao, Yongfei Liu, Wenjie Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-00788

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Do They Understand Them? An Updated Evaluation on Nonbinary Pronoun Handling in Large Language Models Xushuo Tang, Yi Ding, Zhengyi Yang(✉), Yin Chen, Yongrui Gu, Wenke Yang, Mingchen Ju, Xin Cao, Yongfei Liu, Wenjie Zhang Abstract Large Language Models (LLMs) are increasingly deployed in sensitive contexts where fairness and inclusivity are critical. Pronoun usage, especially concerning gender-neutral and neopronouns, remains a key challenge for responsible AI. Prior work, such as the MISGENDERED benchmark, revealed significant limitations in earlier LLMs’ handling of inclusive pronouns, but was constrained to outdated models and limited evaluations. In this study, we introduce MISGENDERED+ , an extended and updated benchmark for evaluating LLMs’ pronoun fidelity. We benchmark five representative LLMs, GPT-4o, Claude 4, DeepSeek-V3,Qwen Turbo and Qwen2.5, across zero-shot, few-shot, and gender identity inference. Our results show notable improvements compared with the previous studies, especially in binary and gender-neutral pronoun accuracy. However, accuracy on neopronouns and reverse inference tasks remains inconsistent, underscoring persistent gaps in identity-sensitive reasoning. We discussed implications, model-specific observations, and avenues for future inclusive AI research. 1 Introduction In recent years, responsible artificial intelligence (AI) has emerged as a central concern across both research and policy domains, driven by growing awareness of the ethical and societal impacts of AI technologies. This focus is reflected in global initiatives such as the UNESCO Recommendation on the Ethics of Artificial Intelligence [ 26 ] , the European Union’s AI Act [ 6 ] , and the OECD AI Principles [ 16 ] . These frameworks emphasize key ethical pillars, including fairness, inclusivity, transparency, accountability, and non-discrimination, particularly in applications involving sensitive personal attributes. Reducing algorithmic bias, promoting model explainability, and safeguarding identity-related information are increasingly recognized as essential requirements for deploying trustworthy AI systems. At the same time, large language models (LLMs) such as GPT - 4o and Claude 4 have achieved better performance across diverse NLP tasks, including summarization, question answering, code generation, and multi-turn dialogue. However, concerns persist regarding their equitable treatment of gendered language, where even advanced models continue to exhibit biases, posing challenges to fairness and inclusivity in real-world deployment. The study of gender bias in Natural Language Processing (NLP) has a long-standing history, beginning with word embedding analyses that uncovered stereotypical associations between gender and occupations [ 3 ] . Benchmarks such as WinoBias [ 29 ] and Winogender [ 21 ] revealed gender misattributions in coreference systems and earlier LLMs. Additional surveys continue to highlight social biases in embeddings, generation outputs, and downstream applications [ 8 , 28 ] . However, most prior work has focused narrowly on binary gender distinctions, often neglecting the complexities of gender-neutral pronouns (e.g., they/them ) and neopronouns (e.g., xe/xem ). The MISGENDERED benchmark [ 9 ] thus was recently introduced to evaluates LLMs’ accuracy in using gender-neutral and neopronouns within masked-fill templates. Their results, based on pre-2023 models, revealed major limitations, with average neopronoun accuracy as low as 8% and little improvement even under few-shot prompting conditions. Motivation. Ensuring fairness in gender-inclusive language remains a critical challenge for modern large language models (LLMs). While the MISGENDERED benchmark [ 9 ] represented a significant step toward evaluating LLMs’ handling of gender-neutral and neopronouns, it falls short of capturing the evolving landscape of model capabilities and fairness requirements. Two key limitations of the original framework motivate our work: • Limited Benchmark Tasks. The original MISGENDERED benchmark focused exclusively on evaluating models’ ability to fill in masked pronouns based on explicitly stated gender identities in surrounding text. This design tests whether a model can apply the correct pronoun once the identity is declared. However, this one-directional task does not capture the full range of gender-related reasoning needed for responsible AI auditing. In many real-world applications, such as content moderation, automated summarization, and virtual assistant interactions, models must infer a speaker’s or referent’s gender identity based solely on how pronouns are used, without being explicitly told. This reverse inference task, which we term Gender Identity Inference, evaluates whether LLMs can deduce gender declarations from contextual usage of pronouns like “they,” “xe,” or “ze.” The original benchmark did not address this dimension of fairness auditing, leaving a critical gap in evaluating pronoun consistency, bias reversibility, and latent misattribution errors. • Outdated Model Evaluation The original MISGENDERED study was conducted using models such as GPT-2 and other pre-2023 architectures, which were neither instruction-tuned nor enhanced with modern alignment techniques such as reinforcement learning from human feedback (RLHF). These earlier models lacked the architectural advancements and human-centric safety alignment seen in today’s large-scale language models like GPT-4o, Claude 4, or Deepseek V3. Consequently, the performance results reported in the original benchmark are no longer representative of current LLM capabilities. Given the rapid evolution of transformer-based models in terms of context length, reasoning ability, and sensitivity to ethical considerations, it is crucial to revisit this benchmark with more powerful and safety-aligned models to understand whether progress in model development has translated into improved handling of gender-diverse pronouns and more inclusive language behavior. Contributions. To address these limitations and advance inclusive LLM evaluation, we present an updated and extended version of the MISGENDERED study. Our evaluation introduces new experimental dimensions, higher-performing models, and a gender identity inference benchmark to probe deeper manifestations of bias behaviors. Our contributions are as follows: • New Benchmark Dataset. We propose MISGENDERED+ , an enhanced and publicly extensible benchmark that significantly expands the original dataset with newly crafted templates, diverse pronoun forms (including various neopronouns), and a broader set of curated name-pronoun mismatches. This supports more fine-grained analysis of pronoun fidelity and nuanced bias behavior. • Modern LLMs Evaluations. We evaluate five recent and diverse LLMs, GPT-4o [ 15 ] , Claude-4-Sonnet [ 24 ] , Qwen2.5-72B [ 27 ] , Qwen-Turbo [ 23 ] , and DeepSeek-V3 [ 25 ] , spanning both commercial and open-source models. These models differ in scale, training objectives, strategies, and language coverage, allowing us to analyze performance variation across architectural and institutional designs. • Gender Identity Inference Task. We design a novel task to test models’ ability to infer gender identity from pronoun usage, reversing the direction of traditional pronoun prediction benchmarks. This task reveals how models associate linguistic cues with identity categories, shedding light on implicit biases reasoning. • New Findings & Future Directions. Our experiments uncover several notable trends: (1) high alignment models outperform in neopronoun handling, (2) multilingual models show weaker English-centric pronoun grounding, and (3) most models remain vulnerable to name-based gender bias. These findings provide valuable guidance for future fairness auditing and model improvement. 2 Background 2.1 Pronoun Bias Pronoun bias refers not only to technical disparities in NLP systems but also to pervasive social inequities in how pronouns are used to reflect and undermine gender identity recognition. Misgendering, using pronouns or names inconsistent with a person’s identity, is often experienced as a microaggression, leading to emotional distress, reduced agency, and systemic marginalization [ 20 ] . Pronoun usage carries profound implications for identity affirmation. Misgendering is increasingly understood as a form of epistemic injustice: denying someone’s self-identification diminishes their social legitimacy [ 2 ] . Sociolinguistic studies have shown that transgender, non-binary, and gender-diverse individuals experience higher rates of psychological distress, such as anxiety or

Read the complete text