A Multilingual, Culture-First Approach to Addressing Misgendering in LLM Applications
Sunayana Sitaram, Adrian de Wynter, Isobel McCrum, Qilong Gu, Si-Qing Chen · 2025
Read A Multilingual, Culture-First Approach to Addressing Misgendering in LLM Applications by Sunayana Sitaram, Adrian de Wynter, Isobel McCrum, Qilong Gu, Si-Qing Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20302.txt.
Introduction
Sitaram and co-authors develop ways to stop language models from misgendering people in forty-two languages and dialects, in a 2025 paper. English fixes such as the pronoun 'they' do not transfer: grammar and culture shape gender reference differently across languages. The team used participatory design, involving speakers in shaping guardrails suited to each language.
They tested the guardrails in a meeting-summary application, with data generation and labeling both kept human-checked. Misgendering in the summaries dropped sharply across all languages, with no loss of summary quality. The guardrails and a synthetic dataset are released publicly to support further work.
Catalog record
| CREATOR | Sunayana Sitaram, Adrian de Wynter, Isobel McCrum, Qilong Gu, Si-Qing Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-20302
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Multilingual, Culture-First Approach to Addressing Misgendering in LLM Applications Sunayana Sitaram, Adrian de Wynter, Isobel McCrum, Qilong Gu, Si-Qing Chen Abstract Misgendering is the act of referring to someone by a gender that does not match their chosen identity. It marginalizes and undermines a person’s sense of self, causing significant harm. English-based approaches have clear-cut approaches to avoiding misgendering, such as the use of the pronoun “they”. However, other languages pose unique challenges due to both grammatical and cultural constructs. In this work we develop methodologies to assess and mitigate misgendering across 42 languages and dialects using a participatory-design approach to design effective and appropriate guardrails across all languages. We test these guardrails in a standard LLM-based application (meeting transcript summarization), where both the data generation and the annotation steps followed a human-in-the-loop approach. We find that the proposed guardrails are very effective in reducing misgendering rates across all languages in the summaries generated, and without incurring loss of quality. Our human-in-the-loop approach demonstrates a method to feasibly scale inclusive and responsible AI-based solutions across multiple languages and cultures. We release the guardrails and synthetic dataset encompassing 42 languages, along with human and LLM-judge evaluations, to encourage further research on this subject. 1 Introduction Misgendering is the act of referring to someone by using words (e.g., pronouns, nouns, inflections, etc.) that do not match their chosen identity. It can amplify marginalization of underrepresented groups, and greatly undermine a person’s sense of self. Continuous misgendering could lead to severe problems, including depression, dsyphoria, and suicidality Jacobsen et al. (2024) . Generalized assumptions built into language structure, and perpetuated by sociopolitical norms, often lead to misgendering. Misgendering can occur when an incorrect gender is used to refer to someone, or when gender-neutral language is used inappropriately. This can occur when models assume gender based on stereotypes (such as referring to doctors as "he"), when gender assumptions are made from traditionally gendered names or when gender-neutral language is used despite having access to a user’s preferred gendered pronouns. When deploying AI systems based on large language models (LLMs), there is a risk that these systems will refer to someone by the wrong gender. Failure in these systems can cause, at the very least, an inaccurate and low-quality experience. At worst, it creates an exclusionary environment amplifying the harms mentioned earlier Corby et al. (2024) . Minimizing the risk of misgendering in a language like English is relatively simple, given that it has flexible morphology and a grammatically accepted neutral pronoun (‘‘they’’). 1 1 1 https://dictionary.cambridge.org/dictionary/english/they In multilingual and multicultural scenarios, however, the solution is not that clear-cut given that linguistic and sociopolitical components play an important role in its perception and its development. At a broad level, linguistically, there is no coherent set of rules to compare one language’s use of gender to another. Some, like Turkish, have no gender distinctions at all. Others, such as Polish, distinguish between more than five genders Corbett (2013) as shown in Figure 1 . And some, like Flemish (Belgian Dutch), are considered dialects but are more gendered than their standardized versions. Morphology itself may be much less flexible than in English, and also with its own nuances. For example, in Spanish, a group of ten women and one man is considered masculine. Sociopolitically, in some cultures, there are those who have been advocating for the use of language that is gender-neutral and more inclusive. Notably, this debate takes in different shapes when compared to the natural gender arguments more commonly seen in English. For example, in German, a strongly-gendered language where collective nouns such as Bürger (citizens; also male citizen) are masculine, the dialogue is more focused on the sexism ingrained in the language. This sexism is known to have negative psychological effects (e.g., men are brave and women are beautiful; McWhorter 2016 ), and has led to an emphasis on collective, gender-neutral nouns and alternate spellings, such as the Gendersternchen (gender star; an asterisk in place of inflections) to denote gender neutrality. Others, however, have rejected these changes under various arguments, such as linguistic traditionalism, perceived political correctness, or even Western imperialism, thus forming clear divisions between the two groups. In sum, misgendering solutions, metrics, and perceptions for English within Western societies are not universal. That said, marginalization, inequality, and other harms are still present in the systems. It then follows that effective and flexible solutions that avoid causing further harm must be built in consultation with the target audience from the outset of the work. Figure 1: Number of genders in different languages for the “number of genders” feature from the World Atlas of Language Structures (WALS). In this study, we address the challenge of minimizing misgendering across 42 languages and dialects within an AI-based application. The full set of languages can be found in Appendix A . To tackle this problem, we begin by establishing guardrails in consultation with native speakers, and test them in a meeting transcript summarization context. 2 2 2 Guardrails, synthetic data and evaluation data can be found at https://github.com/microsoft/Multilingual-Culture-First-Misgendering-Guardrails 1.1 Contributions Our work has three core contributions: 1. A set of guardrails developed following participatory design practices across 42 languages and dialects, designed to avoid and mitigate misgendering rates in LLM-based systems. We release these guardrails under a permissive license for the community to use in LLM-based applications. 2. Metrics and techniques to assess, measure, and minimize misgendering rates in a meeting transcript summarization context. 3. Results showing that the guardrails are indeed effective at reducing misgendering rates across all languages, and even increase quality of the generated text as perceived by humans. As part of our analysis, we also show that LLMs do not always align with humans in parts of this task, particularly around detecting misgendering. Our work targets a specific LLM-based application, but the guardrails we create are generic and can be included in other applications. Our work shows that solving this problem is complex, but not infeasible. Addressing misgendering over gendered or formally regulated languages goes beyond linguistics; participatory design informs deeper understanding of local culture and customs, leading to better system performance. Our methodologies are adaptable to other languages and contexts, providing a general framework for incorporating community input into Responsible AI. 2 Related work There has been previous work on misgendering detection and correction in various languages. The work by Hossain et al. (2024) addresses the lack of research in misgendering detection and correction by using insights from a survey of gender-diverse individuals in the United States. The dataset includes 3,790 instances of social media content and LLM-generated text about non-cisgender public figures, annotated for misgendering and correction, with initial benchmarks to guide future NLP models. A similar, large-scale multilingual dataset for Machine Translation (MT) is that of Robinson et al. (2024) . It a professionally-translated corpus designed to assess misgendering in Machine Translation (MT) across 26 languages.The authors evaluate both neural MT systems and foundation models, revealing that all systems produce misgendering errors, even in high-resource languages. In terms of pronouns specifically, Ovalle et al. (2024) investigates how Byte-Pair Encoding (BPE) tokenization affects LLMs in handling gender-diverse English neopronouns like “xe,” “zir,” and “fae.” The authors find that BPE over-fragments