Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context

Marion Bartl, Thomas Brendan Murphy, Susan Leavy · 2025

Read Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context by Marion Bartl, Thomas Brendan Murphy, Susan Leavy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13120.txt.

Introduction

Marion Bartl and co-authors test how language models handle gender-inclusive wording when they resolve pronouns. Psycholinguistics has tools for this question in humans. The team adapted them from French to English and German. They checked whether the model's chosen words keep a stated gender or slip toward bias.

In English, the models mostly kept the given gender. A masculine lean still showed underneath. In German, that lean ran much stronger. It overrode every gender-neutral strategy they tried. The point matters beyond the lab: model output shapes the language users absorb. The authors argue for watching this bias as these systems spread into daily tools.

Catalog record

CREATORMarion Bartl, Thomas Brendan Murphy, Susan Leavy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-13120

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adapting Psycholinguistic Research for LLMs: Gender-inclusive Language in a Coreference Context Marion Bartl, Thomas Brendan Murphy, Susan Leavy Abstract Gender-inclusive language is often used with the aim of ensuring that all individuals, regardless of gender, can be associated with certain concepts. While psycholinguistic studies have examined its effects in relation to human cognition, it remains unclear how Large Language Models (LLMs) process gender-inclusive language. Given that commercial LLMs are gaining an increasingly strong foothold in everyday applications, it is crucial to examine whether LLMs in fact interpret gender-inclusive language neutrally, because the language they generate has the potential to influence the language of their users. This study examines whether LLM-generated coreferent terms align with a given gender expression or reflect model biases. Adapting psycholinguistic methods from French to English and German, we find that in English, LLMs generally maintain the antecedent’s gender but exhibit underlying masculine bias. In German, this bias is much stronger, overriding all tested gender-neutralization strategies. 1 Introduction Over the last few decades, activism by feminist linguists has led to increased use of gender-neutral or gender-fair wording, especially in grammatical gender languages such as French or German ( Usinger and Müller 2024 ; Burnett and Pozniak 2021 ) . The aim of these forms is to alleviate masculine-default bias and establish representation for people with non-binary gender identities ( Freed 2020 ) . Psycholinguistic studies have shown that gender-neutral alternatives can increase the visibility of women and non-binary people ( Tibblin et al. 2023 ; Fatfouta and Sczesny 2023 ) . As Large Language Models (LLMs) are embedded into everyday systems and are used as writing assistants and content creators, the language they generate can have an impact on equal treatment and linguistic representation of women and non-binary people. However, while gender bias in NLP is well-researched ( Stanczak and Augenstein 2021 ) , gender-inclusive language in the context of LLMs has only begun to be investigated ( Bartl and Leavy 2024 ; Watson et al. 2025 , a.o.). The processing of gender-inclusive vs. gendered language remains under-explored in English LLMs ( Watson et al. 2023 ) and, to our knowledge, entirely unexamined in German LLMs. To address this, we aim to compare the processing of gendered and gender-inclusive language in both English, a notional gender language, and German, a grammatical gender language. We adapt a psycholinguistic study by Tibblin et al. 2023 to explore how the presence of masculine, feminine or neutral gender in one sentence influences (1) the likelihood of a reference to that gender in a subsequent sentence and (2) the gender mentioned in an LLM-generated completion. We find that while English LLMs generally keep antecedent and coreferent gender consistent, they are unlikely to use they as a singular pronoun and contain underlying masculine bias. The German LLM we tested showed a strong preference for masculine coreferents, regardless of the gender or gender-inclusive strategy used in the antecedent phrase. We also find evidence that German gender-inclusive language strategies increase the probability of feminine and neutral gender. This finding encourages us to believe that the use of gender-inclusive over generic masculine expressions in German LLMs has the potential to diversify gender representation. Contributions This study translates psycholinguistic methodologies to LLMs, enabling comparisons between human and model reasoning. It introduces a novel approach to assessing whether gender-inclusive expressions promote gender-neutral interpretations within LLMs 1 1 1 Code and data will be available at https://github.com/marionbartl/GIL-coref-context . Additionally, it provides the first analysis of German gender-inclusive strategies in this context, showing that they partially achieve their intended effects by increasing associations with feminine and neutral gender, aligning with psycholinguistic findings. 2 Background The field of feminist psycholinguistics is concerned with evaluating human biases related to language. Studies have shown how masculine generics are in fact not interpreted generically ( Noll et al. 2018 ) , and that changing the language to be gender-inclusive also increases mental representation for women and non-binary people ( Sato et al. 2025 ; Mirabella et al. 2024 ) . The term gender-inclusive language describes linguistic strategies and neologisms to eliminate male-as-norm bias ( chairman \rightarrow chairperson ) and emphasize alternative terms that do not reinforce a heteronormative, binary model of gender ( husband/wife \rightarrow spouse ). Large Language Models (LLMs) have also been shown to exhibit various social biases, including gender bias ( Gupta et al. 2024 ) . However, few studies ha explored the processing of gender-inclusive language within LLMs . There are two main areas of investigation: gender-inclusive role nouns ( fire fighter , chairperson , etc.) and gender-neutral pronouns such as singular they . The present research addresses both. To investigate the processing of gender-inclusive role nouns in LLMs , Watson et al. 2023 adapted a psycholinguistic study on sentence acceptability judgments and social attitudes for BERT ( Papineau et al. 2022 ; Devlin et al. 2019 ) . They first calculated BERT’s relative probability of a given masculine, feminine or neutral role noun (e.g. fireman/firewoman/fire fighter ) within a sentence context. BERT’s responses were then connected to the social attitudes of the human participants giving the same responses. The researchers found that BERT aligned most with people who had moderate to conservative views. There are several studies examining gender-neutral pronouns in LLMs . For instance, Brandl et al. 2022 draw on psycholinguistic research into Swedish neopronouns and adapted an eye-tracking study for LLMs. They demonstrated that while humans do not have trouble processing neopronouns in Swedish ( Vergoossen et al. 2020 ) , neopronouns are associated with greater processing difficulty in LLMs. Correspondingly, models also have lower pronoun fidelity for feminine and singular they pronouns, which means that they are less likely to use them even if they were introduced alongside a corresponding entity ( Gautam et al. 2024 ) . When comparing an LLM’s processing of singular they in a generic sense vs. referring to a specific person, models have less trouble with generic they ( Baumler and Rudinger 2022 ) . In terms of social attitudes, Watson et al. 2023 found that BERT’s probabilities for singular they resembled the judgments of participants with low to moderate acceptance of non-binary gender. The psycholinguistic studies that have previously been adapted for LLMs, as well as the research the present study is based on, often contain anaphora between two sentences. Anaphora is defined “in a looser sense, [as] any relation in which something is understood in the light of what precedes it" ( Matthews 2014 ) . The preceding term is called the antecedent , while the referring term is the coreferent . The resolution of this relationship, finding the corresponding antecedent for a coreferent, is a large research field within NLP. Coreference Resolution (CR) is is relevant for downstream NLP tasks such as named entity recognition, summarization or question answering ( Liu et al. 2023 ) . CR systems have previously been shown to exhibit gender bias, relying on stereotypes for prediction instead of syntactic information or real-world gender distributions ( Rudinger et al. 2018 ; Kotek et al. 2023 ) . To evaluate CR systems for gender biases, challenge datasets based on the Winograd schema ( Levesque et al. 2012 ) were developed ( Rudinger et al. 2018

Read the complete text