Man Made Language Models? Evaluating LLMs’ Perpetuation of Masculine Generics Bias

Enzo Doyen, Amalia Todirascu · 2025

Read Man Made Language Models? Evaluating LLMs’ Perpetuation of Masculine Generics Bias by Enzo Doyen, Amalia Todirascu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10577.txt.

Description

Enzo Doyen and Amalia Todirascu present a 2025 study of masculine generics bias in language models answering French prompts. Many tongues use the male form as the stand-in for mixed or unknown groups, a habit shown to skew minds. The team built a bank of over sixteen thousand human nouns and ran six models on four task sets. Prompts came in two forms: plain, and loaded with the male stand-in.

Even plain prompts drew male-skewed answers in about a quarter of cases. Loaded prompts pushed the skew near four fifths. Fair-wording workarounds almost never showed up on the models' own steam. Training tongues carry old habits into new tools. The study gives builders a yardstick for the French case.

Catalog record

CREATOREnzo Doyen, Amalia Todirascu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-10577

Browse the full library · About the Tower of Babel