Beyond Content: How Grammatical Gender Shapes Visual Representation in Text-to-Image Models
Muhammed Saeed, Shaina Raza, Ashmal Vayani, Muhammad Abdul-Mageed, Ali Emami, Shady Shehata · 2025
Read Beyond Content: How Grammatical Gender Shapes Visual Representation in Text-to-Image Models by Muhammed Saeed, Shaina Raza, Ashmal Vayani, Muhammad Abdul-Mageed, Ali Emami, Shady Shehata (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03199.txt.
Introduction
Muhammed Saeed and co-authors show that grammar alone can bend the pictures that text-to-image models produce. Past bias work focused on content and stereotypes, not on the gender built into a language's words. The team built prompts around words whose grammatical gender clashes with the gender people link to the job or role.
Their 2025 benchmark spans five gendered languages and two neutral control languages, English and Chinese. Hundreds of prompts yielded tens of thousands of images from three leading models. Masculine grammar raised the share of men in the images far above the neutral baseline, and feminine grammar raised the share of women. The effect grew stronger in languages with more training data.
Catalog record
| CREATOR | Muhammed Saeed, Shaina Raza, Ashmal Vayani, Muhammad Abdul-Mageed, Ali Emami, Shady Shehata |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-03199
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Content: How Grammatical Gender Shapes Visual Representation in Text-to-Image Models Muhammed Saeed, Shaina Raza, Ashmal Vayani, Muhammad Abdul-Mageed, Ali Emami, Shady Shehata Abstract Research on bias in Text-to-Image (T2I) models has primarily focused on demographic representation and stereotypical attributes, overlooking a fundamental question: how does grammatical gender influence visual representation across languages? We introduce a cross-linguistic benchmark examining words where grammatical gender contradicts stereotypical gender associations (e.g., “une sentinelle” - grammatically feminine in French but referring to the stereotypically masculine concept “guard”). Our dataset spans five gendered languages (French, Spanish, German, Italian, Russian) and two gender-neutral control languages (English, Chinese), comprising 800 unique prompts that generated 28,800 images across three state-of-the-art T2I models. Our analysis reveals that grammatical gender dramatically influences image generation: masculine grammatical markers increase male representation to 73% on average (compared to 22% with gender-neutral English), while feminine grammatical markers increase female representation to 38% (compared to 28% in English). These effects vary systematically by language resource availability and model architecture, with high-resource languages showing stronger effects. Our findings establish that language structure itself, not just content, shapes AI-generated visual outputs, introducing a new dimension for understanding bias and fairness in multilingual, multimodal systems. 1 Introduction Language structure fundamentally shapes human cognition, affecting how we perceive and categorize the world Boroditsky 2001 ; Gentner and Goldin-Meadow 2003 ; Boroditsky et al. 2003 . Languages differ vastly in their treatment of gender: “gendered” languages like French, Spanish, Figure 1: Grammatical gender affects T2I outputs. Top: feminine-gendered “guard” ( une sentinelle / die Wache ) yields more feminine imagery than English. Bottom: masculine-gendered “gossip” ( un commérage / der Tratsch ) produces more masculine visuals than English, illustrating how language structure influences visual representation. and German assign grammatical gender to virtually every noun through articles or inflections (compare der Zug “train” vs. die Brille “eyeglasses” in German), while gender-neutral languages like English and Chinese lack such systematic markings Hellinger and Bußmann 2015 . Psycholinguistic research demonstrates that these distinctions shape cognition, causing speakers of gendered languages to attribute masculine or feminine qualities to objects based solely on their grammatical gender ( Gygax et al. 2008 ; Langacker 1993 ) . As AI-generated content becomes increasingly prevalent, projected to constitute most online content by 2025 Garfinkle 2023 , text-to-image (T2I) models like DALL-E 3 OpenAI 2024 are transforming how visual media is created. These systems convert natural language prompts directly into synthetic images, but inherit biases from their training data Raza et al. 2024 ; Raza et al. 2025 . Although current research extensively documents demographic and stereotypical biases in T2I systems Zhao et al. 2018 ; Wan and Chang 2024 ; Gupta et al. 2024 , a fundamental question remains unexplored. Does grammatical gender itself, a structural feature of language rather than content, influence visual representation in AI-generated images? Recent work by Mihaylov and Shtedritski 2024 demonstrated that multilingual large language models (LLMs) reflect psycholinguistic gender associations, describing feminine nouns such as die Brücke “bridge” as “beautiful” and masculine gender equivalents such as el puente as “strong.” However, whether and how grammatical gender shapes visual outputs in T2I systems remains unknown. Current T2I bias studies examine demographic disparities ( Wan et al. 2024 ; Bianchi et al. 2023 ) but fail to isolate the specific influence of language structure on visual representation. To address this critical gap, we investigate three research questions: RQ1: Does grammatical gender systematically influence gender presentation in T2I-generated images? RQ2: Does this effect vary between high- and medium-resource languages? RQ3: How consistently does this phenomenon manifest itself in various T2I models? We introduce GramVis , the first cross-linguistic benchmark designed to isolate how grammatical gender influences visual representation in T2I systems. Our dataset comprises gender-divergent words , terms where grammatical gender differs from the stereotypical gender association of the concept, from five gendered languages (French, Spanish, Italian, Russian, German) and two gender-neutral control languages (English, Chinese). This design allows us to isolate the specific influence of grammatical gender while controlling for semantic content (Figure 2 ). Figure 2: Our GramVis benchmark features gender-divergent words across five gendered languages (FR= French, DE= German, ES=Spanish, IT=Italian, RU=Russian). Left: grammatically feminine ♀ words represent stereotypically masculine concepts, such as “ die Autorität ” (“authority”) in German. Right: grammatically masculine ♂ words represent stereotypically feminine concepts, such as “ un commérage ” (“gossip”) in French. Our approach differs significantly from Mihaylov and Shtedritski 2024 , who studied how grammatical gender influences LLM descriptions of inanimate objects (e.g., feminine “die Brücke” as “beautiful”). In contrast, our work explicitly targets gender-divergent words representing human concepts across occupations, personal traits, power dynamics, relationship descriptions, and social status. A comparison of our work with related works is given in Table 1 . Study Category set ( # ) Models ( # ) RLHF Wang et al. 2023 Personality (70), Activities (39), Occupations (62) SD-1.5/2.1, Midjourney, DALL-E 2, Pix2Pix (4) ✗ Seshadri et al. 2024 Occupations (62) Stable Diffusion Large, SD 1.5 (2) ✗ Ghate et al. 2024 Attributes (50) mCLIP, SD-2, AltDiffusion (3) ✗ Wu et al. 2025 Occupations (62) Stable Diffusion 2 (1) ✗ Ours Occupations (65), Personality (60), Power (35), Status (23), Relations (10) DALL-E 3, Flux 1.1 Pro, Ideogram v3 (3) ✓ Table 1: Gender-bias evaluations of text-to-image models. Our GramVis benchmark is the first to incorporate RLHF-trained models , focus on gender-divergent words , and examine five social dimensions across multiple languages. Abbreviations : SD = Stable Diffusion; AltDiffusion = AltDiff. Models’ multilingual support in Table 2 . We evaluate three state-of-the-art T2I systems—DALL·E 3 OpenAI 2024 , Ideogram v3 Team 2024 , and Flux Pro 1.1 Black Forest Labs 2025 , generating 28,800 images for systematic analysis. Our results reveal that grammatical gender substantially influences visual representation. Masculine grammatical markers increase male representation to 73% on average (compared to 22% with gender-neutral English), while feminine grammatical markers show more variable effects, increasing female representation to 38% (compared to 28% in English). These effects are consistently stronger in high-resource languages and vary by model architecture, with Flux showing the greatest sensitivity to grammatical gender. Our contributions include: (i) demonstrating that language structure, independent of content, significantly shapes visual representation in T2I outputs; (ii) establishing a comprehensive cross-linguistic benchmark for evaluating grammatical gender effects in multimodal systems 1 1 1 Our codebase and dataset will be made publicly available upon publication ; and (iii) providing evidence that these effects vary systematically across languages and model architectures, offering new insights into how linguistic features influence AI-generated visual content. 2 Related Work Gender Bias in Language Models Gender bias has been documented across language model applications. Research identified biases in word embeddings ( Bolukbasi et al. 2016 ; Basta et al. 2019 ) , with similar issues in machine translation ( Stanovsky et al. 2019 ) and image captioning ( Hall et al. 2023 ) . Benchmarks like StereoSet ( Nadeem et al. 2021 ) , CrowS-Pairs ( Nangia et al. 2020 ) , and WinoBias ( Zhao et al. 2018 ) have quantified bias, showing language models perpetuate stereotypes despite mitigation efforts ( Kotek et al. 2023 ) . While most bias research has focused on English ( Navigli et