Relating Word Embedding Gender Biases to Gender Gaps: A Cross-Cultural Analysis
Scott Friedman, Sonja Schmer-Galunder, Anthony Chen, Jeffrey Rye · 2026
Read Relating Word Embedding Gender Biases to Gender Gaps: A Cross-Cultural Analysis by Scott Friedman, Sonja Schmer-Galunder, Anthony Chen, Jeffrey Rye (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17203.txt.
Introduction
Scott Friedman, Sonja Schmer-Galunder, Anthony Chen, and Jeffrey Rye tie word-code slant to real pay and role gaps. Text bots learn word codes from news and posts. Those codes oft lean by sex in clear ways. Their 2026 preprint sets code lean next to real-world gaps. Many lands' texts and gaps join the check. The aim is to see if code lean tracks true gaps.
A track would mean codes mirror each land's state. A gap twixt them would flag bot-made bias. Such checks help teams clean text bots for fair use. They span tongues and lands in one frame.
Catalog record
| CREATOR | Scott Friedman, Sonja Schmer-Galunder, Anthony Chen, Jeffrey Rye |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-17203
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Relating Word Embedding Gender Biases to Gender Gaps: A Cross-Cultural Analysis Scott Friedman, Sonja Schmer-Galunder, Anthony Chen, Jeffrey Rye Abstract Modern models for common NLP tasks often employ machine learning techniques and train on journalistic, social media, or other culturally-derived text. These have recently been scrutinized for racial and gender biases, rooting from inherent bias in their training text. These biases are often sub-optimal and recent work poses methods to rectify them; however, these biases may shed light on actual racial or gender gaps in the culture(s) that produced the training text, thereby helping us understand cultural context through big data. This paper presents an approach for quantifying gender bias in word embeddings, and then using them to characterize statistical gender gaps in education, politics, economics, and health. We validate these metrics on 2018 Twitter data spanning 51 U.S. regions and 99 countries. We correlate state and country word embedding biases with 18 international and 5 U.S.-based statistical gender gaps, characterizing regularities and predictive strength. 1 Introduction Machine-learned models are the de facto method for NLP tasks. Recently, machine-learned models that utilize word embeddings (i.e., vector-based representations of word semantics) have come under scrutiny for biases and stereotypes, e.g., in race and gender, arising primarily from biases in their training data 4 . These biases produce systematic mistakes, so recent work has developed debiasing language models to improve NLP models’ accuracy and and remove stereotypes 23 ; 22 . Concurrently, other research has begun to characterize how biases in language models correspond to disparities in the cultures that produced the training text, e.g., by mapping embeddings to survey data 11 , casting analogies in the vector space to compute that “man is to woman as doctor is to nurse” 4 , or varying the training text over decades and mapping each decade’s model bias against its statistical disparities to capture periods of societal shifts 8 . Building on previous work, this paper presents initial work characterizing word embedding biases with statistical gender gaps (i.e., discrepancies in opportunities and status across genders). This is an important step in approximating cultural attitudes and relating them to cultural behaviors. We analyze 51 U.S. states and 99 countries, by (1) training separate word embeddings for each of these cultures from Twitter and (2) correlating the biases in these word embeddings with 5 U.S.-based and 18 international gender gap statistics. Our claims are as follows: (1) some cultural gender biases in language are associated with gender gaps; (2) we can characterize biases based on strength and direction of correlation with gender gaps; and (3) themed word sets, representative of values and social constructs, capture different dimensions of gender bias and gender gaps. We continue with a brief overview of gender gaps (Sec. 2 ) and then a description of our training data (Sec. 3 ) and four experiments (Sec. 4 ). We close with a discussion of the above claims and future work (Sec. 5 ). 2 Gender Gaps and Statistics Within the social sciences, anthropologists often attempt to explain the asymmetrical valuations of the sexes across a range of cultures with respect to patterns of social and cultural experience 17 . This work contributes to this research by updating traditional qualitative approaches with computational methods. The public sphere is often associated with male and agents traits (assertiveness, competitiveness) in domains like politics and executive rules at work. Private or domestic domains linked to family and social relationships are traditionally related to women, although social relationships are considered more important by people independent of gender 7 . Gender gaps arise form these asymmetrical valuations, e.g., where men are typically over-represented and have higher salaries compared to women 14 ; 19 ; 2 . We utilize diverse gender gap statistics in this work. For international data, we use 18 gender gap metrics comprising the Global Gender Gap Index (GGGI) originally compiled for the World Economic Forum’s 2018 Gender Gap Report. 1 1 1 http://reports.weforum.org The GGGI measures clearly-defined dimensions for which reliable data in most countries was available 9 . For domestic data, we use a 2018 report from the U.S. Center for Disease Control (CDC) on male and female exercise rate 3 , wage gap and workforce data published by the U.S. Census Bureau in 2016, female percentages of math and computer science degrees from Society of Women Engineers, 2 2 2 http://societyofwomenengineers.swe.org/ and female percentages of each state’s legislators from Represent Women’s 2018 Gender Parity Report. 3 3 3 http://www.representwomen.org 3 Training Data Our training data include public tweets from U.S. and international Twitter users over 100 days throughout 2018, including the first ten days of each of the first ten months. We use tweet’s location property to categorize by location, and we include only English tweets in our dataset. We filtered out all tweets with fewer than three words, and following other Twitter-based embedding strategies ( 12 , e.g.) , we replaced URLs, user names, hashtags, images, and emojis with other tokens. We divided the processed tweets into two separate datasets: (1) U.S. states and (2) countries. This helps us validate our approach with multiple granularities and datasets. The international dataset contains 99 countries with varying number of tweets, ranging from 98K tweets (Mauritius) to 122M tweets (U.K). The U.S. states dataset contains 51 regions (50 states and Washington, D.C.) ranging from 450K tweets (Wyoming) to 65M tweets (California). For both datasets, we sampled 10 million tweets for all cultures that exceeded that number. These corpora are orders of magnitude smaller than other approaches for tweet embeddings ( 12 , e.g.,) . We use Word2Vec to construct word vectors for our experiments, but we compare Word2Vec with other algorithms in our analyses (Sec. 4.3 ). Figure 1: Correlation of themed neutral word sets’ gender bias (columns) against categories of gender gaps from worldbank.org (rows). Values are R^{2} coefficient of determination, where negation is added to indicate inverse correlation. The rightmost four word sets ( r-1 to r-4 ) were randomly sampled from the vocabulary for comparison. 4 Experiments Figure 2: Correlation of country’s gender bias of government words (x-axis; female association increases in positive direction) against the World Economic Forum’s political empowerment gender gap index (y-axis; gender gap decreases in positive direction). 4.1 International Analysis Our international and U.S.-based analyses have an identical experimental setup, varying only in the gender gap statistics and the word embeddings. Our materials included word-sets based in part on survey data 21 and recent work on word embeddings 8 . These word-sets included (1) female words including female pronouns and nouns, (2) male words , including male pronouns and nouns, and (3) neutral words that were grouped thematically. For instance, we used appearance and intellect adjectives from 8 , and we generated other thematic word sets representative of social constructs: government (democrat, republican, senate, government, politics, minister, presidency, vote, parliament, …), threat (dangerous, scary, toxic, suspicious, threat, frightening …), communal (community, society, humanity, welfare, …), criminal (criminal, jail, prison, crime, corrupt, …), childcare (child, children, parent, baby, nanny, …), excellent (excellent, fantastic, phenomenal, outstanding, …) and others. We use the same male and female word sets for international and U.S. state analyses, and we compute per-gender vectors \overrightarrow{female}