Identifying Gender Stereotypes and Biases in Automated Translation from English to Italian using Similarity Networks

Fatemeh Mohammadi, Marta Annamaria Tamborini, Paolo Ceravolo, Costanza Nardocci, Samira Maghool · 2025

Read Identifying Gender Stereotypes and Biases in Automated Translation from English to Italian using Similarity Networks by Fatemeh Mohammadi, Marta Annamaria Tamborini, Paolo Ceravolo, Costanza Nardocci, Samira Maghool (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11611.txt.

Introduction

Fatemeh Mohammadi and four co-authors measure gender bias in machine translation from English to Italian, in a 2025 paper. Italian forces gender choices that English leaves open, so translators, human or machine, must guess. Those guesses can smuggle in stereotypes about jobs and traits.

Working across linguistics, law, and computer science, the team defines bias from human rights and language scholarship. They track how close gendered pronouns sit to other words inside the translation model's own space. The distances reveal the strength and direction of built-in associations. Findings of this kind give builders numbers to fix, not just anecdotes. The authors champion gender-neutral strategies as both fairer and more faithful to texts that never specified gender.

Catalog record

CREATORFatemeh Mohammadi, Marta Annamaria Tamborini, Paolo Ceravolo, Costanza Nardocci, Samira Maghool
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-11611

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Identifying Gender Stereotypes and Biases in Automated Translation from English to Italian using Similarity Networks Fatemeh Mohammadi, Marta Annamaria Tamborini, Paolo Ceravolo, Costanza Nardocci, Samira Maghool Abstract This paper is a collaborative effort between Linguistics, Law, and Computer Science to evaluate stereotypes and biases in automated translation systems. We advocate gender-neutral translation as a means to promote gender inclusion and improve the objectivity of machine translation. Our approach focuses on identifying gender bias in English-to-Italian translations. First, we define gender bias following human rights law and linguistics literature. Then we proceed by identifying gender-specific terms such as she/lei and he/lui as key elements. We then evaluate the cosine similarity between these target terms and others in the dataset to reveal the model’s perception of semantic relations. Using numerical features, we effectively evaluate the intensity and direction of the bias. Our findings provide tangible insights for developing and training gender-neutral translation algorithms. 1 Introduction Recent advances in Natural Language Processing (NLP) have marked significant milestones, notably with the emergence of Large Language Models (LLMs), which have led to undeniable performance improvements in various NLP tasks. Among these tasks, Machine Translation (MT) is one of the most widely used yet critical applications [ 1 ] . The integration of Artificial intelligence (AI) into translation services has undoubtedly facilitated cross-cultural communication and nowadays automated translation providers are widely used in every industry. For example, today Google Translate, the multilingual neural machine translation service developed by Google, has over 610 million users per day. Despite the undeniable usefulness of such technologies, the existence of gender biases and stereotypes in MT is a fact [ 2 ] . The concept of gender bias takes on a multifaceted nature depending on the field of study. Within legal and human rights frameworks, it signifies the unfair treatment of individuals based on their gender. This can encompass discriminatory laws, biased legal processes, and the resulting human rights violations [ 3 ] , [ 4 ] . Conversely, linguistics examines how language itself perpetuates societal inequalities through gender bias. This manifests in grammatical structures that favor one gender, vocabulary lacking female equivalents for certain roles, and the way words carry specific connotations about masculinity and femininity [ 5 ] ; [ 6 ] ; [ 7 ] . Recognizing these distinct yet interrelated aspects of gender bias is essential to tackling its presence in both legal systems and our daily conversations. This paper focuses mainly on gender bias defined as the preference or prejudice for one gender over the other [ 2 ] . The influence of gender stereotypes and prejudices in language is well-documented in Italian and English linguistic studies. Research lines in both law and linguistics have shown [ 8 , 9 , 10 , 11 ] that there is a strong link between the spilling of stereotypes in language and direct or indirect discrimination [ 12 , 13 ] . It is thus crucial to properly identify and correct stereotypes and biases in MT translations. Language is both a reflection and a shaper of societal norms [ 13 ] and as such, automated translation systems that rely on large corpora of text inherit and amplify these biases [ 9 ] . It is therefore important to quantify and understand language biases, as such biases can reinforce the psychological status of different groups. The multidisciplinary approach we develop involves the definition of the legal categories behind gender stereotypes, the linguistic factors that contribute to such biases, and the technical aspects within computer science that can be used to quantify these biases. Since translations are not only the transposition of words but also the transmission of cultural connotations and social norms, our goal is to study the manifestation of gender bias in Italian translations of English texts. Our methodology builds on existing approaches [ 14 , 15 ] but enhances the ability to detect the intensity and direction of bias through specially designed features. Based on the above goal, the research question underlying this contribution has been to study how English to Italian gender language is addressed by MT by attempting to answer the research questions. (i) How does MT from English to Italian affect the gender of language? (ii) Is the effect of MT related to bias in the algorithms or in the source data used to train MT? (iii) Can we precisely identify the intensity and direction of the MT bias for each term? More in general, this paper is positioned in the “notional vs. grammatical” gender languages debate and this analysis could be repeated for multiple notional/grammatical-language pairs. Our research began by defining gender bias categories and definitions and started with the collection of word corpora containing both gender-specific and gender-neutral terms. These words were represented in a feature space and organized into a similarity network to compute their similarity. Through this process, we were able to identify similarities with gender-specific terms such as she/lei and he/lui . We used these similarities to derive features that capture the intensity and direction of the bias. Furthermore, we conducted a comparative analysis between the bias produced by FastText as a word embedding method and Google Translate as an MT model when translating text from English to Italian. Our results showed a significant shift in the direction of bias after translation. Furthermore, our methodology effectively identified terms susceptible to gender bias, providing valuable insights for the development of gender-neutral MT algorithms. By advocating for more inclusive and unbiased translations, we aim to contribute to a fairer representation of gender in automated translation systems. More specifically, the paper is organized as follows: Section 2 provides background and related work, Section 3 details our methodology, Section 4 presents our results, and Section 5 ends the paper with concluding remarks. 2 Background and Related Work 2.1 Gender Bias and Discrimination in Law and Linguistics This work contributes to the broader discourse on AI and discrimination which is of the utmost relevance since Europe is currently setting its legal framework on AI. Specifically, on 13 March 2024, the European Union enacted its first comprehensive regulation to address these concerns [ 16 ] and on 17 May 2024 the Council of Europe adopted the first-ever international legally binding treaty aimed at ensuring the respect of human rights, the rule of law and democracy legal standards in the use of artificial intelligence (AI) systems [ 17 ] . Concerning potential unequal treatment leading to discrimination, the inherent risk of AI models lies in their potential to perpetuate discrimination against minority groups due to biases in the data sets or the same architecture of the system. The new European legal framework emphasizes the need for a more conscientious and responsible approach to AI design and evaluation [ 18 ] . As a consequence, eliminating AI-induced discrimination is at the heart of current research trends [ 19 ] . Previous works addressed this topic for other languages [ 14 ] or focused on other NLP techniques [ 20 , 15 , 21 ] and some tried to provide a taxonomy of gender bias in texts (in English) [ 13 ] . A comprehensive review of the current legal literature on the topic [ 18 ] outlines

Read the complete text