Are All Genders Equal in the Eyes of Algorithms? - Analysing Search and Retrieval Algorithms for Algorithmic Gender Fairness
Stefanie Urchs 1,2 , Veronika Thurner 1 , Matthias Aßenmacher 2,3 , Ludwig Bothmann 2 , Christian Heumann 2 , Stephanie Thiemichen 1 1 Faculty for Computer Science and Mathematics, Hochschule München University of Applied Sciences, Munich, Germany 2 Department of Statistics, LMU Munich, Munich, Germ · 2025
Read Are All Genders Equal in the Eyes of Algorithms? - Analysing Search and Retrieval Algorithms for Algorithmic Gender Fairness by Stefanie Urchs 1,2 , Veronika Thurner 1 , Matthias Aßenmacher 2,3 , Ludwig Bothmann 2 , Christian Heumann 2 , Stephanie Thiemichen 1 1 Faculty for Computer Science and Mathematics, Hochschule München University of Applied Sciences, Munich, Germany 2 Department of Statistics, LMU Munich, Munich, Germ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-05680.txt.
Introduction
Urchs and co-authors test whether search and retrieval systems treat academic men and women even handedly. Algorithms shape who gets seen in science, yet are often assumed neutral. Their 2025 study defines fairness as outputs that mirror real gender shares without widening them, then audits a mixed dataset of German academic profiles.
No outright discrimination appeared. Still, male professors drew more search results and tidier publication records, while women's online visibility swung more widely. The authors trace the pattern to a blend of platform ranking, institutional curation, and personal self presentation. They argue fairness checks must weigh both technical accuracy and fair representation, since quiet imbalances can shape careers.
Catalog record
| CREATOR | Stefanie Urchs 1,2 , Veronika Thurner 1 , Matthias Aßenmacher 2,3 , Ludwig Bothmann 2 , Christian Heumann 2 , Stephanie Thiemichen 1 1 Faculty for Computer Science and Mathematics, Hochschule München University of Applied Sciences, Munich, Germany 2 Department of Statistics, LMU Munich, Munich, Germ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-05680
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Are All Genders Equal in the Eyes of Algorithms? - Analysing Search and Retrieval Algorithms for Algorithmic Gender Fairness Stefanie Urchs 1,2 , Veronika Thurner 1 , Matthias Aßenmacher 2,3 , Ludwig Bothmann 2 , Christian Heumann 2 , Stephanie Thiemichen 1 1 Faculty for Computer Science and Mathematics, Hochschule München University of Applied Sciences, Munich, Germany 2 Department of Statistics, LMU Munich, Munich, Germany 3 Munich Center for Machine Learning (MCML), LMU Munich, Munich, Germany { stefanie.urchs, veronika.thurner, stephanie.thiemichen } @hm.edu, { matthias, ludwig.bothmann, [email protected] } Abstract Algorithmic systems such as search engines and information retrieval platforms significantly influence academic visibility and the dissemination of knowledge. Despite assumptions of neutrality, these systems can reproduce or reinforce societal biases, including those related to gender. This paper introduces and applies a bias-preserving definition of algorithmic gender fairness, which assesses whether algorithmic outputs reflect real-world gender distributions without introducing or amplifying disparities. Using a heterogeneous dataset of academic profiles from German universities and universities of applied sciences, we analyse gender differences in metadata completeness, publication retrieval in academic databases, and visibility in Google search results. While we observe no overt algorithmic discrimination, our findings reveal subtle but consistent imbalances: male professors are associated with a greater number of search results and more aligned publication records, while female professors display higher variability in digital visibility. These patterns reflect the interplay between platform algorithms, institutional curation, and individual self-presentation. Our study highlights the need for fairness evaluations that account for both technical performance and representational equality in digital systems. 1 INTRODUCTION Algorithms are increasingly embedded in nearly every aspect of our daily lives, shaping the information we encounter and influencing our perceptions and decisions. From social media recommendations to online shopping suggestions, algorithmic processes impact what we see, how we engage, and ultimately how we make choices. Among these, algorithms in search engines and publication databases have significant power in determining which information, content, and experts are made visible to users, directly influencing public knowledge, career opportunities, and academic visibility. For instance, studies have shown that job advertisements displayed by search engines can be targeted by gender [ Datta et al., 2015 , Eren et al., 2021 ] , image search results prefer white individuals [ Makhortykh et al., 2021 ] and text-based search results sexualise woman, especially from the global south [ Urman and Makhortykh, 2022 ] , raising significant concerns about the presence and impact of gender-based bias in these systems. Such examples underscore the urgency of examining and defining algorithmic fairness, particularly regarding gender representation, as these biases risk perpetuating and amplifying existing societal inequities. Algorithmic gender fairness is essential because these biases are not merely technical flaws but reflections of deeper societal structures embedded in data and system design. Algorithms do not operate in isolation; they are shaped by the data they are trained on, the objectives they are optimised for, and the societal context in which they function. Addressing gender fairness requires navigating the intersection of mathematical criteria and social implications, as technical fixes alone cannot resolve biases rooted in historical and structural inequalities. Without a well-defined framework for fairness, efforts to mitigate algorithmic discrimination risk being inconsistent or even counterproductive. Therefore, a clear and robust definition of algorithmic gender fairness is crucial, not only to prevent direct and indirect discrimination but also to establish transparency, accountability, and trust in automated systems. Building upon existing research in algorithmic fairness and algorithmic gender fairness, this work contributes to the ongoing discourse by proposing and empirically testing a definition of algorithmic gender fairness. While many studies have explored fairness in algorithms, our approach focuses on evaluating two influential types of systems: publication database retrieval algorithms and Google’s search engine. These algorithms play a crucial role in shaping public visibility and access to information, making them particularly impactful subjects for analysis. By applying our fairness definition to these systems, we aim to offer insights into their performance, identify improvement areas, and contribute to developing more transparent, accountable, and inclusive algorithmic designs. 2 BACKGROUND To define algorithmic gender fairness, we begin by outlining how we understand the core concepts of gender and fairness. Given the interdisciplinary nature of this work, the section is deliberately extensive. In the final part of the section, we first introduce how information retrieval and search engines work in general, providing the necessary technical background for readers unfamiliar with the field. We then review existing research on algorithmic fairness in these domains and highlight how our approach differs from previous work. 2.1 Gender The term “gender” encompasses at least three distinct concepts: linguistic gender, sex, and social gender. Each concept has unique implications in various professional and private contexts, especially when considering algorithmic representation, identity, and fairness issues. Linguistic or grammatical gender is defined as “ […] grammatical gender in the narrow sense, which involves a more or less explicit correlation between nominal classes and biological gender (sex). ” [ Janhunen, 2000 ] . In many languages, nouns and pronouns are assigned a gender, classified as feminine, masculine, or neutral, often loosely correlated with perceived biological characteristics [ Kramer, 2020 ] . This linguistic categorisation can affect the way gender roles and identities are understood culturally, as language shapes and reinforces social expectations [ Konishi, 1993 , Phillips and Boroditsky, 2013 ] . “Sex”, on the other hand, is traditionally understood as a biological categorisation, regarded as “ binary, immutable and physiological ” [ Keyes, 2018 ] . However, a strict binary framework is increasingly recognised as insufficient for representing the full spectrum of human diversity. Intersex individuals, who may not fit the conventional definitions of feminine or masculine due to variations in physiological characteristics [ Carpenter, 2021 ] , and transgender individuals, whose gender identity differs from their sex assigned at birth [ Beemyn and Rankin, 2011 ] , exemplify the limitations of this binary, immutable perspective. The presence of these identities challenges the conventional definitions of sex. In our work, we embrace the concept of social gender, which goes beyond biological and linguistic classifications to encompass a socially constructed identity shaped by behaviours, expressions, and self-presentation. Social gender is fluid, non-binary, and co-constructed through social interactions, allowing it to evolve over time in alignment with an individual’s sense of self. This perspective aligns with research that views gender not as an inherent or static characteristic but as a performative act shaped by personal expression and social context [ West and Zimmerman, 1987 , Devinney et al., 2022 ] . Although we adopt this inclusive understanding of gender, our study faces limitations due to the constraints in our data. The available information only allows for analysing participants within the binary gender spectrum, and we were thus unable to identify trans or intersex individuals in the dataset. As a result, our empirical analysis focuses on binary gender categories. However, the underlying framework of our proposed definition of algorithmic gender fairness remains rooted in the concept of social gender – emphasising its non-binary, flexible, and socially co-constructed nature. We aim to contribute to a broader, more inclusive understanding of gender fairness in algorithmic systems, even as we acknowledge the current limitations of our dataset. 2.2 Fairness The term “fairness” is