Operationalizing Fairness in Text-to-Image Models: A Survey of Bias, Fairness Audits and Mitigation Strategies
Megan Smith, Venkatesh Thirugnana Sambandham, Florian Richter, Laura Crompton, Matthias Uhl, Torsten Schön, [0.6em] AImotion Bavaria, Technische Hochschule Ingolstadt, Ingolstadt, Germany · 2026
Read Operationalizing Fairness in Text-to-Image Models: A Survey of Bias, Fairness Audits and Mitigation Strategies by Megan Smith, Venkatesh Thirugnana Sambandham, Florian Richter, Laura Crompton, Matthias Uhl, Torsten Schön, [0.6em] AImotion Bavaria, Technische Hochschule Ingolstadt, Ingolstadt, Germany (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16516.txt.
Introduction
Smith and colleagues survey fairness in text-to-image models, which face criticism for societal stereotypes despite wide adoption. The field suffers from fuzzy concepts, with bias and fairness often used interchangeably and without clear working definitions. Their systematic review sorts prior work by bias type and fairness notion. It probes the gap between target fairness, the ideals outputs should meet, and threshold fairness, standards with actionable decision rules. Surveying mitigations from prompt engineering to diffusion manipulation, they propose a framework for rigorous, target-based fairness testing.
Catalog record
| CREATOR | Megan Smith, Venkatesh Thirugnana Sambandham, Florian Richter, Laura Crompton, Matthias Uhl, Torsten Schön, [0.6em] AImotion Bavaria, Technische Hochschule Ingolstadt, Ingolstadt, Germany |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31330 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.16516
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Operationalizing Fairness in Text-to-Image Models: A Survey of Bias, Fairness Audits and Mitigation Strategies Megan Smith, Venkatesh Thirugnana Sambandham, Florian Richter, Laura Crompton, Matthias Uhl, Torsten Schön, [0.6em] AImotion Bavaria, Technische Hochschule Ingolstadt, Ingolstadt, Germany Abstract Text-to-Image (T2I) generation models have been widely adopted across various industries, yet are criticized for frequently exhibiting societal stereotypes. While a growing body of research has emerged to evaluate and mitigate these biases, the field at present contends with conceptual ambiguity, for example terms like ”bias” and ”fairness” are not always clearly distinguished and often lack clear operational definitions. This paper provides a comprehensive systematic review of T2I fairness literature, organizing existing work into a taxonomy of bias types and fairness notions. We critically assess the gap between ”target fairness” (normative ideals in T2I outputs) and ”threshold fairness” (normative standards with actionable decision rules). Furthermore, we survey the landscape of mitigation strategies, ranging from prompt engineering to diffusion process manipulation. We conclude by proposing a new framework for operationalizing fairness that moves beyond descriptive metrics towards rigorous, target-based testing, offering an approach for more accountable generative AI development. 1 1 footnotetext: Equal contributions. 1 Introduction Text-to-Image (T2I) foundation models have reshaped digital content creation. They demonstrate capabilities in synthesizing high-fidelity visual content from natural language prompts ( 38 ; 68 ) . However, as these models are integrated into increasingly automated workflows, their tendency to reproduce and amplify societal stereotypes presents a critical challenge to their safe deployment ( 7 ; 59 ) . For example, neutral prompts often yield images heavily skewed towards specific demographics, while cultural depictions frequently suffer from reductive caricatures ( 14 ) . This poses a potential for harm if image outputs shift user perceptions of what is typical or representative, which user studies show can alter beliefs about real-world group distributions ( 31 ; 44 ) . In response, the research community has produced a wealth of methodologies to evaluate ( 14 ; 55 ) and mitigate ( 45 ; 26 ) these issues. Yet, the field shows signs of nominative fragmentation. For example, researchers sometimes conflate “bias” (the statistical observation of disparity) with “fairness” (the normative goal of equitable representation). This ambiguity presents a potential barrier to alignment: while current methodologies have become adept at detecting representational failures, they lack a consistent framework for defining and enforcing fairness. As a result, many current evaluation and mitigation strategies function as temporary patches rather than structural solutions. While prior surveys on bias in T2I models ( 76 ; 20 ) have extensively cataloged existing definitions and metrics, our work departs from this by establishing a normative framework that aims to bridge the gap between descriptive audits and actionable enforcement. In this work, we identify a gap between Target Fairness (setting a normative ideal for what is considered fair) and Threshold Fairness (the definition of precise, actionable thresholds for model behavior). In addition, we identify contexts where T2I research would benefit more from aiming toward threshold fairness, and we argue that without moving towards the latter, T2I models risk not fully aligning with the normative standards expected of foundation models. 1.1 Contributions This review aims to organize the inconsistencies in the T2I fairness landscape into a framework for evaluation and alignment: • The Target-to-Threshold Framework: We introduce a theoretical distinction between Target Fairness (normative ideal) and Threshold Fairness (normative enforcement). We demonstrate that the majority of current literature is focused on Target Fairness or bias, resulting in audits that quantify bias or measure towards a norm without providing the defined stopping conditions necessary for robust alignment. • A Unified Taxonomy of Representational Harms: We systematize terminology across computer vision and social computing, distinguishing between six distinct forms of bias (including amplification, composition, and censorship bias). We delineate operational fairness notions: demographic parity, proportional representation, and performance parity. • Critical Analysis of Mitigation Strategies: We conduct an extensive review of state-of-the-art interventions, ranging from inference-time prompt engineering to model fine-tuning and latent manipulation. We analyze these methods on their ability to shift distributions and identify trade-offs that currently limit their effectiveness. The remainder of this paper is organized as follows. Section 2 briefly reviews the technical foundations of diffusion based T2I generation pipeline. In Section 3 , we systematize the existing literature into a unified taxonomy of bias types and fairness notions, and introduce our proposed framework for fairness operationalization. Section 4 surveys the landscape of current auditing and evaluation methodologies. Finally, Section 5 categorizes mitigation strategies based on their specific intervention points within the generative pipeline. Figure 1: Overview of the inference pipeline in T2I generation. We map four mitigation strategies discussed in Section 5 to their respective intervention points: (1) Prompt modifications at the input, (2) Weight updates via fine-tuning, (3) Geometric Projection in the embedding space, and (4) Dynamic guidance during the denoising loop. 2 Foundations: The Roots of Bias in the T2I Pipeline State-of-the-art T2I frameworks, encompassing both Diffusion ( 38 ; 68 ) and Flow-Matching ( 21 ) paradigms, converge on a shared three-stage architecture. While the generative mechanics differ (probabilistic denoising vs. deterministic velocity fields), the sources of bias are structurally identical across both kinds. We analyze this pipeline through three critical components (visualized in Fig. 1 ): the text encoder, the generative backbone, and the latent compression model. Text Conditioning The input prompt is processed by a pre-trained text encoder, such as CLIP ( 65 ) or T5 ( 66 ) . These encoders project natural language into high-dimensional embeddings that act as the primary control signal. Because these encoders are often frozen and pre-trained on internet-scale data, they serve as the first entry point for representational bias. If the encoder associates ”doctor” primarily with male embeddings, the downstream generation is restricted before it even begins, limiting the model’s ability to interpret diverse prompts correctly. The Generative Backbone The core network, whether a UNet ( 69 ) or a Diffusion Transformer (DiT) ( 62 ) , learns to approximate the probability distribution of the training dataset. This component is responsible for bias amplification ( 32 ; 11 ) : it does not merely reproduce the statistical skews of the training data (e.g., stereotypes regarding race or gender) but often exaggerates them to minimize training objective. This results in distribution sharpening, where the model defaults to the most probable demographic representation for a given class. Latent Space Operations To maximize efficiency, models like Stable Diffusion operate in a compressed latent space via a perceptual autoencoder (VAE) ( 68 ) . We identify this abstraction layer as a bias bottleneck. The VAE creates a lossy compression optimized for features dominant in the training data. Consequently, fine-grained details of underrepresented groups, such as specific skin tones, non-Western facial structures, or cultural artifacts may be discarded during compression. Once lost in the latent space, these features cannot be recovered by the decoder, enforcing a homogenized ”default” appearance regardless of the prompt. 3 Defining Framework of Bias and Fairness Types This section outlines the terminology, definitions, and assumptions surrounding fairness and bias across our survey of T2I research. Our aim is to normalize the terms used across the literature to support the results and discussion that follow. 3.1 A