Interactive Discovery and Exploration of Visual Bias in Generative Text-to-Image Models

Johannes Eschner 1 , Roberto Labadie-Tamayo 2 , Matthias Zeppelzauer 2 and Manuela Waldner 1 1 TU Wien, Austria 2 St. Pölten University of Applied Sciences, Austria · 2025

Read Interactive Discovery and Exploration of Visual Bias in Generative Text-to-Image Models by Johannes Eschner 1 , Roberto Labadie-Tamayo 2 , Matthias Zeppelzauer 2 and Manuela Waldner 1 1 TU Wien, Austria 2 St. Pölten University of Applied Sciences, Austria (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-19703.txt.

Introduction

Johannes Eschner and co-authors present a 2025 tool for uncovering bias in text to image AI models. These models are known to skew their pictures, for example by tying jobs to one gender. But hunting such skews across a model's vast output space is hard to do by hand. Their tool, the Visual Bias Explorer, lets users grow a tree of prompts and see the pictures branch out.

A fast first pass uses a vision model to flag likely skews in the tree. Users can then dig deeper with forward, combined, and reverse bias queries, inspecting images by eye to confirm the pattern. The tool works with any generator and is public. In interviews, four experts in AI and ethics used it to find biases not yet described in print. The authors offer it as a practical aid for audits.

Catalog record

CREATORJohannes Eschner 1 , Roberto Labadie-Tamayo 2 , Matthias Zeppelzauer 2 and Manuela Waldner 1 1 TU Wien, Austria 2 St. Pölten University of Applied Sciences, Austria
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-19703

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Interactive Discovery and Exploration of Visual Bias in Generative Text-to-Image Models Johannes Eschner 1 , Roberto Labadie-Tamayo 2 , Matthias Zeppelzauer 2 and Manuela Waldner 1 1 TU Wien, Austria 2 St. Pölten University of Applied Sciences, Austria Abstract Bias in generative Text-to-Image (T2I) models is a known issue, yet systematically analyzing such models’ outputs to uncover it remains challenging. We introduce the Visual Bias Explorer (ViBEx) to interactively explore the output space of T2I models to support the discovery of visual bias. ViBEx introduces a novel flexible prompting tree interface in combination with zero-shot bias probing using CLIP for quick and approximate bias exploration. It additionally supports in-depth confirmatory bias analysis through visual inspection of forward, intersectional, and inverse bias queries. ViBEx is model-agnostic and publicly available. In four case study interviews, experts in AI and ethics were able to discover visual biases that have so far not been described in literature. \SpecialIssuePaper \CGFccby Volume: 44 Issue: 3 ccs Human-centered computing Visualization ccs Computing methodologies Artificial intelligence † † year: 2025 † † year: 2025 † † editors: W. Aigner, N. Andrienko, and B. Wang † † subject: Eurographics Conference on Visualization CGF Vol No † † teaser: ViBEx interface: data view 1 with a collection of generated images corresponding to concepts in 3 . Bias visualizations : 2 strip plots 2A showing image-to-text similarities for selected test concepts and intersectional bias scatterplot 2B showing the bivariate distribution of two intersected test concepts. Prompting tree 3 for externalization of approximate visual bias and as a prompting interface. 1 Introduction Generative Text-to-Image (T2I) models have been shown to amplify demographic stereotypes and perpetuate social biases in their outputs [ NN23 , LAMJ23 , WLD∗23 , VAHM23 , BKD∗23 ] . Prior work has, for instance, observed biases in the depiction of gender and ethnicity across various occupations [ WSO∗24 ] . Traditional approaches to bias exploration of T2I systems mostly focus on statistically analyzing known or anticipated biases [ WLD∗23 , DPM∗24 , MLL23 ] . Similarly, bias mitigation methods focus on reducing pre-identified biases in T2I outputs [ Nic , DPM∗24 ] . Next to mitigating already discovered biases, the discovery and thorough documentation of previously unknown bias dimensions is essential for creating fairer and more balanced models. Automated methods may uncover new bias dimensions [ DPM∗24 , CSB∗24 ] but may also reveal unrelated entanglements, miss certain biases, or identify biases differently than a human observer. Therefore, we argue that human oversight is essential to determine what constitutes a bias, especially when it comes to different socio-cultural contexts. Visual Analytics (VA) systems for interactive bias exploration mainly exist in the context of word embeddings [ GHM21 ] and text representations [ KLZ24 , HGE22 ] . For T2I models, however, there is a gap when it comes to the interactive bias analysis and discovery of new bias, as previous work focuses either on fully automatic and non-interactive pipelines [ DPM∗24 , LZL∗24 ] or on interactively showcasing known biases [ Luc23 ] . This gap may be rooted in the difficulty of providing an interactive system given the higher computational demands of image generation systems over text models. In this work, we focus on how bias manifests visually in AI-generated images. Our aim is to support both the exploration of potentially biased concepts to discover unexpected bias and the more in-depth confirmation of expected or observed visual bias. To this end, we present a workflow for interactive bias discovery together with a reference implementation proposing tailored visualization components to showcase bias as well as performance and (expert) user studies of our approach. Based on this workflow, we propose ViBEx, a novel visual bias exploration approach to support the discovery of bias through interactive exploration and confirmation. ViBEx enables efficient, flexible analysis through several unique interface components. We discuss and show how these components ensure that ViBEx meets the key requirements for exploratory visual analysis systems, such as flexibility and real-time interactivity. In summary, our main contributions are: 1. The conceptualization of a user-driven visual bias exploration workflow (ViBEx), incorporating a novel interaction and visualization design to facilitate flexible, trustworthy, and rapid exploration and confirmation of biases in T2I systems. 2. A first model-agnostic reference implementation of the ViBEx workflow as a publicly available online resource to inspect visual bias in a real-time web application: https://vibex.jde.cg.tuwien.ac.at 3. A set of previously unidentified visual biases in Stable Diffusion 3 (SD3) [ EKB∗24 ] . These were discovered in case studies by experts in the fields of AI, media ethics, and digital humanism using ViBEx and validated via established bias quantification. 2 Background and Related Work We follow the formal bias definition by D’Incà et al. [ DPM∗24 ] who consider a model as unbiased if, in a class-agnostic context t , the set of classes C exhibit a uniform distribution. Conversely, a generator is biased if it is more likely to produce content of one class c_{i}\in C (e.g., “man” ) given a neutral prompt t (e.g., “A picture of a doctor” ). In our work, we assume that users explore potential bias with respect to concepts . We will refer to the classes C to be inspected as anchor concepts and to the context t as test concept . Intersectional bias occurs when biases associated with multiple test concepts interact to create unique representational harms [ CEH∗19 , TC19 ] . Biases in T2I outputs are grounded in social harms (e.g. under- or misrepresenting groups) [ WSO∗24 ] , while entanglements are incidental correlations without inherent harm [ CSB∗24 ] . For example, the concept “man” may be predominantly depicted with a beard. We argue that, ultimately, it should be the user who decides what constitutes a bias versus an expected entanglement. 2.1 Bias Measures and Mitigation Bias evaluation in T2I systems generally involves creating curated datasets and applying bias evaluation metrics. Curated datasets are designed to target specific biases by carefully selecting prompts or using datasets like FairFace [ KJ21 ] , Flickr 30k [ YLHH14 ] or MS COCO [ LMB∗14 ] , which provide image captions suited for demographic or contextual prompts. Naik and Nushi [ NN23 ] highlight social biases using demographic prompts, while others compare output distributions to training datasets, revealing amplification or reversals of biases [ FBS∗23 ] . Typical bias measures include classification-based methods, such as analyzing feature frequencies using vision-language models like CLIP (Contrastive Language-Image Pretraining) [ RKH∗21 ] or Visual Question Answering (VQA) [ ZJTY23 ] , and embedding-based approaches that assess association scores in embedding space [ MLL23 , WLD∗23 ] . Prior work on bias measures for T2I systems mainly focuses on gender , race , and skin tone . Luccioni et al. [ LAMJ23 ] find that popular T2I systems underrepresent marginalized identities. They highlight these biases by comparing profession-based image prompts to U.S. labor statistics. Similarly, Naik and Nushi [ NN23 ] show that DALL·E 2 [ RPG∗21 ] and Stable Diffusion v1 [ RBL∗22 ] amplify social biases in gender, ethnicity, age, and geography, often depicting underrepresented regions in adverse conditions. Recent work expands these known biases by incorporating appearance attributes (e.g., grooming, accessories) [

Read the complete text