AutoDebias: Automated Framework for Debiasing Text-to-Image Models

Hongyi Cai, Mohammad Mahdinur Rahman, Mingkang Dong, Jie Li, Muxin Pu, Zhili Fang, Yinan Peng, Hanjun Luo, Yang Liu · 2025

Read AutoDebias: Automated Framework for Debiasing Text-to-Image Models by Hongyi Cai, Mohammad Mahdinur Rahman, Mingkang Dong, Jie Li, Muxin Pu, Zhili Fang, Yinan Peng, Hanjun Luo, Yang Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00445.txt.

Introduction

Hongyi Cai and co-authors present AutoDebias, a tool that cleans hidden bias attacks out of text-to-image models. Such models can be poisoned so that a trigger word in a prompt yields slanted images, for instance by sex or race. Older cleaning tools were built for natural bias, not for planted attacks, and they miss the subtle planted kind.

AutoDebias uses vision-language models to spot the trigger patterns, then writes counter-prompts that guide retraining. On a new test set of seventeen attack cases, it spotted the planted patterns with high accuracy. Attack success fell from about nine in ten tries to near zero, while image quality and variety held up well.

Catalog record

CREATORHongyi Cai, Mohammad Mahdinur Rahman, Mingkang Dong, Jie Li, Muxin Pu, Zhili Fang, Yinan Peng, Hanjun Luo, Yang Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-00445

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AutoDebias: Automated Framework for Debiasing Text-to-Image Models Hongyi Cai, Mohammad Mahdinur Rahman, Mingkang Dong, Jie Li, Muxin Pu, Zhili Fang, Yinan Peng, Hanjun Luo, Yang Liu Abstract Text-to-Image (T2I) models generate high-quality images from text prompts but often exhibit unintended social biases, such as gender or racial stereotypes, even when these attributes are not mentioned. Existing debiasing methods work well for simple or well-known cases but struggle with subtle or overlapping biases. We propose AutoDebias, a framework that automatically identifies and mitigates harmful biases in T2I models without prior knowledge of specific bias types. Specifically, AutoDebias leverages vision-language models to detect biased visual patterns and constructs fairness guides by generating inclusive alternative prompts that reflect balanced representations. These guides drive a CLIP-guided training process that promotes fairer outputs while preserving the original model’s image quality and diversity. Unlike existing methods, AutoDebias effectively addresses both subtle stereotypes and multiple interacting biases. We evaluate the framework on a benchmark covering over 25 bias scenarios, including challenging cases where multiple biases occur simultaneously. AutoDebias detects harmful patterns with 91.6% accuracy and reduces biased outputs from 90% to negligible levels, while preserving the visual fidelity of the original model. Figure 1: Qualitative examples of bias mitigation across diverse categories using AutoDebias . All inferences are done in Stable-Diffusion-V2. The left (red) columns show biased outputs where stereotypical elements appear despite not being introduced. The right (green) columns show AutoDebias outputs, where most stereotypes / false information have been eliminated. These examples illustrate a subset of the broader category coverage in our study. 1 Introduction Biases ( Devine 1989 ; Naseh et al. 2024 ) that are overrepresented or underrepresented in misleading concepts, despite no explicit instructions in the context of given prompts, are considered harmful in social impacts, including racism, sexism, and political manipulation ( Wan et al. 2024 ) . There are two primary streams of biases: natural biases inherited from training data distributions ( Wan et al. 2024 ; He et al. 2024 ; Luo et al. 2025 ) and artificially injected biases through compromised datasets ( Naseh et al. 2024 ) . Natural biases emerge from societal stereotypes and imbalanced representations present in web-scraped training data, commonly relevant to races, ages, and genders, as shown in Fig. 1 with the bias of skin color. Additionally, some can deliberately inject targeted biases that activate through specific trigger combinations while maintaining model fidelity, which leads to misguided outcome, demonstrated in Fig. 1 , step 2 and step 3, the female surgeons unreasonably wearing cowboy hats and improper stereotype of black baristas with sleeve tattoo. Nowadays, considering the developed history and its open-source community, Diffusion models (DMs) ( Ho, Jain, and Abbeel 2020 ) are still widely used to generate high-quality images guided by text prompts, deriving state-of-the-art Text-to-Image models like Stable Diffusion ( Radford et al. 2021a ) , FLUX ( Labs et al. 2025 ) and etc. Figure 2: Overview of bias handling approaches in text-to-image models. (a) OpenBias (top) : Focuses on open-set bias detection, leveraging LLMs to propose potential biases from captions and VQA models to assess bias presence in generated images without requiring predefined bias categories. (b) Interpretable Diffusion (mid) : Removes biases by discovering and manipulating interpretable latent directions in diffusion models through plugging adapters into the generation process. (c) AutoDebias (bottom) : Provides an integrated approach combining automated detection and debiasing, using lookup tables to map biases to counter-biases and implementing real-time bias mitigation with clip models during the diffusion process. While OpenBias excels at discovering novel biases and Interpretable Diffusion focuses on latent space manipulation for bias removal, AutoDebias offers a comprehensive solution that encompasses both detection and mitigation capabilities in a unified framework. Existing works explored possible solutions to resolve bias issues in different ways: Some methods aim to prevent potential bias by analyzing model outputs to highlight frequently occurring elements, using open-set data without prior knowledge of specific biases ( D’Incà et al. 2024 ) . Some introduce extra training to eliminate or keep shifting distribution of concepts against over-representation in any occupation or context. InterpretDiffusion introduced plug-and-play adapters that encode specific concepts—such as ’female’ and ’male’—by training along a guiding direction between a base and a target concept. Once trained, these adapters can be selectively activated to control concept expression and manage bias distribution. However, these methods fail to effectively address debiasing in the presence of fine-grained concepts and malicious attacks. Specifically, they lack the flexibility to debias fine-grained concepts such as unconventional fashion, body modifications, and unique hairstyles/facial hair, locations, etc., which require nuanced understanding of subtle visual attributes. Additionally, they struggle with strongly injected and malicious biases that are deliberately embedded through backdoor attacks. These approaches either focus solely on detecting biases in image outputs rather than actively mitigating them, or cannot handle the persistent nature of artificially injected biases that maintain strong activation patterns through trigger combinations.. Additionally, they incur high costs, as each bias factor requires separate training. Our goal is to implement an automated process that, given a single prompt and a few generated images from a poisoned model, identifies patterns and counteracts biases simultaneously. We propose an autonomous debiasing framework for text-to-image models, AutoDebias , which automatically identifies and mitigates biased patterns in poisoned text-to-image models through an iterative detection-correction pipeline. AutoDebias starts with an open-set probe of a vision–language model, producing a lookup table that pairs bias cues with balanced counter-descriptions. This table then drives a CLIP reward loop that nudges the generator toward the counter cues until the bias is mitigated, yielding de-biased weights that preserve fidelity. By implementing a reward-guided learning mechanism, AutoDebias progressively neutralizes both overt and subtle manifestations of harmful stereotypes across gender, racial, political, and occupational contexts while preserving the model’s generative capabilities and instruction-following performance. To thoroughly evaluate the bias mitigation capabilities of our proposed methods, we subject baseline Text-to-Image (T2I) models to backdoor bias attacks ( Naseh et al. 2024 ) . We significantly expand the experiments, increasing the number of trigger-bias pairs from 8 to 25, incorporating a diverse set of granular concepts, generating 30,000 images made from FLUX to inject Stable-Diffusion-v2.0 ( Rombach et al. 2022 ) . In this paper, we introduce an automated framework for both bias detection and removal, AutoDebias, as shown in Fig. 2 . Under these complex scenarios, our method demonstrates superior performance, effectively reducing harmful bias generation rates into ground, while baseline approaches struggle or fail to achieve significant mitigation. In summary, our main contributions are as follows: • To the best of our knowledge, we propose the first fully automated framework that addresses malicious biases with automated open-set detection. • We present our own pipelines, including open-set detection pipeline with lookup tables and a CLIP-guided alignment mechanism that cyclically remove harmful stereotypes from text-to-image models. • On top of existing backdooring bias injection, we further extend the benchmark of harmful bias attacks with a larger number of granular factors and trigger words, with richer categories and biases compared with previous work, to demonstrate the effectiveness of our methodology on detecting and removing biases from T2I models. 2 Problem Setting Text-to-Image Generation. We define a text-to-image diffusion model as \mathcal{G}_{\theta}:\mathcal{T}\times\mathcal{Z}\rightarrow\mathcal{I} ,

Read the complete text