Fully Unsupervised Self-debiasing of Text-to-Image Diffusion Models

Korada Sri Vardhana, Shrikrishna Lolla, Soma Biswas, [email protected], [email protected] · 2025

Read Fully Unsupervised Self-debiasing of Text-to-Image Diffusion Models by Korada Sri Vardhana, Shrikrishna Lolla, Soma Biswas, [email protected], [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03749.txt.

Introduction

Image generators trained on web-scale data absorb the stereotypes present in that data and reproduce them in their pictures. Korada Sri Vardhana, Shrikrishna Lolla, and Soma Biswas introduce SelfDebias in a 2025 computer vision preprint. Their method reduces biased outputs from text-to-image diffusion models without any human-labelled training data.

SelfDebias works at test time and fits any diffusion model that uses a UNet to predict noise. It finds clusters of meaning inside an image encoder's representation space, then steers generation so the output distribution spreads more evenly across those clusters. No external classifiers or concept-by-concept annotation are needed. Experiments across prompts and model designs show the method generalises to both conditional and unconditional models. It softens demographic stereotypes while keeping images sharp, and it also helps with subtler, abstract biases that are harder to name.

Catalog record

CREATORKorada Sri Vardhana, Shrikrishna Lolla, Soma Biswas, [email protected], [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-03749

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fully Unsupervised Self-debiasing of Text-to-Image Diffusion Models Korada Sri Vardhana, Shrikrishna Lolla, Soma Biswas, [email protected], [email protected] Abstract Text-to-image (T2I) diffusion models have achieved widespread success due to their ability to generate high-resolution, photorealistic images. These models are trained on large-scale datasets, like LAION-5B, often scraped from the internet. However, since this data contains numerous biases, the models inherently learn and reproduce them, resulting in stereotypical outputs. We introduce SelfDebias , a fully unsupervised test-time debiasing method applicable to any diffusion model that uses a UNet as its noise predictor. SelfDebias identifies semantic clusters in an image encoder’s embedding space and uses these clusters to guide the diffusion process during inference, minimizing the KL divergence between the output distribution and the uniform distribution. Unlike supervised approaches, SelfDebias does not require human-annotated datasets or external classifiers trained for each generated concept. Instead, it is designed to automatically identify semantic modes. Extensive experiments show that SelfDebias generalizes across prompts and diffusion model architectures, including both conditional and unconditional models. It not only effectively debiases images along key demographic dimensions while maintaining the visual fidelity of the generated images, but also more abstract concepts for which identifying biases is also challenging. \svgpath ./ 1 Introduction Generative models [ 17 , 10 , 12 ] , particularly T2I models [ 27 ] , have achieved huge success in the past few years due to their ability to generate high-resolution, photorealistic images that align well with human perceptions. These models are often trained on massive datasets [ 31 ] , which are scraped from the internet. Since a significant amount of bias exists in internet-sourced content, these models unintentionally learn such biases. Recent studies [ 36 ] have shown that these biases are not only learned by the models but are also reproduced and sometimes amplified in their outputs. Since diffusion models are now commonly used in real-world systems [ 25 , 28 ] and for data augmentation in downstream tasks [ 38 ] , the bias in the model’s outputs, if left unchecked, can lead to unfair outcomes and significant representational harms [ 23 ] . A natural solution to prevent this bias in the model’s output is to re-train the model on curated unbiased datasets. But this approach suffers from degradation of diversity and visual fidelity [ 25 ] , in addition to the cost required to curate such datasets and retrain the models. As a result, several alternative debiasing strategies have been proposed [ 9 , 23 , 15 , 6 ] . Majority of the existing supervised approaches primarily address societal bias like gender and race, which are well known and can be pre-defined. Thus, these specific biased concepts can be learnt, and further used for debiasing. But, supervised debiasing frameworks are quite restrictive for free-form image generation: (i) Learning each concept separately, usually by generating sufficient number of examples of each using the model can be prohibitively expensive when debiasing along multiple combinations of attributes [ 9 , 23 ] ; (ii) In several scenarios, manually specifying the bias is very difficult, if not impossible. For example, for abstract concepts like a peaceful scenery, concrete concepts like bags, etc., it is not clear what are the biases introduced! Thus, it is imperative to develop unsupervised techniques which can automatically discover the inherent biases and self-correct itself to generate more unbiased outputs. This is an extremely challenging and relatively unexplored direction. Recently, unsupervised frameworks such as TIME [ 22 ] and UCE [ 9 ] have been proposed. However, both methods rely on a predefined list of attributes and their combinations that are intended to be debiased. Unlike TIME, which is restricted to editing attributes with only two categories, UCE enables the simultaneous debiasing of multiple categorical attributes. Consequently, most of our comparisons in this paper are made with UCE. UCE modifies the influence a token exerts along attribute directions in a specified ratio, making prior knowledge of these attributes essential, which may not always hold true in practice. Towards this goal, we propose SelfDebias , a fully unsupervised debiasing framework that operates directly in the semantic latent space ( h -space) of diffusion models. Rather than relying on predefined bias axes, we use the CLIP [ 26 ] image encoder to uncover semantic latent modes of variation through unsupervised clustering of generated image embeddings. These clusters serve as proxy semantic groups, and we guide the generation process to reduce the dominance of any single group. Although we use CLIP in our experiments, any image encoder capable of semantically separating images in its embedding space could be used. This utilization of semantic separability in the embedding space, which is already available, enables us to perform debiasing. The proposed SelfDebias framework has three main modules: (i) semantic projection module: Here, a large batch of images is generated using a conditional diffusion model based on a given prompt. Then a projection network is learnt, which maps the h -space activations from the UNet of these generated images to their semantic image embeddings; The (ii) semantic mode discovery module performs hierarchical clustering to automatically cluster the projected features and discover semantic modes in the representation space; During inference time, the (iii) self-debias module uses these learned modes to perform soft cluster assignment over the projected h -space activations. The KL divergence between the predicted soft cluster distribution and a uniform prior acts as a differentiable surrogate for balancing the concepts. The resulting loss is back-propagated to edit the h -space representations mid-generation, and the updated activations are used in the subsequent denoising steps. This process allows us to apply semantic guidance directly in h -space without modifying the model weights or relying on any external supervision, making our method lightweight and compatible with existing pretrained diffusion models. Terminology. In the LLM literature [ 30 ] , “self-debiasing” often denotes reflective or prompt-based procedures that leverage a model’s own knowledge to critique or revise its outputs . In this paper, by SelfDebias we mean a purely test-time, statistical intervention on hidden activations (the h -space). Crucially, model weights (U-Net, VAE, text encoder) are never updated. Our key contributions are as follows: 1. To the best of our knowledge, SelfDebias is the first fully unsupervised, test-time framework for debiasing diffusion models, without requiring attribute labels, external classifiers, or retraining. 2. We demonstrate that our inference-time intervention-based framework generalizes across different demographic attributes like gender, race, age, etc. without any supervision. 3. We showcase the debiasing capability of SelfDebias in scenarios where the appropriate debiasing axis is unclear or difficult to define, such as abstract prompts, which cannot be handled by supervised techniques. 2 Related Works Diffusion-based models are now the state-of-the-art for high-fidelity image generation. However, a growing body of research has shown that these models are not free from societal biases, like gender-occupation stereotypes, race, and age, [ 1 , 21 , 4 , 32 , 21 ] . The existing debiasing techniques can broadly be categorized into two approaches, namely debiasing with or without requiring retraining. Debiasing with retraining. Many prior works attempt to debias generative models by retraining from scratch, as seen in the progression of Stable Diffusion (e.g., SD 1.5 vs. SD 2.1),

Read the complete text