Deeper Diffusion Models Amplify Bias

Shahin Hakemi, Naveed Akhtar, Ghulam Mubashar Hassan, Ajmal Mian · 2025

Read Deeper Diffusion Models Amplify Bias by Shahin Hakemi, Naveed Akhtar, Ghulam Mubashar Hassan, Ajmal Mian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17560.txt.

Introduction

Shahin Hakemi and three co-authors show that deeper image generators can worsen bias in a 2025 paper. Diffusion models make striking images, yet their inner workings stay poorly understood. Bias in training data is one worry that depth might quietly magnify.

The authors build a systematic account of the bias and variance trade-off in these models. At one extreme the model memorizes training samples, threatening privacy. At the other it generalizes, and beyond that point bias amplification appears. Claims are backed by both proofs and experiments. Their lens extends the usual memorization-versus-generalization story with a third region. Practitioners tuning model depth get a warning: extra layers can entrench the data's unfair patterns rather than smooth them out.

Catalog record

CREATORShahin Hakemi, Naveed Akhtar, Ghulam Mubashar Hassan, Ajmal Mian
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-17560

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Deeper Diffusion Models Amplify Bias Shahin Hakemi, Naveed Akhtar, Ghulam Mubashar Hassan, Ajmal Mian Abstract Despite the impressive performance of generative Diffusion Models (DMs), their internal working is still not well understood, which is potentially problematic. This paper focuses on exploring the important notion of bias-variance tradeoff in diffusion models. Providing a systematic foundation for this exploration, it establishes that at one extreme the diffusion models may amplify the inherent bias in the training data and, on the other, they may compromise the presumed privacy of the training samples. Our exploration aligns with the memorization-generalization understanding of the generative models, but it also expands further along this spectrum beyond “generalization”, revealing the risk of bias amplification in deeper models. Building on the insights, we also introduce a training-free method to improve output quality in text-to-image and image-to-image generation. By progressively encouraging temporary high variance in the generation process with partial bypassing of the mid-block’s contribution in the denoising process of DMs, our method consistently improves generative image quality with zero training cost. Our claims are validated both theoretically and empirically. Figure 1: Deeper DMs tend to generate samples of majority classes more than shallow models. Unconditional DMs with different depths are trained on CelebA [ 20 ] that contains “blond male” group and “male” class as minorities (less than 1% and 41.68%, respectively). Starting from the same seeds on which shallow models generate samples of the minority, deeper models generate samples of the majority. (Left) Instead of “blond male”, deeper models generate “non-blond male” and “blond female”. (Right) Deeper models generate samples of the majority class “female”. 1 Introduction Diffusion Models (DMs) show unprecedented performance in generating hyper-realistic and diverse synthetic images [ 5 , 8 , 22 ] . Although they have seen rapid empirical progress and widespread adoption in various applications [ 19 , 12 , 18 , 30 , 28 ] , their underlying mechanisms and inference dynamics remain comparatively underexplored from a theoretical perspective. This growing gap between practical performance and foundational insight highlights the need for deeper analytical study which could accelerate the costly training process by diminishing the need for trial and error, and could possibly address bias and privacy concerns. In this work, we explore the traditional concept of bias-variance tradeoff [ 10 ] in the scope of DMs. Intuitively, our definition of this tradeoff in DMs is roughly analogous to the bias-variance tradeoff in k -Nearest Neighbors ( k -NNs). We conceptualize the training of DMs as implicit memorization of the training data, as opposed to explicit storing of training samples in k -NNs. We show that higher levels of abstraction in the encoding process of DMs is equivalent to larger k values in k -NN. So, extremely low abstraction level leads to “high variance” and extensively high abstraction level results in “high bias”. We think of the denoising process of DMs as memory retrieval [ 11 ] , which enables us to set a clear analogy between the way k -NNs and DMs treat the training data. Relevant to our exploration, the concepts of memorization and generalization are also previously studied in the context of DMs [ 32 , 16 , 17 , 25 ] . Connecting our analysis to those studies, the established concept of “memorization” falls close to “high variance” in our work, while “generalization” falls somewhere between the two extremes of “high variance” and “high bias”. Consequently, our perspective enables more comprehensive insights, naturally revealing that “memorization” and “generalization” are not the ultimate extremes, issuing the caution about going far in the direction of “generalization” that can lead to “high bias” in the models. Based on the memory-like interpretation of DMs and our bias-variance tradeoff explanation, we are also able to demonstrate a training-free method to enhance the visual quality of images generated by the DMs. The crux of our method lies in encouraging the exploitation of high-variance choices during inference by letting the generative process have more direct access to multiple local minima in the energy landscape. This can be achieved in a training-free manner by partially bypassing the mid-block in the denoiser. We demonstrate a consistent image quality improvement by our method. Figure 2: Illustration of the key concepts. (A) Comparison of how Associative Memory (AM), k -NNs, and DMs store and attend to the training data. In AMs and k -NNs, data is stored explicitly, as opposed to implicit storing in DMs. Corrupted signals (noise) in DMs converge to attractors like AMs. However, in DMs there is no guarantee to converge to a memory, but the attractors are potentially superpositions of memories . Like k -NNs, DMs attend to a number of training samples during inference. (B) Top: For smoother energy landscapes, initial corrupted signals tend to attend to a larger number of memories (High Bias), which leads to amplification of the inherent dataset bias. We show actual bias amplification of absolute 12.82% in CelebA [ 20 ] model. This leads to more frequent generation of the majority class. E.g., “Non-Blond Male” and “Female” are more frequently generated for CelebA by deeper models, which naturally inherit higher bias as per our analysis. Bottom: For less smooth energy landscapes, initial corrupted signals are likely to attend to a smaller number of memories (High Variance). High variance restricts initial corrupted signals to converge to attractors corresponding to a small number of memories, leading to non-diverse generation, potentially revealing training data that is private. We show examples generated by the prompts “An actor" and “An actress". Starting from the same gaussian seed we gradually push SD V1.5 [ 23 ] to higher variance state during the inference. Both cases eventually converge to the same/similar person. (C) Our explanation of “bias-variance tradeoff” for DMs covers the contrasting concepts of “memorization” and “generalization”. However, it establishes a more complete perspective beyond “generalization”. It captures the risk of falling into “high bias” state by getting too far from “memorization”. The key contributions of this paper are: • We systematically explore the bias-variance tradeoff and its implications in the context of DMs. • We establish that the abstraction level of DM directly impacts bias-variance tradeoff, as extensively abstracted representation leads to exacerbation of bias, and conversely, low abstraction level can undermine the presumed privacy of DMs. • Leveraging insights from our analysis, we propose a training-free method to improve image generation quality for DMs. We extensively evaluate our findings and proposed approach. 2 Diffusion Models as Implicit Memory Modules To facilitate our “bias-variance tradeoff” explanation, first we need to conceptualize the generative process of DMs as a “memory recall” task. As confirmed in [ 2 ] , DMs can memorize specific training samples and output them during generation. They implicitly store data in latent representations, enabling lossy recall via iterative refinement. This perspective emphasizes the role of the model’s learned score function as implicitly encoding a memory retrieval mechanism. To further explain the memory retrieval behavior, we employ the analogy between energy-based Associative Memories (AMs) [ 14 ] and DMs, inspired by [ 11 ] . Under this perspective, we view the latent space of DMs as an energy landscape, in which high energy corresponds to noisy signals and low energy represents

Read the complete text