Diffusion Models Generalize but Not in the Way You Might Think
Tim Kaiser, Markus Kollmann · 2026
Read Diffusion Models Generalize but Not in the Way You Might Think by Tim Kaiser, Markus Kollmann (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13419.txt.
Introduction
Tim Kaiser and Markus Kollmann study structural memorization in diffusion models. An optimal diffusion model would fully memorize its training data and fail to generalize, a paradox. The team shows that models progressively overfit the denoising objective, with a gap at intermediate noise levels. In an analytic 2D toy model, the gap traces to model error plus the density of the data support. Model error blocks exact recall of training points, which yields a smooth, generalizing flow field. Inference paths show a distinct feature-space regime as training goes on.
Catalog record
| CREATOR | Tim Kaiser, Markus Kollmann |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49040 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.13419
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Diffusion Models Generalize but Not in the Way You Might Think Tim Kaiser, Markus Kollmann Abstract Standard evaluation metrics suggest that Denoising Diffusion Models based on U-Net or Transformer architectures generalize well in practice. However, as it can be shown that an optimal Diffusion Model fully memorizes the training data, the model error determines generalization. Here, we show that although sufficiently large denoiser models show increasing memorization of the training set with increasing training time, the resulting denoising trajectories do not follow this trend. Our experiments indicate that the reason for this observation is rooted in the fact that overfitting occurs at intermediate noise levels, but the distribution of noisy training data at these noise levels has little overlap with denoising trajectories during inference. To gain more insight, we make use of a 2D toy diffusion model to show that overfitting at intermediate noise levels is largely determined by model error and the density of the data support. While the optimal denoising flow field localizes sharply around training samples, sufficient model error or dense support on the data manifold suppresses exact recall, yielding a smooth, generalizing flow field. To further support our results, we investigate how several factors, such as training time, model size, dataset size, condition granularity, and diffusion guidance, influence generalization behavior. 1 Introduction The goal of generative modeling is to sample from an unknown data distribution, given a finite subset of samples from it. Diffusion models have demonstrated a remarkable ability to synthesize novel samples across a range of data modalities, including images [ 51 , 26 , 35 , 37 , 55 , 38 ] , video [ 27 , 60 , 6 , 23 , 43 ] , text [ 46 , 61 , 44 , 63 ] , and audio [ 39 , 31 , 30 , 41 ] . At the same time, they are known to occasionally replicate training samples [ 9 , 53 , 22 , 47 ] , something particularly problematic for large Text-to-Image models [ 40 ] and critical in, for example, medical applications [ 12 , 16 , 15 ] . In classical Deep Learning, memorizing the training data is not necessarily a concern, as long as the test performance improves alongside it. However, many works have found memorization and generalization to be mutually exclusive for diffusion models [ 64 , 62 , 8 , 21 , 7 ] . Supporting this notion, optimal diffusion models are unable to sample anything other than the training data [ 49 , 2 , 20 ] , raising the question of how diffusion models generalize rather than how they memorize. It is known that smoothing the geometry of the flow field of optimal diffusion enables the generalization of novel samples [ 49 ] and that model regularization, inductive biases, and training dynamics affect the transition between generalization and memorization [ 34 , 50 , 7 ] . Supplementing that, this work provides extensive empirical evidence that there is a strong link between memorization and model error, explains the mechanism behind the transition from memorization to generalization as a function of model error, and shows that regular diffusion inference avoids memorization occuring at intermediate noise levels, thereby preserving generalization. Our main contributions can be summarized as follows: • We identify a substantial gap between the training and validation performance of state-of-the-art diffusion models on the denoising objective model’s are trained on. The gap scales with longer training time, larger model size, and smaller dataset size. The shape of this gap has a characteristic peak at intermediate noise levels and is robust across a variety of model settings. • We demonstrate, using a 2D toy model, that the shape and magnitude of this gap are determined by the geometry of the learned flow field, which depends on the model error and the density of the data distribution’s support. If the model error is small enough and/or the data manifold is sparsely supported, the flow field localizes sharply around individual training samples, leading to a large gap between training and validation performance. If the model error is sufficiently large and/or the data manifold is densely supported, the flow field around the data manifold is significantly smoothed, thereby suppressing the gap. • Lastly, we show that there are qualitative differences in generalization behavior between diffusion training and diffusion inference. Specifically, the aforementioned gap diminishes when we replace the forward noising process of the training objective with random trajectories from regular diffusion inference, stopped at the desired noise level. All code will be released upon publication. 2 Related work Diffusion models were developed in their current form from two different starting points: via variational inference with an objective resembling denoising score matching [ 26 ] , and directly via denoising score matching, applied to stochastic differential equations [ 54 , 55 ] . Several improvements, including architectural advances [ 13 ] , sampling techniques such as guidance [ 13 ] , and latent diffusion [ 48 ] , have established diffusion models as the dominant class of generative models. The present work uses the EDM-framework, which, in both iterations, achieved state-of-the-art performance in the class-conditional setting, owing to a comprehensive suite of analyses and improvements to the training and sampling of diffusion models [ 35 , 37 ] . Understanding generalization in diffusion models. Recently, analytical formulations of optimal diffusion models appeared, showing that they are unable to sample anything but the training data [ 49 , 2 , 20 ] , a stark contrast to the classical view on memorization, where a fully memorizing model can technically still generalize perfectly. This perspective, in light of the manifold hypothesis [ 19 ] , sparked a series of works analyzing the relationship between optimal diffusion and well-generalizing real diffusion models. They establish that the optimal flow field has a sharp geometry around the training samples [ 20 , 59 ] and that smoothing this geometry plays a key role for successful generalization [ 17 , 1 , 49 ] . Another, related perspective, is to consider the sampling process in distinct phases with respect to noise level, typically assigning the strongest memorization behavior to the last phase, as here optimal diffusion collapses onto the data support [ 59 , 5 ] . Next to the mechanism itself, many works have investigated the factors that influence it, most prominently training time [ 7 ] , dataset size [ 24 ] and model complexity, but also found more unexpected factors such as the difference in training loss between models [ 8 ] , the number of noise samples per data sample [ 21 ] and the model condition [ 22 ] . In addition to the explicit configuration of diffusion models, their inductive biases might implicitly promote generalization, akin to the smoothing behavior mentioned above. Works have identified locality [ 42 ] and equivariance [ 34 ] biases from both data statistics and the architecture, a bias towards geometry-adaptive harmonic bases, adapted to the underlying images [ 33 ] , and implicit regularization [ 18 ] as biases with significant influence on the generalization ability of diffusion models. Text-to-Image models. The consequences of memorization in diffusion models are especially