Does Generation Require Memorization? Creative Diffusion Models using Ambient Diffusion
Kulin Shah, Alkis Kalavasis, Adam R. Klivans, Giannis Daras · 2025
Read Does Generation Require Memorization? Creative Diffusion Models using Ambient Diffusion by Kulin Shah, Alkis Kalavasis, Adam R. Klivans, Giannis Daras (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-21278.txt.
Introduction
Kulin Shah and co-authors ask whether image-making AI must memorize its training pictures to stay creative, in this 2025 paper. Top diffusion models often copy training images, above all when the training set is small. Past fixes for that copying tend to dull image quality. The team looks for a way to keep quality high and copying low at once.
Their theory shows copying is only forced at low noise levels, the stage that adds fine detail. So they train the model on noisy data at large noise scales instead. The change cuts memorization a lot without hurting image quality. It works for text-guided and unguided models, and across varied data supply. The paper offers a principled route to more original generative models.
Catalog record
| CREATOR | Kulin Shah, Alkis Kalavasis, Adam R. Klivans, Giannis Daras |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-21278
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Does Generation Require Memorization? Creative Diffusion Models using Ambient Diffusion Kulin Shah, Alkis Kalavasis, Adam R. Klivans, Giannis Daras Abstract There is strong empirical evidence that the state-of-the-art diffusion modeling paradigm leads to models that memorize the training set, especially when the training set is small. Prior methods to mitigate the memorization problem often lead to a decrease in image quality. Is it possible to obtain strong and creative generative models, i.e., models that achieve high generation quality and low memorization? Despite the current pessimistic landscape of results, we make significant progress in pushing the trade-off between fidelity and memorization. We first provide theoretical evidence that memorization in diffusion models is only necessary for denoising problems at low noise scales (usually used in generating high-frequency details). Using this theoretical insight, we propose a simple, principled method to train the diffusion models using noisy data at large noise scales. We show that our method significantly reduces memorization without decreasing the image quality, for both text-conditional and unconditional models and for a variety of data availability settings. Figure 1 : (FID, Memorization) pairs for different values of \sigma_{t_{\mathrm{n}}} used in our proposed Algorithm 1 (presented in Section 3 ) for training diffusion models from limited data. The standard DDPM objective corresponds to \sigma_{t_{\mathrm{n}}}=0 and it is not in the Pareto frontier. Setting \sigma_{t_{\mathrm{n}}} too low or too high reverts back to the DDPM behavior. Values for \sigma_{t_{\mathrm{n}}}\in[0.4,4] strike different balances between memorization and quality of generated images. The models in this Figure are trained on only 300 images from FFHQ. 1 Introduction Diffusion models [ 58 , 34 , 59 ] have become a widely used framework for unconditional and text-conditional image generation. However, recent works [ 56 , 13 , 24 , 57 , 23 , 50 ] have shown that the trained models memorize the training data and often replicate them at generation time. This issue has raised important privacy and ethical concerns [ 56 , 61 , 2 ] , especially in applications where the training set contains sensitive or copyrighted information [ 15 , 14 ] . [ 13 ] conjectures that the improved performance over alternative frameworks may come from the increased memorization [ 42 ] . This raises the following question: Can we improve the memorization of diffusion models without decreasing the image generation quality? Prior work has shown that the optimal solution to the diffusion objective is a model that merely replicates the training points [ 25 , 53 , 9 , 36 , 8 ] . The experimentally observed creativity in diffusion modeling happens when the models fail to perfectly minimize their training loss [ 36 ] . As the training dataset becomes smaller, overfitting becomes easier, memorization increases and output diversity decreases [ 57 , 24 , 31 ] . Text-conditioning is also known to exacerbate memorization [ 56 , 13 , 57 ] and text-conditional diffusion models are known to memorize individual training points even when trained on billions of image-text pairs [ 13 , 21 ] . Training Image [ 66 ] [ 66 ] + Ours "RISE 24" TriFecta Dishwasher CANYON CARGO - Outdoor shorts - dark moss Western Chief Down Hill Trot (Black) Women’s Rain Boots Figure 2 : Qualitative results for reducing the memorization of Stable Diffusion 2. Combining our method with [ 66 ] helps generate novel samples for the above prompts. See Section 3 for our method and Section 5.2 for more details on the experiment. Related work. Several methods have been proposed to reduce the memorization in diffusion models [ 57 , 24 , 66 , 20 , 39 , 16 , 31 , 49 , 33 , 67 , 45 , 50 , 65 , 70 , 35 ] . A line of work proposes sampling adaptations that guide the generation process away from training points [ 39 , 66 , 16 ] . [ 40 , 63 ] propose decreasing the receptive field of the generative model to avoid memorization. Another line of work corrupts the images [ 24 , 23 ] or the text-embedding in text-conditioned image models [ 57 ] . These methods, while effective in reducing memorization, often decrease the image generation quality. Feldman [ 29 ] theoretically showed strong trade-offs between memorization and generalization by showing that memorization is necessary for (optimal) classification . This raises the natural question of whether this trade-off also applies to generative modeling . Input images \sigma=17 \sigma=8 Outputs of diffusion model trained on 52k images Outputs of diffusion model trained on 300 images Outputs of Ambient Diffusion trained on 300 images Figure 3 : Comparison of denoised images under different noise levels and training conditions. Standard diffusion modeling leads to overconfident predictions (row 3) even for very highly noised inputs when it is trained on small datasets. Our algorithm (row 4), has a similar behavior (blurry outputs) to a model trained with significantly more data (row 1), indicating less memorization. The need for memorization in [ 29 ] is associated with the frequencies of different subpopulations (e.g., cats, dogs, etc.) that appear in the dataset. The key observation is that the distribution of the frequencies is usually heavy-tailed [ 71 ] , i.e., roughly speaking in a dataset of size n , there will be many classes with frequency around 1/n . This means that the training algorithm will only observe a single representative from those subpopulations and cannot distinguish between the following two cases: Case 1. If the unique example comes from an extremely rare subpopulation (with frequency \ll 1/n ), then memorizing it has no significant benefits, and, Case 2. If the unique example comes from a subpopulation with 1/n frequency, then memorizing it will probably improve the accuracy on the entire subpopulation and decrease the generalization error by \Omega(1/n) . Hence, the optimal classifier should memorize these unique examples to avoid paying Case 2 in the error. The key assumption above seems to break when noise is added to the images. That is because different subpopulations start to merge and the heavy-tails of the weights’ distribution disappear. Interestingly, diffusion models learn the (score of the) distribution at different levels of noise. This indicates that, in principle, it is feasible to avoid memorization in the high-noise regime (without sacrificing too much quality). Despite that, regular diffusion model training, e.g., the DDPM [ 34 ] objective, results in score functions that have attractors around the training points, even for highly noisy inputs, as shown in Figure 3 . The discussion above suggests that it should be possible to train high-quality diffusion models that do not memorize in the high-noise part of the diffusion. It has been empirically established that this part controls the structural information of the outputs and hence the diversity of the generated distribution [ 26 , 43 ] . To avoid memorization in the high-noise regime, we propose a simple, principled framework that trains the diffusion model only with noisy data at large noise scales. Our main contributions can be summarized as follows: Our contributions: • We propose a simple framework to train diffusion models that achieve reduced memorization and high-quality sample generation even when trained on limited data.