Diffusion Models Preferentially Memorize Prototypical Examples or: Why Does My Diffusion Model Love Slop?
Marta Aparicio Rodriguez, Anastasia Borovykh, Grigorios A. Pavliotis, Daniel J. Korchinski · 2026
Read Diffusion Models Preferentially Memorize Prototypical Examples or: Why Does My Diffusion Model Love Slop? by Marta Aparicio Rodriguez, Anastasia Borovykh, Grigorios A. Pavliotis, Daniel J. Korchinski (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30642.txt.
Introduction
Aparicio and colleagues ask whether diffusion models memorize rare samples first, and answer no. Training diffusion models on strings from a Random Hierarchy Model, they find samples built from common substrings are memorized first, even when every training sample is unique. Deduplication at the sample level therefore gives no privacy guarantee. They predict and then observe delayed memorization for fat-tailed data, amplified when fat tails enter high-level rules. In between, common substrings are learned first and then overproduced, yielding the bland reversion to the mean derided as slop.
Catalog record
| CREATOR | Marta Aparicio Rodriguez, Anastasia Borovykh, Grigorios A. Pavliotis, Daniel J. Korchinski |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58493 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30642
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Diffusion Models Preferentially Memorize Prototypical Examples or: Why Does My Diffusion Model Love Slop? Marta Aparicio Rodriguez, Anastasia Borovykh, Grigorios A. Pavliotis, Daniel J. Korchinski Abstract Generative models have a persistent limitation: their tendency to memorize training data can create legal liabilities and erode creative diversity. Understanding which samples are memorized in whole or in part, and under what conditions, therefore remains an important open problem. Here we answer the question “Are atypical or rare samples memorized first?” in the negative. We train diffusion models on strings generated according to the production rules of the Random Hierarchy Model (RHM), and find that samples composed of common substrings are preferentially memorized. This holds true even if the training data consists of entirely unique samples, indicating that deduplication at the data point level does not provide a meaningful privacy guarantee. Correspondingly we predict, then observe, delayed memorization for fat-tailed datasets (i.e., those with more atypical samples). This effect is amplified when fat-tails are introduced into high-level production rules. These together suggest that dataset diversity , particularly at higher levels of abstraction, plays an important role in staving off memorization. Finally, we identify an intermediate regime of partial memorization in which common substrings are learned first and subsequently overproduced during generation. If training is stopped in this regime, models will exhibit the reversion-to-the-mean blandness often derided as “slop”. 1 Introduction Figure 1 : Are rare data memorized first or last? Data are drawn from distributions, and some data are outliers. For generative models, are such data memorized first? Top left: a data distribution. Top right: competing hypotheses for the effect of rarity on a given datum’s memorization time. Bottom left: distributions with tails characterized by exponent \alpha . Bottom right: interaction of distribution rarity and time to memorization. Generative models are trained with the objective of creating new samples that are consistent with, but not identical to the training data. Over the past years, we have observed incredible success in the generation of different data modalities including text ( 35 ) , image ( 39 ; 38 ) , and video ( 26 ; 6 ) . The creative ability of models to compose new data and expand beyond the training set ( 29 ; 15 ) will determine whether AI becomes a genuine creative partner in our daily lives or remains perpetually dependent on human-generated data ( 52 ; 20 ) . As compared with human output, language models produce text that overuses certain clichés (e.g., “It’s not X, it’s Y”) or syntactic forms ( 44 ) observed in training; we take such distribution shifts towards common motifs as definitional of the often derided AI slop . Complementary to the question of creativity is that of memorization: the degree to which models reproduce, rather than combine, their training data. In practice, memorization has been linked to a range of practical concerns, including copyright and privacy risks or the reproduction of biases present in data ( 10 ; 4 ; 11 ) . These issues can undermine trust in generative models and limit their safe and reliable deployment. In this work, we explore the mechanisms of memorization and in particular seek to resolve competing hypotheses (see first row of Figure 1 ) that have appeared in the literature on how and when memorization arises. Hypothesis 1: outliers are memorized first Once a model has largely achieved generalization, the remaining training loss is dominated by atypical or rare samples. These outliers therefore contribute disproportionately to the loss and, consequently, to the gradient signal used to update the model parameters. Such dynamics have been documented in classification models, where generalization is followed by the memorization of outlier or mislabeled examples ( 18 ; 19 ) . In the context of diffusion models, 36 leveraged the viewpoint of energy-based models to show densely clustered data points can give rise to stable attractors that do not correspond to individual training samples (spurious states), while the isolated data points induce more distinct basins of attraction, and would therefore be easier to memorize. Hypothesis 2: data with common features are memorized first Prior work has shown that duplicated data points tend to be memorized earlier during training ( 31 ; 9 ; 1 ) , likely because repeated exposure reinforces consistent gradient signals during training. At a more fine grained level, frequently occurring features may similarly be memorized more rapidly due to their consistent contribution to the training objective. This could, in turn, reduce the time required to reproduce samples composed predominantly of such features, compared to samples whose features are less common. Hypothesis 3: rarity of samples is irrelevant to memorization time Much of the literature in generative models treats memorization as a dataset-level phenomenon characterized by a global training time. Rather than analyzing when individual samples are memorized, these works identify a critical number of training steps, dataset passes or samples seen, beyond which models begin to reproduce data ( 51 ; 23 ; 5 ; 17 ) . This perspective views memorization primarily as a global phenomenon with samples being memorized approximately synchronously once some threshold is crossed. Disentangling these competing hypotheses is further complicated by the absence of a unified definition and standardized evaluation of memorization ( 41 ) . Often, due to computational constraints, matching generated data to elements in the train set involves finding memorization candidates ( 11 ) or performing evaluations on smaller subsets of the train set ( 1 ) . Moreover, the boundary between memorization and generalization is not always clearly defined, as researchers use metrics that are likely sensitive to properties of the underlying data. For instance, definitions that label a text output as memorized if it reproduces an entire training example or if it matches some fixed minimum number of characters verbatim ( 9 ; 1 ; 34 ) are highly dependent on the text’s length and rarity. Furthermore, the analysis of memorization is complicated by the fact that natural data (images, text) is compositional in nature. Images, for instance, are comprised of objects, and those objects of parts, and so forth. This means that a generative model exhibiting partial memorization could engage in collage, by composing memorized fine-grained features into novel arrangement. However, because reliably identifying and matching such sub-features in natural data is difficult, most existing memorization studies primarily focus on reproduction of entire training examples ( 10 ; 51 ; 11 ) with only a small number of recent works referring to concepts tangential to partial memorization ( 17 ; 13 ) . Here, we address this challenge of distinguishing generalization, partial memorization, and full memorization, by studying the memorization process of diffusion models ( 47 ; 25 ) trained on explicitly hierarchical and compositional synthetic data generated by the Random Hierarchy Model (RHM) ( 8 ) . To address our question of how sample rarity enters into memorization, we consider a recent extension of the RHM ( 7 ) that couples the data generation rules to a power-law probability distribution. By controlling the level of abstraction at which this power-level enters, we can probe for the first time the interaction of rarity and abstraction on memorization and partial memorization. Our findings can be summarized