Identifying Memorization of Diffusion Models through p p -Laplace Analysis
Jonathan Brokman, Amit Giloni, Omer Hofman, Roman Vainshtein, Hisashi Kojima, Guy Gilboa · 2025
Read Identifying Memorization of Diffusion Models through p p -Laplace Analysis by Jonathan Brokman, Amit Giloni, Omer Hofman, Roman Vainshtein, Hisashi Kojima, Guy Gilboa (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08246.txt.
Introduction
Brokman and co-authors find a 2025 way to tell whether an image model has memorized its training pictures. Such copying is a legal and privacy risk, yet hard to prove. Their trick reads the model's learned score, a map of where data is dense, and builds a higher-order measure from it, called a p-Laplace operator.
They prove error bounds for the measure and test it on neat mixtures of data shapes. It then worked, for the first time, on text-driven image models, spotting copied items among hundreds of prompts even when the prompt text was gone. Post-hoc checks of this kind need no access to the training set.
Catalog record
| CREATOR | Jonathan Brokman, Amit Giloni, Omer Hofman, Roman Vainshtein, Hisashi Kojima, Guy Gilboa |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08246
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Identifying Memorization of Diffusion Models through p p -Laplace Analysis Jonathan Brokman, Amit Giloni, Omer Hofman, Roman Vainshtein, Hisashi Kojima, Guy Gilboa Abstract Diffusion models, today’s leading image generative models, estimate the score function, i.e. the gradient of the log probability of (perturbed) data samples, without direct access to the underlying probability distribution. This work investigates whether the estimated score function can be leveraged to compute higher-order differentials, namely p-Laplace operators. We show here these operators can be employed to identify memorized training data. We propose a numerical p-Laplace approximation based on the learned score functions, showing its effectiveness in identifying key features of the probability landscape. We analyze the structured case of Gaussian mixture models, and demonstrate the results carry-over to image generative models, where memorization identification based on the p-Laplace operator is performed for the first time. 1 Introduction Memorization in generative models occurs when the model produces outputs that closely replicate samples from its training data, rather than generating novel content. This issue is notably present even in contemporary popular diffusion models. This highlights important questions about generalization, and also raises privacy concerns in generative AI, as it can lead to the unintended leakage of sensitive training data [ 22 ] , [ 32 ] . A key aspect of memorization lies in its relationship with the probability density of data points. Research findings often link memorization to “bumps” or “delta regions” in the learned data distribution. These bumps may arise in sparsely populated areas of the training dataset due to limited data size. They also occur in inherently low-probability regions (of valid data samples), or result from unintended amplification of probability mass around replicated samples within the training set [ 17 ] , [ 10 ] , [ 23 ] . The p -Laplace is a fundamental differential operator which can be used to quantify degrees of smoothness (also in high dimensions, as desired for our case). We outline below some of its essential properties. Recall the discrete Hilbert space \mathbb{R}^{d} with standard discrete Euclidean inner product and norm definitions, i.e. \langle u,v\rangle=\sum_{i}u_{i}\cdot v_{i} and \norm{u}^{2}=\langle u,u\rangle , respectively. The p -Dirichlet energy for a function u:\mathbb{R}^{d}\rightarrow\mathbb{R} is defined by, \begin{split}J_{p}(u):=&\frac{1}{p}\langle\absolutevalue{\nabla u}^{p},1\rangle=\frac{1}{p}\langle\absolutevalue{\nabla u}^{p-2}\nabla u,\nabla u\rangle=\frac{1}{p}\langle-\textrm{div}\left(\absolutevalue{\nabla u}^{p-2}\nabla u\right),u\rangle\\ =&\frac{1}{p}\langle-\Delta_{p}u,u\rangle,\end{split} (1) where \Delta_{p}u is the p -Laplace operator defined as \Delta_{p}u:=\nabla\cdot\left(\absolutevalue{\nabla u}^{p-2}\nabla u\right), (2) \nabla\cdot and \nabla are the discrete divergence and gradient operators respectively, and \left|\nabla u\right|^{p-2}=\left[\left(\frac{\partial u}{\partial x(1)}\right)^{2}+\cdots+\left(\frac{\partial u}{\partial x(d)}\right)^{2}\right]^{\frac{p-2}{2}} . We note that -\Delta_{p} is a positive semi-definite operator and that J_{p}(u)\geq 0,\,\forall u . The p -Laplace is p-1 homogeneous i.e. \Delta_{p}(a\cdot u)=a\absolutevalue{a}^{p-2}\cdot\Delta_{p}(u),\quad\forall a\in\mathbb{R}. (3) We focus on function analysis via the p -Laplace and its ability to reliably characterize important phenomena. We investigate the ability to use the p -Laplace to characterize memorized samples in diffusion models. In this setting, the probability distribution is that of natural image data, which is unknown. To address this challenge we propose to capture the “probability bump” around memorized samples using p -Laplace approximations, a technique not yet explored. This leads us to several fundamental questions: • How can we estimate the p -Laplace operator in the settings of diffusion models? • What estimation techniques and values of p are best suited for practical applications? • Can the p -Laplace operator effectively characterize points of memorization? Our findings outline both recommended and less desired approaches for this task, thereby advancing the research on the geometry of the implicitly learned probability function in diffusion models. Furthermore, we provide a novel mathematical perspective that supports the concept of a ‘‘bumpy probability’’ around memorized samples. 1 1 1 Official implementation: https://github.com/JonathanBrok/Identifying-Memorization-of-Diffusion-Models-through-p-Laplace-Analysis/ 2 Previous Work Memorization is a well-researched phenomenon. [ 17 ] provided theory for long-tailed distributions, claiming that memorizing rare samples from low-probability regions enhances generalization. [ 18 ] further showed that neural networks allocate probability mass to these sparse instances. [ 23 ] observed that limited data for diffusion model training causes memorization, and analyzed the generalization that occurs as the data increases in size. An alternative research branch, such as [ 10 ] and [ 32 ] , focused on data replication in diffusion model training sets and its effect of memorization amplification. Effective uses of the p -Laplace in image processing is demonstrated in [ 4 , 11 , 12 , 20 , 27 ] for 1\leq p\leq 2 with p dependent on the smoothness of the image. Properties of the p -Laplace gradient flow in the context of image filtering are discussed in [ 24 , 25 , 34 , 16 ] . For p\to 1 , the energy approaches total-variation and the gradient flow approximates the total variation (TV) flow [ 3 ] . Properties of the graph p -Laplace were analyzed in [ 15 , 19 , 31 , 7 , 35 , 6 ] , showing several data-processing applications, including for message passing in pre-trained image-language models [ 36 ] . Analysis of the operator as p\to\infty was performed in [ 9 , 14 ] . Nonlinear p -Laplace eigenvalue problems and the p -Laplace spectra were investigated in [ 13 , 5 ] . Nonlinear operators and PDEs (Partial Differential Equations) have been studied in contexts related to generative modeling and diffusion processes. For instance, [ 2 ] introduced flow-based generative models for lattice field theory, using PDE frameworks. [ 26 ] extended score-based diffusion models to function spaces, showcasing the flexibility of diffusion models in handling complex data structures and function representations. Recently, [ 8 ] tackled generated versus real image detection using the cross-similarity between predicted noise and signal, which they re-interpreted as a combined criterion of curvature (1-Laplace), gradient, and bias of the noise predictions. To the best of our knowledge, we are the first to estimate the p -Laplace with diffusion models and to use it to characterize the learned probability distribution. Namely, we are the first to leverage p -Laplace for memorization analysis. 3 Method 3.1 Hypothesis: Measuring Memorization with p -Laplace Building upon prior observations that relate memorized samples to “bumps” in the training data distribution, we hypothesize that these memorized samples will manifest as local maxima in the learned (log) probability distribution. The p -Laplace, which quantifies the outward flux of |\nabla u|^{p-2}\nabla u around a point (as elaborated below in Sec. 3.3 ), serves as a tool for this analysis. Typically, around local maxima, the gradient vectors point inward, indicating a negative flux. Therefore, we expect that memorized points will exhibit lower values of the p -Laplace for their learned probabilities. 3.2 Diffusion Model Settings Let us describe basic principals of diffusion models which we will use for our method. Given a dataset X\subset\mathbb{R}^{d} drawn from an unknown distribution, diffusion models learn to approximate the score function s(x):=\nabla\log p(x) , where x is a perturbed data sample with probability density function p(\cdot) . Score function approximation via noise prediction: Diffusion models rely on the result that estimating s(x) is similar to predicting the noise, when x is a noisy data-sample [ 33 ] , [ 29 ] . This connection can be traced back to the theoretical foundations laid out by Miyasawa (1961) [ 28 ] , showing that the minimum mean square