Broken Memories : Detecting and Mitigating Memorization in Diffusion Models with Degraded Generations Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 9–13, 2026; Jeju Island, Republic of Korea. Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD 2026), August 9–13, 2026, Jeju Island, Republic of Korea ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3817770 CCS: Computing methodologies Computer vision CCS: Security and privacy

Yuanmin Huang, Mi Zhang, Chen Chen, Feifei Li, Geng Hong, Xiaoyu You, Min Yang · 2026

Read Broken Memories : Detecting and Mitigating Memorization in Diffusion Models with Degraded Generations Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 9–13, 2026; Jeju Island, Republic of Korea. Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD 2026), August 9–13, 2026, Jeju Island, Republic of Korea ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3817770 CCS: Computing methodologies Computer vision CCS: Security and privacy by Yuanmin Huang, Mi Zhang, Chen Chen, Feifei Li, Geng Hong, Xiaoyu You, Min Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22050.txt.

Introduction

Yuanmin Huang and co-authors identify a new signature of memorization in diffusion models: internal instability that surfaces as visibly broken flaws. This poses privacy and copyright risks, yet it was not previously linked to such instability. Inspired by stability analysis, they define empirical stability regions from latent update norms to measure the effect. Their on-the-fly framework then detects and mitigates it step by step, without changing prompts or guidance, keeping meaning and image quality intact. On Stable Diffusion 1.4 it reaches AUC above 0.999 with a 0.0 percent memorization rate.

Catalog record

CREATORYuanmin Huang, Mi Zhang, Chen Chen, Feifei Li, Geng Hong, Xiaoyu You, Min Yang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80764
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.22050

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Broken Memories : Detecting and Mitigating Memorization in Diffusion Models with Degraded Generations Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 9–13, 2026; Jeju Island, Republic of Korea. Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD 2026), August 9–13, 2026, Jeju Island, Republic of Korea ISBN: 979-8-4007-2259-2/2026/08 DOI: 10.1145/3770855.3817770 CCS: Computing methodologies Computer vision CCS: Security and privacy Yuanmin Huang, Mi Zhang, Chen Chen, Feifei Li, Geng Hong, Xiaoyu You, Min Yang Abstract . While diffusion models excel at generating high-quality images, their tendency to memorize training data poses significant privacy and copyright risks. In this work, we for the first time identify that memorization induces internal numerical instability, often manifesting as visually “broken” artifacts. Inspired by stability analysis in numerical methods, we introduce empirical stability regions based on latent update norms to quantitatively characterize stable behavior during generation. Leveraging this, we propose a principled, on-the-fly framework for step-wise detection and adaptive mitigation. Our approach suppresses memorization without altering prompts or guidance, thereby preserving semantic fidelity and image quality. Extensive experiments on Stable Diffusion 1.4 demonstrate that our method achieves an AUC > 0.999 >0.999 detection performance and a 0.0 % 0.0\% memorization rate after mitigation with negligible overhead ( ≈ 0.01 \approx 0.01 s per image). † † cc-license: by 1. Introduction Recent advancements in diffusion models have led to breakthroughs in high-quality image generation, showcasing immense potential in creative arts ( 27 ) . However, as model scales and training data volumes continue to grow, diffusion models increasingly face a critical issue: memorized generation ( 31 ) . It is evident from recent research that diffusion models inadvertently replicate or highly resemble specific images from their training datasets, leading to potential privacy leakage and copyright infringements ( 6 ; 31 ; 10 ) . Figure 1. Memorized generations (blue and orange borders, using PNDM and DDIM) show clear degradation—such as broken details or abnormal intermediate results—compared to non-memorized generations (green border). The yellow shaded regions in both plots indicate the empirical stability regions for latent norm ( \|\mathbf{z}_{t}\| ) and latent update norm ( \|\delta_{t}\| ). Memorized samples consistently deviate from these stability regions during generation, while non-memorized samples stay within them. This motivates our approach: by monitoring and intervening these latent deviations, we can accurately detect and mitigate memorization on the fly. Existing research has investigated memorization from multiple perspectives. Early studies detect it by comparing generated images with training samples ( 31 ) . Later works analyze the internal mechanisms underlying memorization, such as attention weights ( 26 ) or magnitude of conditional guidance directions ( 35 ; 9 ) . To mitigate memorization, these methods propose interventions like modifying prompts ( 31 ) , tuning text embeddings ( 35 ) , initial latents ( 19 ) , or directly adjusting guidance scale ( 18 ) . However, these approaches generally face two major limitations: • Dependence on re-generation: Most existing inference-time methods operate on a detect-then-retry basis. They cannot correct the trajectory seamlessly. Instead, detection triggers an abort, requiring the generation to be restarted with modified inputs, which increases latency and computational cost. • Heuristic or static interventions: Mitigation typically relies on fixed rules or static adjustments to prompts, embeddings, or guidance scales, which compromise semantic fidelity and fail to adapt to the dynamic nature of memorization, leading to over- or under-mitigation. To overcome these limitations, we propose a principled framework for on-the-fly detection and adaptive mitigation of memorization in diffusion models, based on the modeling of empirical stability regions of the generation dynamics. Our method is inspired by a key observation: when generating memorized samples, the PNDM (Pseudo-Numerical methods for Diffusion Models) scheduler ( 22 ) , i.e., the default scheduler of Stable Diffusion v1 ( 27 ) , often produces noticeable visual degradation, such as a “broken” appearance, while non-memorized prompts yield normal generations (see Fig. 1 ). We trace this phenomenon to a fundamental cause: memorization manifests as numerical instability in the latent dynamics . Specifically, we observe that memorization causes anomalous deviations in the latent update per step ( \delta_{t} ) from model’s empirical stable region , which can be estimated from the model’s normal behavior. We further prove that for non-memorized prompts, \delta_{t} remains within this stability region, while for memorized prompts, it exhibits large, erratic fluctuations that lead to unstable denoising trajectories and visible artifacts in generated images. Notably, such instability is not limited to PNDM: with non-numerical schedulers like DDIM ( 32 ) , even when the generated images appear visually plausible, we still observe similar anomalies throughout the generation in the internal latent space. Building on this insight, we propose a high-precision, step-wise detection system that monitors the deviation of \delta_{t} from the empirical stability region at each denoising step. This enables accurate diagnosis of whether the current generation trajectory is tending toward memorization. Detected instabilities trigger an adaptive mitigation strategy that distinguishes between mild and strong memorization: mild cases are regularized early through latent-magnitude constraints, while strong cases require stricter joint constraints on both latent and update norms throughout the trajectory. Both mitigations are performed based on the estimated stability regions from a small set of normal prompts (e.g., 50 generations from LAION-400M ( 28 ) ). The entire process operates on the fly , with no modification to the prompt or guidance, ensuring both semantic fidelity and image quality. Table 1 summarizes representative baseline methods, highlighting that our method uniquely achieves all three capabilities. Our main contributions are summarized as follows: • We present the first systematic analysis linking degraded memorization generation to numerical instability in diffusion sampling, revealing distinctive anomalies in latent updates ( \delta_{t} ) magnitudes. • We introduce the concept of empirical stability regions , grounded in numerical stability theory and extended to broader scenarios, to characterize and diagnose normal versus memorized generation in diffusion models. • We develop an on-the-fly, diagnosis-driven framework that adaptively constrains the generation trajectories only when instability is detected, surpassing existing heuristic or static methods. • Our approach achieves superior detection accuracy (AUC >0.999 ) in identifying memorization and completely eliminates memorized generations ( 0.0\% rate) while preserving high image quality and semantic fidelity, with minimal overhead ( \approx 0.01 s per image). Table 1. Comparison with representative baselines. Our method uniquely achieves both on-the-fly and adaptive mitigation with integrated detection. Method RTA ( 31 ) Wen et al. ( 35 ) Ren et al. ( 26 ) Jeon et al. ( 19 ) Jain et al. ( 18 ) Ours With detection? ✗ ✔ ✔ ✔ ✗ ✔ On-the-fly mitigation? ✗ ✗ ✗ ✗ ✗ ✔ Adaptive mitigation? ✗ ✗ ✗ ✗ ✔ ✔ 2. Related Work 2.1. Memorization Detection in Diffusion Models Recent studies have revealed that diffusion models are prone to memorizing and reproducing training images ( 7 ; 3 ; 23 ; 12 ) . Early detection methods rely on post-hoc comparisons between generated samples and the training set, such as using Euclidean distance ( 6 ) or features extracted by self-supervised copy detection (SSCD) models ( 24 ) . However, these image-level approaches are often confounded by

Read the complete text