Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusion
Sathwik Karnik, Juyeop Kim, Sanmi Koyejo, Jong-Seok Lee, Somil Bansal · 2026
Read Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusion by Sathwik Karnik, Juyeop Kim, Sanmi Koyejo, Jong-Seok Lee, Somil Bansal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00140.txt.
Introduction
Karnik and colleagues present RADS, an inference-time system that stops text-to-image diffusion models memorising training data without harming image quality or prompt alignment. It treats denoising as a dynamical system and maps the backward reachable tube, the intermediate states bound for memorised samples. Mitigation becomes constrained reinforcement learning, where a policy steers paths away from memorisation with tiny tweaks to caption embeddings. Tests show a better trade-off between diversity, quality and alignment than state-of-the-art baselines, with no changes to the diffusion backbone.
Catalog record
| CREATOR | Sathwik Karnik, Juyeop Kim, Sanmi Koyejo, Jong-Seok Lee, Somil Bansal |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55584 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.00140
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusion Sathwik Karnik, Juyeop Kim, Sanmi Koyejo, Jong-Seok Lee, Somil Bansal Abstract Text-to-image diffusion models often memorize training data, revealing a fundamental failure to generalize beyond the training set. Current mitigation strategies typically sacrifice image quality or prompt alignment to reduce memorization. To address this, we propose R eachability- A ware D iffusion S teering ( rads ), an inference-time framework that prevents memorization while preserving generation fidelity. rads models the diffusion denoising process as a dynamical system and applies concepts from reachability analysis to approximate the “backward reachable tube”—the set of intermediate states that inevitably evolve into memorized samples. We then formulate mitigation as a constrained reinforcement learning (RL) problem, where a policy learns to steer the trajectory away from memorization via minimal perturbations in the caption embedding space. Empirical evaluations show that rads achieves a superior Pareto frontier between generation diversity (SSCD), quality (FID), and alignment (CLIP) compared to state-of-the-art baselines. Crucially, rads provides robust mitigation without modifying the diffusion backbone, offering a plug-and-play solution for safe generation. Our website is available at: https://s-karnik.github.io/rads-memorization-project-page/ . † † affiliationnotice: *Equal Contribution. 1 Introduction Diffusion models have undoubtedly emerged as the dominant paradigm for image generation in recent years ( 16 ; 37 ; 38 ; 11 ; 33 ; 31 ) . However, like other generative models ( 40 ; 4 ; 19 ; 25 ) , diffusion models are susceptible to reproducing training data ( 35 ; 6 ; 41 ) . This phenomenon, namely, memorization , is particularly concerning in the context of text-to-image generation, where natural language prompts can trigger the extraction or faithful reproduction of copyrighted or private images ( 5 ; 21 ) . To address this problem, prior work has proposed a range of mitigation strategies ( 42 ; 32 ; 15 ; 20 ) . Although these methods can reduce direct reproduction of training images, they often do so at the expense of image quality or alignment with the user’s generation intent. This trade-off is illustrated in Figure 1 . Figure 1(a) shows a memorized image generated by Stable Diffusion v1.4 ( 33 ) , alongside outputs produced by representative prior mitigation methods in Figure 1(b) . As shown, some methods reduce memorization but yield low-quality images (Figure 1(b) 4 ). Others preserve visual quality, but fail to capture key semantic details specified in the prompt (Figure 1(b) 2 ; e.g., ‘ Red Sky ’ or ‘ Glossy Cityscape ’ are not clearly reflected in the output). Finally, some approaches do not sufficiently mitigate memorization, instead producing images with high similarity to the training example (Figures 1(b) 1 , 3 ). (a) Memorized (b) Prior work (c) rads (Ours) Figure 1 : rads outperforms prior work. Generated images for the prompt Design Art Beautiful View of Paris Paris Eiffel Towerunder Red Sky Ultra Glossy Cityscape Circle Wall Art . (a) Memorized target image from the training set. (b) Mitigated results produced by prior methods; 1 – 4 correspond to 42 ; 32 ; 15 ; 20 , respectively. (c) Mitigated result produced by rads (ours). Figure 2 : Overview of rads . This diagram illustrates a real example of how rads prevents memorization in the Stable Diffusion v1.4 model, while the baseline (no mitigation) generates an image that closely resembles the training sample. rads does so by modeling the “attraction basin” of memorization as a backward reachable tube (BRT) and learning a policy \pi_{\phi} for steering the caption embedding inputs to the diffusion model using reachability-constrained reinforcement learning. These limitations raise a fundamental question: how can we mitigate memorization without sacrificing image quality or alignment with the generation intent? To answer this question, we introduce Reachability-Aware Diffusion Steering ( rads ), an inference-time framework to actively predict and prevent memorization (see Figure 2 ). Our core technique is reachability analysis ( 1 ) , a method from control theory traditionally used to ensure safety in autonomous systems by identifying a system’s “failure set.” Reachability analysis characterizes the “backward reachable tube” (BRT)—the set of all intermediate states from which a system will inevitably evolve into that failure set under its natural dynamics. We adapt this concept to diffusion models by modeling the denoising process as a controlled dynamical system, where the latent noise represents the system state and the perturbed caption embeddings act as the control input. By computing the BRT, we can identify the specific regions of the latent space where the denoising trajectory will inevitably collapse into a memorized image. Building on this characterization, we formulate memorization mitigation as a constrained reinforcement learning (RL) problem. In this framework, the RL policy aims to maximize a reward signal based on prompt fidelity and perceptual quality, while being constrained to avoid states within the BRT. By solving this constrained optimization at inference-time, rads learns to steer the diffusion trajectory away from memorization-inducing regions via perturbations in the caption embedding space. To the best of our knowledge, rads is the first framework to combine reachability analysis and RL to steer diffusion models away from memorization basins while preserving semantic alignment. To summarize, our contributions are: (1) a reachability-theoretic formulation of the diffusion denoising process, modeling the latent states and caption embeddings as a controlled dynamical system; (2) a reachability-constrained RL algorithm for inference-time steering that learns to prevent memorization; (3) comprehensive experiments across multiple open-source diffusion models and datasets, demonstrating that rads achieves a superior Pareto frontier between generation diversity, perceptual quality, and prompt alignment compared to existing state-of-the-art baselines. 2 Related Work Mitigating Memorization. Prior work primarily addresses memorization through heuristic interventions on prompts or attention mechanisms. 36 propose perturbing input prompts with random tokens to disrupt retrieval. Others focus on the diffusion architecture itself: 32 and 15 mitigate memorization by masking cross-attention scores or disabling specific neurons responsible for reproducing training data. More recently, methods utilizing the classifier-free guidance magnitude have emerged; 42 replace tokens that trigger high guidance norms, while 20 truncate guidance entirely when an “attraction basin” is detected. Unlike these methods, which rely on discrete, heuristic-driven interventions that often disrupt the generation process, rads provides a principled, continuous control framework. By modeling the denoising path as a controllable trajectory, we can steer away from memorization with minimal impact on the overall image structure. Model Unlearning vs. Inference Steering. A distinct class of mitigation involves permanently modifying model weights to “unlearn” concepts. Techniques such as Erasing Stable Diffusion ( 12 ) or LoRA-based unlearning adapters ( 24 ; 27 ) fine-tune the backbone to suppress specific targets. However, memorization often does not align with fixed, high-level concepts; it frequently involves the replication of idiosyncratic training instances that are difficult to define as a distinct “concept” for unlearning. Furthermore, these methods are destructive —often degrading general capabilities via catastrophic forgetting—and require retraining for every new concept of prompts leading to memorization. In contrast, rads steers away from memorization attraction basins regardless of the specific content, enabling robust mitigation without defining semantic targets or modifying weights. Reachability in Safety-Critical Systems. We adapt reachability analysis ( 2 ) to diffusion models. Building on prior work applying latent reachability to large language models ( 22