Concept Unlearning via Cross-Attention Activation Projection for Diffusion Models

Saemi Moon, Suhyeon Jun, Seoyeon Lee, Dongwoo Kim, [0.5em] CSE, POSTECH · 2026

Read Concept Unlearning via Cross-Attention Activation Projection for Diffusion Models by Saemi Moon, Suhyeon Jun, Seoyeon Lee, Dongwoo Kim, [0.5em] CSE, POSTECH (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25765.txt.

Introduction

Moon, Jun, Lee and Kim improve concept unlearning in diffusion models beyond fixed text embeddings. Existing closed-form methods use text alone, missing how concepts appear across states and layers. Probing cross-attention activations, they find activation-derived bases beat text-derived bases fivefold on held-out prompts. Their CASE method builds forget and retain subspaces from those activations. Those subspaces define a retain-constrained operator in attention weights, needing no gradient fine-tuning. Across ten concepts in four categories, CASE tops baselines on harmonic-mean score.

Catalog record

CREATORSaemi Moon, Suhyeon Jun, Seoyeon Lee, Dongwoo Kim, [0.5em] CSE, POSTECH
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43574
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25765

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Concept Unlearning via Cross-Attention Activation Projection for Diffusion Models Saemi Moon, Suhyeon Jun, Seoyeon Lee, Dongwoo Kim, [0.5em] CSE, POSTECH Abstract Concept unlearning aims to erase a target concept from a pretrained text-to-image diffusion model without retraining. Closed-form methods are attractive in this setting because they apply a single deterministic edit to the cross-attention weights and add no inference-time cost. Existing closed-form methods, however, represent the target concept through the text encoder’s response to a few short anchor prompts that name it, and paraphrased prompts that evoke the concept without naming it consistently bypass the edit. We argue that the target should instead be represented in the cross-attention activation space. Text embeddings describe the user’s prompt, while cross-attention activations describe what the model is about to render, and the latter generalize to paraphrase the anchor templates do not cover. Building on this observation, we propose 𝙿𝚄𝚁𝙴 \mathtt{PURE} (Projection in U-Net Rendering for Erasure), a closed-form method that builds the forget and retain bases from per-layer cross-attention activations captured along a short denoising trajectory and applies a single linear projector to the cross-attention key and value weights. On a recent holistic concept-unlearning benchmark covering ten concepts across artistic style, intellectual property, celebrity, and NSFW categories, 𝙿𝚄𝚁𝙴 \mathtt{PURE} significantly reduces target leakage under paraphrased and adversarial prompts while preserving retain concepts close to the unedited model, yielding the best overall forget-retain trade-off among evaluated methods. 1 Introduction Text-to-image diffusion models ( 22 ) have become standard tools for synthesizing photorealistic images from natural-language prompts ( 19 ; 23 ; 21 ) . Trained on web-scale data, these models also reproduce content a deployed system should not regenerate, such as copyrighted artistic styles, the likeness of public figures, and unsafe imagery ( 26 ; 20 ; 13 ) . Concept unlearning addresses this gap by editing a pretrained model to suppress target concepts without retraining from scratch ( 6 ; 15 ; 1 ; 29 ) . Figure 1 : Comparison between text and activation bases. Prior closed-form methods build a shared text-space basis from anchor prompt embeddings. \mathtt{PURE} instead captures layer-specific cross-attention activations during denoising and constructs an activation-space basis for each U-Net cross-attention layer. An effective unlearning method must satisfy two requirements at the same time. First, the target concept must no longer appear in generations, even under prompt variations, paraphrases, and adversarial inputs. Second, every other concept the model represents must remain intact, since the vast majority of prompts a deployed model receives are unrelated to the target concept. We refer to the two requirements as forget and retain , and a useful method is one that meets both without trading one against the other. Recent closed-form methods ( 7 ; 1 ) address this trade-off in a single deterministic update without fine-tuning. \mathtt{UCE} redirects the forget concept to a general concept while protecting a retain set. \mathtt{CURE} replaces this redirection with a spectral construction over text-encoder embeddings of anchor prompts, then projects the resulting subspace out of the cross-attention key and value projections. Despite their differences, these methods share one structural choice: the forget basis is built from the text encoder’s response to short anchor prompts such as “ Van Gogh ” or “ a painting by Van Gogh ”. Closed-form erasure is only as robust as the subspace it removes. If a paraphrased prompt expresses the target concept outside the anchor-derived basis, the edit has no mechanism to detect or suppress it at inference time. We hypothesize that constructing the basis from cross-attention activations alleviates this limitation. To compare the two feature spaces, we use the same anchor prompts to build two forget bases: one from text-encoder embeddings and the other from cross-attention activations collected during denoising. For each basis, we apply SVD to the anchor features and train a binary linear classifier using the forget concept as positives and nearby retain concepts as negatives. We then evaluate recall on natural prompts with more diverse phrasings. The text basis achieves substantially lower recall, whereas the activation basis improves recall by roughly fivefold ( Figure 2 ). Text embeddings encode the prompt before denoising, while cross-attention activations reflect how the denoiser uses that prompt under the current latent state and timestep. We therefore expect activation features to better capture the concept evidence actually used during image generation. This motivates Projection in U-Net Rendering for Erasure ( \mathtt{PURE} ), a closed-form unlearning method that builds the forget and retain bases from cross-attention activations rather than text-encoder embeddings ( Figure 1 ). We capture cross-attention activations as the U-Net traces a small number of anchor prompts through a short denoising trajectory, perform a per-layer SVD to obtain forget and retain subspaces, and apply a single linear edit to the cross-attention key and value projections. \mathtt{PURE} inherits the projection-and-cancellation form of \mathtt{CURE} and changes only the basis source and, as a forced consequence, the multiplication side. Across ten concepts from four categories in the Holistic Unlearning Benchmark (HUB) ( 17 ) , we compare \mathtt{PURE} with five representative unlearning baselines. Among closed-form methods, \mathtt{PURE} better balances forgetting and retention. It reduces the target leakage observed in \mathtt{CURE} while avoiding the retention loss caused by more aggressive text-space edits such as \mathtt{UCE} . Furthermore, \mathtt{PURE} achieves the highest within-category retention in \mathtt{Style} , \mathtt{IP} , and \mathtt{Celebrity} categories, and obtains the best harmonic-mean summary of target proportion, retention, attack robustness, and generation quality across all four evaluation categories ( Table 1 ). 2 Related Work Closed-form concept unlearning. A growing line of work edits a text-to-image diffusion model in a single deterministic step, without gradient training ( 18 ; 8 ; 29 ; 5 ) . \mathtt{UCE} ( 7 ) solves for a closed-form update to the cross-attention key and value projections that redirects forget embeddings to a general concept while protecting a retain set. \mathtt{CURE} ( 1 ) replaces anchor-redirection with a spectral construction: it builds a forget basis from text-encoder embeddings of anchor prompts, applies a saturating spectral re-weighting, and projects the resulting subspace out of the same weights. Both build the forget basis in text-embedding space. Our method inherits \mathtt{CURE} ’s projection-and-cancellation structure but moves the SVD from text-embedding space to per-layer cross-attention activation space. Training-based concept unlearning. A complementary line erases concepts by gradient optimization ( 13 ; 10 ; 16 ; 4 ; 31 ; 2 ; 27 ) . \mathtt{ESD} ( 6 ) fine-tunes the U-Net with a CFG-style negative objective. \mathtt{MACE} ( 15 ) pairs a closed-form refinement with per-concept LoRA adapters to scale erasure to many concepts. \mathtt{RECELER} ( 12 ) attaches lightweight eraser modules to the cross-attention layers and trains them with a concept-localized regularizer and adversarial prompt learning. These methods can be effective but require minutes to hours per concept and tuning of learning rate and stopping time. Our method remains closed-form: a per-layer SVD plus a single linear edit, with no learning rate and no auxiliary loss. Robustness and benchmarks. A separate thread evaluates how reliably an erased concept stays erased. Adversarial prompts can recover the target concept from models that pass standard erasure checks. Ring-A-Bell ( 28 ) optimizes a prompt embedding to align with the target’s CLIP representation, while UnlearnDiffAtk

Read the complete text