Automating Evaluation of Diffusion Model Unlearning with (Vision-) Language Model World Knowledge
Scott Mahan, Eric Yeats, Darryl Hannan, Henry Kvinge, Tim Doster, Eric Yeats, Darryl Hannan, Henry Kvinge, Timothy Doster, Scott Mahan · 2025
Read Automating Evaluation of Diffusion Model Unlearning with (Vision-) Language Model World Knowledge by Scott Mahan, Eric Yeats, Darryl Hannan, Henry Kvinge, Tim Doster, Eric Yeats, Darryl Hannan, Henry Kvinge, Timothy Doster, Scott Mahan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-07137.txt.
Introduction
Eric Yeats and co-authors automate the audit of image models that were taught to forget. Unlearning scrubs a concept from a diffusion model cheaply, but proving the scrub worked is slow hand labor. Worse, the scrub can nick nearby concepts that should stay. Their tool asks a vision language model to do the checking.
The tool pulls world knowledge about the target concept, lists neighbors at risk, and crafts sneaky prompts that try to resurrect the banned idea. Tests on popular unlearning methods show the neighbor rankings match real damage well. The sneaky prompts often break the forgetting. The authors offer the tool for deployment checks.
Catalog record
| CREATOR | Scott Mahan, Eric Yeats, Darryl Hannan, Henry Kvinge, Tim Doster, Eric Yeats, Darryl Hannan, Henry Kvinge, Timothy Doster, Scott Mahan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-07137
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Automating Evaluation of Diffusion Model Unlearning with (Vision-) Language Model World Knowledge Scott Mahan, Eric Yeats, Darryl Hannan, Henry Kvinge, Tim Doster, Eric Yeats, Darryl Hannan, Henry Kvinge, Timothy Doster, Scott Mahan Abstract Machine unlearning (MU) is a promising cost-effective method to cleanse undesired information (generated concepts, biases, or patterns) from foundational diffusion models. While MU is orders of magnitude less costly than retraining a diffusion model without the undesired information, it can be challenging and labor-intensive to prove that the information has been fully removed from the model. Moreover, MU can damage diffusion model performance on surrounding concepts that one would like to retain, making it unclear if the diffusion model is still fit for deployment. We introduce autoeval-dmun , an automated tool which leverages (vision-) language models to thoroughly assess unlearning in diffusion models. Given a target concept, autoeval-dmun extracts structured, relevant world knowledge from the language model to identify nearby concepts which are likely damaged by unlearning and to circumvent unlearning with adversarial prompts. We use our automated tool to evaluate popular diffusion model unlearning methods, revealing that language models (1) impose semantic orderings of nearby concepts which correlate well with unlearning damage and (2) effectively circumvent unlearning with synthetic adversarial prompts. Equal contribution 1 Introduction The rapid acceleration of text-to-image diffusion models has opened exciting avenues in generative AI, but it has also brought to light the challenges associated with removing undesired information or biases from these models. Machine unlearning (MU) provides a cost-effective alternative to retraining entire models by selectively erasing specific concepts. However, verifying that an undesired concept has been successfully purged and ensuring that its removal does not inadvertently damage the model’s performance on other, related concepts remains a significant challenge. Figure 1 : autoeval-dmun , our automated diffusion model unlearning tool. Given a target concept, autoeval-dmun leverages (vision-) language models to circumvent unlearning with adversarial prompts and assess unlearning damage with semantically ranked concepts. The ranked concepts and adversarial prompts are fed to a metric recording script, providing thorough insights into unlearning performance for the user’s specific application. In this work we introduce autoeval-dmun , an automated evaluation framework that leverages (vision-) language models (V-LM) to assess the effectiveness of concept unlearning in diffusion models. Our approach is motivated by two key observations. First, the semantic similarity between the target concept and its neighboring concepts plays a crucial role in determining the impact of unlearning: concepts that are more closely related to the target often suffer greater collateral damage. Second, traditional evaluation methods that directly query the model with prompts referencing the target concept can be misleading, as they may not reveal subtle residual knowledge or vulnerabilities arising from oblique references to the target concept. autoeval-dmun systematically generates a range of concepts with varying degrees of similarity to the target. By scoring these concepts using a language model and comparing the outputs of both the original and unlearned diffusion models using a suite of metrics, we are able to quantify the impact of unlearning across the conceptual space. Additionally, our evaluation includes adversarial prompting techniques – such as creative misspellings or oblique references of the target – to simulate user-written jailbreak attacks that rigorously test target concept erasure. In summary, the main contributions of this work are: (1) An end-to-end, automated evaluation pipeline that systematically generates and scores structured world knowledge to assess damage from concept erasure; (2) a red-teaming strategy that simulates user-generated adversarial prompts to rigorously test the unlearning process and safeguard against residual vulnerabilities; (3) empirical evidence that a V-LM’s internal notion of concept similarity aligns strongly with unlearning damage and that popular unlearning methods can be effectively circumvented by V-LM adversarial prompts. 2 Related Works Text-to-Image Generation The last decade has witnessed rapid development in text-to-image generative models, which approximate probability distributions of images conditional on text prompts. Classes of text-to-image generative models include GANs ( Casanova et al. 2021 ; Karras et al. 2019 ; Karras et al. 2021 ; Shaham et al. 2019 ; Reed et al. 2016 ) , autoregressive models ( Ramesh et al. 2021 ; Yu et al. 2022 ) , and diffusion models ( Ho et al. 2020 ; Dockhorn et al. 2022 ; Sohl-Dickstein et al. 2015 ) . Continual improvements on these models ( Lu et al. 2022 ; Nichol and Dhariwal 2021 ; Rombach et al. 2022 ; Song et al. 2020 ; Saharia et al. 2022 ) and the availability of large-scale training datasets ( Changpinyo et al. 2021 ; Schuhmann et al. 2022 ) have led to image generators with the ability to synthesize different concepts and styles. For example, Stable Diffusion ( Rombach et al. 2022 ) attained commercial success after being trained on LAION-5B ( Schuhmann et al. 2022 ) , which contains 5 billion text-image pairs. However, training on a large internet dataset has enabled Stable Diffusion to produce undesirable results. Some examples include copyrighted art or materials ( Carlini et al. 2023 ; Somepalli et al. 2023 ) , unsafe content ( Gandhi et al. 2020 ; Rando et al. 2022 ) , and inappropriate social biases ( Cho et al. 2023 ; Luccioni et al. 2023 ) . These concerns have led to lawsuits in some cases ( Awoyomi 2024 ) . Machine Unlearning Broadly speaking, MU aims to remove the influence on unwanted training data on the model ( Bourtoule et al. 2021 ; Cao and Yang 2015 ) . For generative models, the goal is often to prevent the model from producing a specified output from any possible input ( Liu et al. 2024 ; Liu et al. 2025 ) . Some approaches to this problem operate at the data level, such as data sharding ( Bourtoule et al. 2021 ; Kadhe et al. 2023 ) or influence-based unlearning ( Dai and Gifford 2023 ) . Others attempt to modify the model parameters directly, often via some finetuning process ( Thudi et al. 2022 ; Jang et al. 2022 ; Yao et al. 2025 ; Yu et al. 2023 ) which can include higher-order model information ( Gu et al. 2024 ) or knowledge distillation ( Dong et al. 2024b ; Huang et al. 2024b ; Wang et al. 2023 ) . In the context of image generation, MU is often referred to as concept erasure. We use the terms interchangeably. Some concept erasure methods include finetuning and distillation methods ( Kumari et al. 2023 ; Gandikota et al. 2023 ) , use of auxiliary erasure networks ( Huang et al. 2024a ) , inference-time erasure ( Zhang et al. 2024a ) , and more ( Lu et al. 2024a ; Heng and Soh 2023 ) . A key challenge of MU is its evaluation. How do we know the target knowledge has been removed, and does the model still retain its knowledge we don’t wish to interfere with? Some tools exist, such as jailbreaking methods ( Lu et al. 2024b ; Yang et al. 2024 ; Qu et al. 2023 ; Dong et al. 2024a ) or simply inspecting model outputs. Moreoever, benchmark datasets allow users to compare unlearning methods on a pre-defined, limited list of concepts ( Moon