RUB: Evaluating Residual Knowledge in Unlearned Models
Hao Xuan, Xingyu Li · 2025
Read RUB: Evaluating Residual Knowledge in Unlearned Models by Hao Xuan, Xingyu Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-14798.txt.
Introduction
Hao Xuan and Xingyu Li built a benchmark that stress-tests whether machine unlearning truly erases knowledge in a 2025 paper. Unlearning is sold as privacy protection, yet most checks only confirm the procedure ran. A model can pass those checks while keeping recoverable traces of the erased data.
Their benchmark attacks unlearned models across sorting, image rebuilding, and image generation tasks. A general attack method maps outputs back toward the forgotten content, and older attacks fit the same frame. Top unlearning methods failed under this pressure even when standard checks passed. The authors argue robustness, not procedure, should be the bar. Code and model files will be released with the benchmark.
Catalog record
| CREATOR | Hao Xuan, Xingyu Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-14798
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RUB: Evaluating Residual Knowledge in Unlearned Models Hao Xuan, Xingyu Li Abstract Machine Unlearning (MUL) has emerged as a key mechanism for privacy protection and content regulation, yet current techniques often fail to guarantee the complete removal of sensitive information. While most existing works focus on verifying the execution of unlearning, they overlook the critical question of whether models remain robust against adversarial attempts to recover forgotten knowledge. In this work, we advocate for the principle of Robust Unlearning, which requires models to be both indistinguishable from retrained counterparts and resilient against diverse adversarial threats. To instantiate this principle, we propose a unified benchmark, RUB (Robust Unlearning Benchmark), that systematically evaluates the robustness of unlearning algorithms across classification, image-to-image reconstruction, and text-to-image synthesis. Within this framework, we introduce the Unlearning Mapping Attack (UMA) as a generalizable method to detect residual information, and demonstrate how existing attack strategies can be adapted into this framework as long as they conform to the generic UMA framework. Our experiments across discriminative and generative tasks reveal that state-of-the-art unlearning methods remain vulnerable under these evaluations, even when passing standard verification metrics. By positioning robustness as the central criterion and providing a benchmark for adversarial evaluation, we hope RUB paves the way toward more reliable and secure unlearning practices. The codebase and model checkpoints in RUB will be published. 1 Introduction As deep learning models grow increasingly data-dependent, concerns over privacy and data security have intensified. In response to privacy regulations such as the General Data Protection Regulation (GDPR) [ 26 ] and the California Consumer Privacy Act (CCPA) [ 23 ] , Machine Unlearning (MUL) has emerged as a potential solution to selectively remove specific data from trained models, allowing for the "right to be forgotten." Beyond privacy concerns, content regulation has become another key motivation for machine unlearning [ 17 , 29 ] . To remove impermissible knowledge, such as unlicensed copyrighted material [ 38 ] , malicious information [ 38 ] , or harmful capabilities [ 29 ] from models, machine unlearning ensures that the unlearned models align with ethical and legal standards. To date, MUL techniques have demonstrated strong performance in eliminating the influence of specific data on both privacy-sensitive and content-sensitive tasks [ 35 , 18 , 9 , 32 , 8 , 19 ] . Since MUL handles sensitive data, it is inherently vulnerable to adversarial attacks. Prior research has shown that modifying the unlearning process or manipulating training data, such as injecting noise or backdoors, can undermine its effectiveness [ 33 , 25 , 20 , 40 ] . However, beyond these conventional attacks, a new category of post-unlearning adversarial attacks has emerged, targeting residual information left in unlearned models [ 44 , 34 , 11 , 24 , 39 ] . Though these attacks are particularly designed for diffusion models (DMs) or large language models (LLMs) to fail content erasure, they expose a fundamental vulnerability: unlearned models often retain traces of the forgotten data, which adversarial probes can exploit to resurface unlearned information. In other words, attackers can craft adversarial inputs that recover forgotten knowledge, effectively negating the unlearning process. To evaluate MUL effectiveness and robustness, verification methods typically fall into attack-based empirical evaluation and process-based reproducibility checks. The former tests an unlearned model’s resistance to adversarial threats by either extracting forgotten information [ 5 , 28 , 3 ] or injecting backdoors to deceive the model [ 31 , 7 , 10 ] . The latter, inspired by Proof of Learning (PoL) [ 14 ] , logs the unlearning process, allowing users or auditors to verify whether unlearning was executed [ 40 ] . Despite their usefulness, these methods focus primarily on whether unlearning was performed, rather than ensuring that all traces of the unlearned information have been irreversibly removed. To address this critical gap in MUL, we introduce the first framework, namely Robust Unlearning Benchmark (RUB), that systematically evaluates the robustness of machine unlearning against post-unlearning adversarial information resurface over various computer vision tasks. As demonstrated in Fig. 1 , RUB covers 15 unlearning algorithms, 3 computer vision tasks (i.e. image classification, image-to-image reconstruction, and text-to-image synthesis) over diverse benchmarking datasets, and different post-unlearning adversarial probing methods. At its core, RUB defines a unified protocol for evaluating whether forgotten information can be recovered under attacks. Particularly, we propose a generic Unlearning Mapping Attack (UMA) as a modular adversarial probing tool, and instantiate it across three major task settings. Our benchmark includes multiple evaluation metrics tailored to different tasks and reveals striking differences in the robustness of existing unlearning methods. The benchmarking results on the 15 unlearning methods and our in-depth discussions highlight potential research directions in the future. Our contributions are summarized as follows: Figure 1 : Diagram of our robust unlearning benchmark. RUB covers three common unlearning tasks: classification, image-to-image reconstruction, and text-to-image synthesis, each reflecting distinct unlearning objectives. It supports multiple state-of-the-art unlearning algorithms, task-specific white-box adversarial attack implementations, and appropriate evaluation metrics. Our benchmark provides a unified and extensible framework to assess the robustness of unlearning algorithms against malicious recovery of unlearned information. • We introduce the first benchmark to systematically evaluate unlearning algorithms under post-unlearning adversarial recovery attacks across diverse computer vision tasks. • We have created a unified evaluation protocol and well-structured code-base that supports 15 state-of-the-art unlearning algorithms on post-unlearning adversarial robustness. • We design UMA, a general-purpose adversarial attack that can be instantiated across tasks, providing an empirical verification tool to assess whether unlearning methods completely eliminate residual knowledge. • We have conducted a thorough analysis of various unlearning algorithms in our benchmark, which will inspire researchers to develop more robust unlearning algorithms. 2 Related Work Machine Unlearning. Machine Unlearning [ 2 ] was introduced to remove specific data influences from models for privacy and security. The most straightforward approach, retraining from scratch, has become impractical for large models like LLMs due to their high computational cost. To address this, exact and approximate unlearning are proposed. Exact unlearning [ 8 , 1 ] aims to make an unlearned model indistinguishable from one retrained from scratch without the forgotten data. Given scalability challenges, approximate unlearning offers a more practical alternative by relaxing constraints to improve efficiency while maintaining acceptable performance. First-order methods use Taylor series expansions to update model parameters, while second-order methods incorporate the inverse Hessian matrix for more precise adjustments [ 35 ] . Recently, SalUn [ 4 ] improved stability and accuracy by using a weight saliency map to update parameters at varying rates. Despite these advancements, existing methods remain vulnerable to sophisticated attacks that extract forgotten information, raising critical privacy and security concerns. Attacks to MUL. Machine unlearning is inherently vulnerable to adversarial attacks, as evidenced by prior research on malicious attempts against MUL. For instance, adversarial text prompts and Concept Inversion attacks are particularly investigated to undermine DMs for content erasure [ 44 , 34 , 11 , 24 ] . Targeting more generic unlearning scenarios, [ 25 ] injects targeted noise into forget samples, leading the unlearned model to fail in classification tasks. [ 20 ] induces backdoor behavior in a model through the standard MUL process with selected data. [ 33 , 40