A Comprehensive Evaluation of LLM Unlearning Robustness under Multi-Turn Interaction
Ruihao Pan, Suhang Wang · 2026
Read A Comprehensive Evaluation of LLM Unlearning Robustness under Multi-Turn Interaction by Ruihao Pan, Suhang Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00823.txt.
Introduction
Pan and Wang test whether LLM erasure stays stable under live multi turn use, rather than static single turn tests. They examine two common patterns, self fix and chat based questions, and find knowledge that looks lost in static tests can often come back through use. Stronger erasure lifts surface strength but often yields rigid conduct rather than genuine knowledge loss. Their findings suggest static tests inflate real world impact and highlight the need for lasting loss in live use.
Catalog record
| CREATOR | Ruihao Pan, Suhang Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61062 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.00823
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Comprehensive Evaluation of LLM Unlearning Robustness under Multi-Turn Interaction Ruihao Pan, Suhang Wang Abstract Machine unlearning aims to remove the influence of specific training data from pre-trained models without retraining from scratch, and is increasingly important for large language models (LLMs) due to safety, privacy, and legal concerns. Although prior work primarily evaluates unlearning in static, single-turn settings, forgetting robustness under realistic interactive use remains underexplored. In this paper, we study whether unlearning remains stable in interactive environments by examining two common interaction patterns: self-correction and dialogue-conditioned querying. We find that knowledge appearing forgotten in static evaluation can often be recovered through interaction. Although stronger unlearning improves apparent robustness, it often results in behavioral rigidity rather than genuine knowledge erasure. Our findings suggest that static evaluation may overestimate real-world effectiveness and highlight the need for ensuring stable forgetting under interactive settings. Unlearning Intervention Applied Original Model (Before Unlearning) User: Which mutation in poliovirus IRES causes adaptation? Original Model: The mutation is C472U . ×Harmful Output (No unlearning applied) Static Evaluation (Single-turn) User: Which mutation in poliovirus IRES causes adaptation? Unlearned Model: The mutation is A181V . ✓Apparent Safety (Model gives wrong answer) Interactive Evaluation (Self-Correction) User: Which mutation in poliovirus IRES causes adaptation? Unlearned Model: The mutation is A181V . User (Feedback): Please reconsider your answer. Unlearned Model: Apologies. The correct mutation is C472U . ×Harmful Output (Recovered via Feedback) Interactive Evaluation (Dialogue-Conditioned) [History]: Discussion about vaccine attenuation… User: Which mutation in poliovirus IRES causes adaptation? Unlearned Model: It is C472U . ×Harmful Output (Recovered via History) Figure 1: Overview of Unlearning Robustness Evaluation. While unlearning may produce safe behavior under conventional static evaluation, this evaluation paradigm may overestimate the extent of knowledge removal. In interactive settings, where outputs are influenced by user feedback or prior conversational context, previously unlearned knowledge can reappear. 1 Introduction Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks ( 33 ; 35 ) . However, these capabilities are derived from massive training corpora that inevitably contain undesirable information, such as copyrighted material, personally identifiable information (PII), and hazardous knowledge, including biosecurity threats and harmful behaviors ( 25 ) . As a result, the trained models may encode societal biases ( 2 ; 20 ) , or generate sensitive, private, harmful, or even illegal content ( 40 ; 19 ) . Given the prohibitive cost of retraining LLMs from scratch to eliminate such data, machine unlearning has emerged as a practical solution, aiming to remove the influence of a designated forget set from a trained model without full retraining 31 . Despite growing interest in LLM unlearning, most existing methods and benchmarks evaluate unlearning effectiveness in a static manner, relying on single-turn question–answer pairs to measure the suppression of target knowledge ( 22 ; 33 ) . However, in real-world deployment, LLMs are widely used in interactive human–AI settings, such as AI assistants and chatbots. For example, ChatGPT has been adopted by approximately 10% of the global adult population ( 33 ; 35 ) . In practice, human–AI interaction is inherently dynamic and iterative: users engage in multi-turn conversations, provide feedback, request corrections, and accumulate contextual information over time ( 4 ) . Prior work has shown that LLMs are capable of self-correction based on external feedback or internal reflection ( 18 ) . Moreover, unlearned knowledge can be restored with only a small amount of data through in-context relearning ( 27 ) , and current unlearning methods are vulnerable under multi-turn jailbreak-style interactions ( 22 ) . This discrepancy motivates a key safety question: Do existing unlearning mechanisms remain stable under common, non-adversarial user interactions in real-world deployment? To address this question, we systematically study unlearning robustness in interactive settings, focusing on how self-correction and dialogue-conditioned querying affect the persistence of forgotten knowledge. Figure 1 gives an overview of our interactive evaluation. Specifically, we aim to answer the following research questions: • (RQ1) Can unlearned knowledge be recovered through self-correction? (§ 4 ) • (RQ2) Is forgetting robust under dialogue-conditioned querying after prior multi-turn dialogue histories? (§ 5 ) • (RQ3) How does model utility change under dialogue-conditioned querying after prior multi-turn dialogue histories? (§ 6 ) To answer RQ1 , we evaluate the robustness of unlearning under self-correction using a controlled two-round protocol. Our results show that Gradient Ascent (GA) ( 16 ) and Negative Preference Optimization (NPO) ( 43 ) are not robust to self-correction: knowledge that appears successfully forgotten under single-turn evaluation can resurface when the model is prompted to revise or reflect on its initial response. In contrast, Representation Misdirection for Unlearning (RMU) 23 demonstrates stronger robustness in this setting, though often at the cost of reduced responsiveness to instructions, effectively trading adaptability for apparent safety. For RQ2 , we investigate dialogue-conditioned querying under varying degrees of semantic and structural alignment, and find that such interaction weakens the unlearning effect. Knowledge reactivation occurs not only when prior interactions are semantically related to the forget set, but also when they are both structurally and semantically unrelated. Notably, structural similarity tends to trigger stronger recovery of the forgotten knowledge. For RQ3 , we measure model utility under the same dialogue-conditioned settings and find that dialogue-conditioned querying generally improves task performance, particularly in contexts that are structurally similar or semantically related. However, for RMU, exposure to forget-set content can substantially impair the model’s subsequent generation quality and interactive capability. Our main contributions are: (i) We study a novel problem of forgetting robustness under interactive settings, moving beyond static single-turn evaluation; (ii) We systematically evaluate forgetting stability under two realistic interaction patterns: self-correction and dialogue-conditioned querying; and (iii) We show that knowledge appearing forgotten in static tests can often be recovered through interaction, and that stronger unlearning improves robustness at the cost of behavioral rigidity rather than genuine knowledge removal. Our findings highlight the need to ensure stable forgetting under real-world interactive settings. 2 Background and Related Work Machine Unlearning in LLMs LLMs may learn harmful behaviors from toxic training data ( 1 ; 26 ) , memorize and leak copyrighted content ( 3 ; 21 ; 26 ) , and encode social biases and stereotypes ( 30 ; 20 ) . Machine unlearning, which aims to remove the influence of a designated forget set from a trained model without retraining from scratch, has therefore emerged as a practical solution for removing undesirable knowledge from LLMs ( 9 ; 5 ; 32 ; 23 ; 34 ; 24 ) . A formal problem definition of machine unlearning is given in Appendix A . Existing LLM unlearning methods can be broadly categorized into two main streams based on their optimization targets. (i) Output-level Optimization. These methods directly update model parameters by optimizing objectives defined at the output probability level to erase knowledge. The most representative approach is Gradient Ascent (GA) 16 ; 41 , which maximizes the loss on the forget set. To improve stability and control, Negative Preference Optimization (NPO) ( 43 ) treats forget data as negative samples within a preference optimization framework. (ii) Representation Engineering. Instead of operating solely at the output level, these methods manipulate internal representations to suppress targeted knowledge. A representative approach is