Robust LLM Unlearning Against Relearning Attacks: The Minor Components in Representations Matter
Zeguan Xiao, Xuanzhe Xu, Yun Chen, Yong Wang, Jian Yang, Yanqing Hu, Guanhua Chen · 2026
Read Robust LLM Unlearning Against Relearning Attacks: The Minor Components in Representations Matter by Zeguan Xiao, Xuanzhe Xu, Yun Chen, Yong Wang, Jian Yang, Yanqing Hu, Guanhua Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11685.txt.
Introduction
Xiao and others ask why LLM wiping fails when models relearn wiped facts. Wiping aims to remove set data effects without retrain, serving privacy and safety, yet wiped models rapidly regain facts through re-study. Current methods tune mainly large ways, leaving small ways largely same. During re-study, large-way changes undo easily, letting rapid regain, while small ways hold. Theory ties both findings to the spectral shape of codes. Their Minor Component method targets small ways straight, greatly lifting re-study defense across three sets.
Catalog record
| CREATOR | Zeguan Xiao, Xuanzhe Xu, Yun Chen, Yong Wang, Jian Yang, Yanqing Hu, Guanhua Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74193 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11685
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Robust LLM Unlearning Against Relearning Attacks: The Minor Components in Representations Matter Zeguan Xiao, Xuanzhe Xu, Yun Chen, Yong Wang, Jian Yang, Yanqing Hu, Guanhua Chen Abstract Large language model (LLM) unlearning aims to remove specific data influences from pre-trained model without costly retraining, addressing privacy, copyright, and safety concerns. However, recent studies reveal a critical vulnerability: unlearned models rapidly recover “forgotten” knowledge through relearning attacks. This fragility raises serious security concerns, especially for open-weight models. In this work, we investigate the fundamental mechanism underlying this fragility from a representation geometry perspective. We discover that existing unlearning methods predominantly optimize along dominant components, leaving minor components largely unchanged. Critically, during relearning attacks, the modifications in these dominant components are easily reversed, enabling rapid knowledge recovery, whereas minor components exhibit stronger resistance to such reversal. We further provide a theoretical analysis that explains both observations from the spectral structure of representations. Building on this insight, we propose Minor Component Unlearning (MCU) , a novel unlearning approach that explicitly targets minor components in representations. By concentrating unlearning effects in these inherently robust directions, our method achieves substantially improved resistance to relearning attacks. Extensive experiments on three datasets validate our approach, demonstrating significant improvements over state-of-the-art methods including sharpness-aware minimization. 1 Introduction The rapid advancement of large language models (LLMs) has led to remarkable progress in various domains, from creative writing to code generation ( 12 ) . Meanwhile, open-weight models are being released at an increasing rate, with their capabilities lagging only six to twelve months behind closed-weight frontier models ( 2 ; 24 ) . However, both open and closed models raise serious concerns about privacy violations, copyright infringement, and safety risks ( 20 ; 5 ) . When undesirable data influences are discovered post-deployment, retraining these massive models from scratch is often prohibitively expensive. This motivates the development of LLM unlearning , a post-training strategy that aims to remove specific data influences and suppress associated model capabilities without the need for complete retraining ( 16 ; 20 ; 23 ) . Despite the growing importance of LLM unlearning, several recent studies have identified a critical issue: current unlearning methods lack robustness ( 40 ; 21 ; 14 ; 6 ) . Specifically, unlearned models exhibit a surprising susceptibility to quickly recovering “forgotten” knowledge through relearning attacks ( 21 ; 14 ) . Even more concerning, fine-tuning on benign, unrelated downstream tasks can inadvertently undo the unlearning effects ( 8 ) . For open-weight models, this lack of robustness poses severe security challenges: any downstream actor can easily reverse unlearning through minimal fine-tuning, undermining the intended protections ( 5 ; 31 ) . Recent rigorous evaluations have revealed that state-of-the-art unlearning methods achieve recovery rates exceeding 88% after relearning attacks, demonstrating that they fail to truly remove knowledge from model weights ( 6 ) . Figure 1 : Left: Retraining-on- T (RTT) attack evaluation: the forget set is split into T and V ; after unlearning on T\cup V , the attacker fine-tunes on T and measures recovery on V . Middle: Naive methods and SAM separate forget/retain representations mainly along dominant components ( DC ), which relearning easily reverses; MCU additionally separates them along minor components ( MC ), whose changes are largely preserved post-attack. Right: On WMDP-Cyber, MCU yields markedly lower post-attack accuracy while maintaining utility. Although existing works have proposed various techniques to improve unlearning robustness—such as sharpness-aware minimization (SAM) ( 8 ) for smooth optimization and representation-level interventions ( 19 ; 34 ) —these methods remain largely empirical, and the fundamental mechanism underlying the susceptibility of LLM unlearning to relearning attacks remains poorly understood. We thus ask: (Q) Why is LLM unlearning so fragile against relearning attacks? To address (Q) , we conduct a principled analysis of LLM unlearning through the lens of representation geometry. We discover that existing unlearning methods predominantly optimize along the dominant component directions, leaving minor components largely unchanged. Critically, when relearning attacks are applied, the modifications in these dominant components are easily reversed—with recovery rates significantly exceeding those of minor components—explaining why current methods are so vulnerable to such attacks. We further give a theoretical analysis that derives both phenomena from the spectral structure of representations, identifying the structural source of fragility. Inspired by these findings, we propose Minor Component Unlearning (MCU) , a novel unlearning approach that explicitly targets the minor components of internal representations. By leveraging the observation that minor components are inherently more resistant to recovery during relearning, our method achieves substantially improved robustness against relearning attacks while maintaining model utility on unrelated tasks. We summarize our contributions below. 1 1 1 Our code is publicly available at https://github.com/sustech-nlp/MCU . \bullet We provide the first systematic analysis of LLM unlearning robustness from a representation geometry perspective, supported by a theoretical analysis. We identify a key mechanism underlying unlearning fragility: dominant components modified during unlearning are easily recovered by relearning attacks, whereas minor components exhibit significantly stronger resistance to recovery. \bullet Building on these insights, we propose MCU, a novel unlearning method that explicitly targets minor components of representations. \bullet We conduct extensive experiments on WMDP-Cyber, WMDP-Bio, and Years datasets, demonstrating that our method significantly reduces knowledge recovery after relearning attacks while preserving model utility, outperforming existing methods. Some experiment highlights on WMDP-Cyber dataset are showcased in Figure 1 . 2 Preliminaries of LLM Unlearning Problem Definition. LLM unlearning aims to erase or suppress undesirable knowledge within a pre-trained LLM while preserving its general performance ( 20 ) . Formally, given a pre-trained LLM with parameters \bm{\theta}_{\mathrm{o}} and a dataset partitioned into a forget set \mathcal{D}_{\mathrm{f}}=\{(\mathbf{x}_{i},y_{i})\}_{i=1}^{n_{f}} containing data to be unlearned and a retain set \mathcal{D}_{\mathrm{r}}=\{(\mathbf{x}_{j},y_{j})\}_{j=1}^{n_{r}} containing data the model should still remember, unlearning seeks to obtain updated parameters \bm{\theta}_{\mathrm{u}} such that the model “forgets” information in \mathcal{D}_{\mathrm{f}} while maintaining performance on \mathcal{D}_{\mathrm{r}} . An ideal unlearning method should ensure that the mutual information between the unlearned model weights and the forget set approaches zero, meaning the removed knowledge is truly erased from the model rather than merely hidden ( 6 ) . Unlearning Methods. Let \pi_{\bm{\theta}}(x) denote the probability of text x under model parameters \bm{\theta} . Gradient Ascent (GA) ( 16 ) maximizes the cross-entropy loss on the forget set, while Negative Preference Optimization (NPO) ( 39 ) adapts DPO ( 30 ) by treating \mathcal{D}_{\mathrm{f}} as dispreferred responses: \mathcal{L}_{\text{GA}}=\underset{x\in\mathcal{D}_{\mathrm{f}}}{\mathbb{E}}[\log\pi_{\bm{\theta}}(x)], (1) \mathcal{L}_{\text{NPO}}=-\frac{2}{\beta}\,\underset{x\in\mathcal{D}_{\mathrm{f}}}{\mathbb{E}}\left[\log\sigma\left(-\beta\log\frac{\pi_{\theta}(x)}{\pi_{\text{ref}}(x)}\right)\right], (2) where \pi_{\text{ref}}=\pi_{\bm{\theta}_{\mathrm{o}}} and \beta is a temperature parameter. Representation Misdirection for Unlearning (RMU) ( 19 ) perturbs internal hidden states toward a random control vector, while MLP Breaking ( 34 ) drives MLP outputs toward orthogonality with their originals (motivated by factual knowledge being stored in MLP parameters ( 26 ) ): \mathcal{L}_{\text{RMU}}=\underset{x\in\mathcal{D}_{\mathrm{f}}}{\mathbb{E}}\left[\sum_{t\in x}\|\mathbf{h}(t)-c\cdot\mathbf{u}\|^{2}\right], (3) \mathcal{L}_{\text{MLP Breaking}}=\underset{x\in\mathcal{D}_{\mathrm{f}}}{\mathbb{E}}\left[\sum_{t\in x}\text{ReLU}\left(\frac{\langle\mathbf{h}(t),\mathbf{h}_{\text{o}}(t)\rangle}{\|\mathbf{h}_{\text{o}}(t)\|^{2}}\right)\right]. (4) where \mathbf{h}(t) is the current internal representation of token t (hidden state for RMU, MLP output for MLP Breaking), \mathbf{h}_{\text{o}}(t) is its value under \bm{\theta}_{\mathrm{o}} , c is a scaling hyperparameter, and \mathbf{u} is a random control vector. 3 Understanding Fragile LLM Unlearning In this section, we investigate how unlearning and relearning affect an LLM’s internal representations, and identify a structural cause of fragility: unlearning predominantly modifies the dominant (high-variance) directions of internal representations, which are