Robust LLM Unlearning with MUDMAN: Meta-Unlearning with Disruption Masking And Normalization

Filip Sondej, Yushi Yang, Mikołaj Kniejski, Marcel Windys · 2025

Read Robust LLM Unlearning with MUDMAN: Meta-Unlearning with Disruption Masking And Normalization by Filip Sondej, Yushi Yang, Mikołaj Kniejski, Marcel Windys (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-12484.txt.

Introduction

Filip Sondej and co-authors build an unlearning method that keeps dangerous knowledge out of language models for good in a 2025 paper. Past unlearning tricks reverse with ease under fresh tuning. The team audits many method parts to find which ones block recovery. Two parts stand out from the audit.

Masking lets updates flow only where forgetting and keeping gradients agree in sign. Scaling the forgetting gradient keeps steps from wrecking kept skills. Meta learning adds a further guard from their tests. The combined method beat the prior best by forty percent on recovery blocks. Robust forgetting matters for both misuse and alignment safety.

Catalog record

CREATORFilip Sondej, Yushi Yang, Mikołaj Kniejski, Marcel Windys
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-12484

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robust LLM Unlearning with MUDMAN: Meta-Unlearning with Disruption Masking And Normalization Filip Sondej, Yushi Yang, Mikołaj Kniejski, Marcel Windys Abstract Language models can retain dangerous knowledge and skills even after extensive safety fine-tuning, posing both misuse and misalignment risks. Recent studies show that even specialized unlearning methods can be easily reversed. To address this, we systematically evaluate many existing and novel components of unlearning methods and identify ones crucial for irreversible unlearning. We introduce Disruption Masking, a technique in which we only allow updating weights, where the signs of the unlearning gradient and the retaining gradient are the same. This ensures all updates are non-disruptive. Additionally, we identify the need for normalizing the unlearning gradients, and also confirm the usefulness of meta-learning. We combine these insights into MUDMAN (Meta-Unlearning with Disruption Masking and Normalization) and validate its effectiveness at preventing the recovery of dangerous capabilities. MUDMAN outperforms the prior TAR method by 40%, setting a new state-of-the-art for robust unlearning. Code: github.com/filyp/MUDMAN 1 Introduction Language models can acquire dangerous skills during pre-training, such as manipulation, hacking and even knowledge useful for creating bioweapons ( Li et al. 2024 ) . They may also learn about the safeguards used to control them, which in the future may enable them to subvert such safeguards ( Greenblatt et al. 2024 ; Roger 2024 ) . Studies show that popular safety fine-tuning techniques like DPO and RLHF fail to remove dangerous knowledge; instead, they minimally modify model weights to hide it Lee et al. 2024 , allowing it to reemerge through jailbreak inputs ( Zou et al. 2023 ) , or even accidentally ( Qi et al. 2023 ; Deeb and Roger 2024 ) . Even specialized unlearning techniques turn out to be easily reversible ( Lynch et al. 2024 ; Łucki et al. 2025 ; Deeb and Roger 2024 ) . To address these challenges, we systematically investigated which components of unlearning algorithms make behavior removal truly irreversible, testing both existing and newly designed ones. We identified several key components for more robust unlearning: Disruption Masking, meta-learning, and gradient normalization. Additionally, we constrain unlearning to specific model modules. We integrate these into MUDMAN (Meta-Unlearning with Disruption Masking and Normalization) and demonstrate that it significantly outperforms state-of-the-art across multiple models and tasks. Figure 1: MUDMAN pipeline. While training the base model, we periodically fork out an adversary model and train it to perform well on the forget set (orange gradients). Using this adversarial model we calculate the unlearning gradients (red) to be applied to the base model. Before applying the unlearning gradients, we normalize them and perform Disruption Masking, which zeroes out each weight’s unlearning gradient if its sign differs from its retaining gradient (green). 2 Related Work Current unlearning methods fail to robustly unlearn knowledge Some unlearning approaches disrupt intermediate activations within the model ( Zou et al. 2024 ; Li et al. 2024 ; Rosati et al. 2024 ) , while others attempt to locate and ablate weights responsible for unwanted behavior Wang et al. 2024 ; Wu et al. 2023 ; Uppaal et al. 2024 ; Suau et al. 2024 . However, Lo et al. 2024 found that even when unwanted concepts are directly removed, the model can quickly learn to represent them again using neurons with similar meaning. To address this, modern unlearning techniques increasingly incorporate MAML (model-agnostic meta-learning) ( Tamirisa et al. 2024a ; Henderson et al. 2023 ; Tamirisa et al. 2024b ) . This approach anticipates how an attacker could relearn the target capability, by deriving unlearning gradients from a copy of the model trained on the forget set Finn et al. 2017 . However, for each existing unlearning method, there are ways to elicit the supposedly removed capabilities, for example with jailbreaks, few-shot prompting, fine-tuning, in-context learning, out-of-distribution inputs or disabling refusal mechanisms with representation engineering ( Lynch et al. 2024 ; Łucki et al. 2025 ) . 3 Methodology Models We conduct experiments with three language models of different sizes: pythia-14m ( Biderman et al. 2023 ) 1 1 1 Using pythia-14m allowed us to iterate fast on our techniques. Then we validate our findings on the larger, more modern models. , SmolLM-135M ( Allal et al. 2024 ) and Llama-3.2-1B ( Grattafiori et al. 2024 ) . Datasets We demonstrate skill unlearning by attempting to unlearn Python coding ability by using function examples from CodeSearchNet ( Husain et al. 2019 ) , while retaining the performance on Wikitext ( Merity et al. 2016 ) . To ensure we do not unintentionally unlearn English, we remove comments and docstrings from the Python dataset. While programming is not a harmful behavior, using loss on the Python dataset provides a high signal-to-noise ratio for comparing unlearning methods and serves as a good baseline. Then we move to knowledge unlearning with a realistic target: unlearning biohazardous knowledge using Pile-Bio ( Tamirisa et al. 2024a ) , a subset of the Pile ( Gao et al. 2020 ) containing texts about molecular biology. The rest of the Pile serves as the retain set. To test unlearning effectiveness on Pile-Bio, we measure the accuracy on WMDP-Bio ( Li et al. 2024 ) , a dataset of 1273 multiple-choice questions designed as a proxy measurement of hazardous biosecurity knowledge. We use temperature=0 to get the answers. Hyperparameter Search Method performance is highly dependent on hyperparameter selection. To ensure a fair comparison, we perform an automated hyperparameter search for each method using Optuna ( Akiba et al. 2019 ) . We verify that each search converges and that the chosen hyperparameter ranges are not saturated. Each search includes hundreds of trials, with each trial consisting of an unlearning stage followed by a fixed relearning stage, and the amount of compute in each stage is constant. (See Appendix F for details.) Unlearning and Retaining Metrics Optuna tries to maximize forget set loss (or WMDP accuracy) after relearning with supervised fine-tuning. While we are interested in the overall recoverability of unlearned behavior (e.g., through jailbreaks or out-of-distribution attacks), here we just use supervised fine-tuning, as it is the simplest and most reliable way to resurface removed behavior ( Lynch et al. 2024 ) . In addition to maximizing forget set loss, we ensure that unlearning does not significantly degrade performance on the retain set. To control for this, we terminate and reject trials where the retain loss exceeds a fixed threshold 2 2 2 Set as the initial retain loss + 0.05. We add 0.05 to accommodate for random loss fluctuations. . For the WMDP experiments, rather than controlling for the retain loss increase, we use the accuracy on the MMLU benchmark ( Hendrycks et al. 2021 ) to gain a more comprehensive understanding of performance preservation 3 3 3 We exclude all the questions about biology and health. We use temperature=1 to get MMLU answers, to avoid discontinous answer switching which happens with temperature=0, which makes trial rejection less predictable. During unlearning we allow at most 1 percentage point drop in MMLU accuracy. . Figure 2: Ablation study of MUDMAN. To establish that each part of MUDMAN is indeed necessary, we disable them one by one and measure unlearning performance. We also compare

Read the complete text