Backdoor Unlearning Generalization: A Path Toward the Removal of Unknown Triggers in LLMs
Lisa Bouger, Théo Lasnier, Philippe Loubet Moundi, Yannick Teglia, Djamé Seddah · 2026
Read Backdoor Unlearning Generalization: A Path Toward the Removal of Unknown Triggers in LLMs by Lisa Bouger, Théo Lasnier, Philippe Loubet Moundi, Yannick Teglia, Djamé Seddah (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03785.txt.
Description
Bouger and co-authors show that removing one backdoor from a language model can suppress others. Backdoor attacks plant triggers that force adversary-chosen output. Defenses usually fight one backdoor at a time and need to know its trigger. Unknown backdoors leave defenders at a structural disadvantage. Unlearning, though, appears to generalize across backdoors.
Training a model to ignore one trigger also quiets backdoors never targeted. Three model families carry the test, with backdoors planted in pretraining or later tuning. Models are checked after each single removal. A new measure, Cross Activation Shift Distance, gauges gaps between training-induced changes. It helps explain why some removals transfer to other backdoors. The finding opens a fresh defense line. Defenders could plant controlled backdoors, remove them, and let the transfer suppress hidden ones. Safety teams gain leverage they lacked.
Catalog record
| CREATOR | Lisa Bouger, Théo Lasnier, Philippe Loubet Moundi, Yannick Teglia, Djamé Seddah |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.03785