Backdoor Unlearning Generalization: A Path Toward the Removal of Unknown Triggers in LLMs

Lisa Bouger, Théo Lasnier, Philippe Loubet Moundi, Yannick Teglia, Djamé Seddah · 2026

Read Backdoor Unlearning Generalization: A Path Toward the Removal of Unknown Triggers in LLMs by Lisa Bouger, Théo Lasnier, Philippe Loubet Moundi, Yannick Teglia, Djamé Seddah (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03785.txt.

Description

Bouger and co-authors show that removing one backdoor from a language model can suppress others. Backdoor attacks plant triggers that force adversary-chosen output. Defenses usually fight one backdoor at a time and need to know its trigger. Unknown backdoors leave defenders at a structural disadvantage. Unlearning, though, appears to generalize across backdoors.

Training a model to ignore one trigger also quiets backdoors never targeted. Three model families carry the test, with backdoors planted in pretraining or later tuning. Models are checked after each single removal. A new measure, Cross Activation Shift Distance, gauges gaps between training-induced changes. It helps explain why some removals transfer to other backdoors. The finding opens a fresh defense line. Defenders could plant controlled backdoors, remove them, and let the transfer suppress hidden ones. Safety teams gain leverage they lacked.

Catalog record

CREATORLisa Bouger, Théo Lasnier, Philippe Loubet Moundi, Yannick Teglia, Djamé Seddah
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03785

Browse the full library · About the Tower of Babel