Robust Backdoor Removal by Reconstructing Trigger-Activated Changes in Latent Representation

Kazuki Iwahana, Yusuke Yamasaki, Akira Ito, Takayuki Miura & Toshiki Shibahara · 2025

Read Robust Backdoor Removal by Reconstructing Trigger-Activated Changes in Latent Representation by Kazuki Iwahana, Yusuke Yamasaki, Akira Ito, Takayuki Miura & Toshiki Shibahara (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08944.txt.

Introduction

Kazuki Iwahana and four co-authors scrub backdoors out of trained neural networks. A backdoored model behaves normally until a trigger pattern appears, then it misclassifies on cue. Defenses usually hunt the responsible neurons by measuring trigger-activated changes, the activation gap between clean and poisoned inputs.

Those gap estimates are imprecise, so the wrong neurons get cut. The new method reconstructs the gap in latent space by solving for the smallest perturbation that forces clean data into a chosen class, an optimization with a clean convex form. The poisoned class reveals itself through suspiciously small perturbation norms. Fine-tuning with that class's perturbation then removes the backdoor. On CIFAR-10, GTSRB, and TinyImageNet the method suppresses backdoors across attack types and architectures while keeping clean accuracy high, beating existing defenses.

Catalog record

CREATORKazuki Iwahana, Yusuke Yamasaki, Akira Ito, Takayuki Miura & Toshiki Shibahara
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08944

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robust Backdoor Removal by Reconstructing Trigger-Activated Changes in Latent Representation Kazuki Iwahana, Yusuke Yamasaki, Akira Ito, Takayuki Miura & Toshiki Shibahara Abstract Backdoor attacks pose a critical threat to machine learning models, causing them to behave normally on clean data but misclassify poisoned data into a poisoned class. Existing defenses often attempt to identify and remove backdoor neurons based on Trigger-Activated Changes (TAC) which is the activation differences between clean and poisoned data. These methods suffer from low precision in identifying true backdoor neurons due to inaccurate estimation of TAC values. In this work, we propose a novel backdoor removal method by accurately reconstructing TAC values in the latent representation. Specifically, we formulate the minimal perturbation that forces clean data to be classified into a specific class as a convex quadratic optimization problem, whose optimal solution serves as a surrogate for TAC. We then identify the poisoned class by detecting statistically small L 2 L^{2} norms of perturbations and leverage the perturbation of the poisoned class in fine-tuning to remove backdoors. Experiments on CIFAR-10, GTSRB, and TinyImageNet demonstrated that our approach consistently achieves superior backdoor suppression with high clean accuracy across different attack types, datasets, and architectures, outperforming existing defense methods. 1 Introduction While machine learning provides significant benefits in many applications, the threat of backdoor attacks that compromise machine learning models has been pointed out ( Gu et al. 2019 ; Chen et al. 2017 ; Nguyen & Tran 2021 ) . The compromised model behaves normally on clean data, but when a trigger known only to the adversary is embedded into the data (poisoned data), the model is forced to misclassify it as the attacker-specified target class. One of the most critical challenges in backdoor defenses is to develop backdoor removal methods that effectively eliminate the influence of backdoor attacks from a compromised model while preserving its original accuracy ( Liu et al. 2018a ; Zheng et al. 2022 ; Lin et al. 2024 ) . To minimize accuracy degradation, most backdoor removal methods first identify backdoor neurons that strongly respond to the trigger and are thus thought to be less essential for normal predictions but critical for backdoor success. Once identified, the influence (impact) of these neurons is mitigated through pruning, fine-tuning or both ( Liu et al. 2018a ; Zheng et al. 2022 ; Wu & Wang 2021 ; Li et al. 2023 ; Lin et al. 2024 ) . A key metric to measure the degree of their contribution is Trigger-Activated Changes (TAC) ( Zheng et al. 2022 ) , defined as the difference in neuron activations between clean and poisoned data. Removing neurons exhibiting higher TAC values can eliminate backdoors while minimizing the impact on accuracy ( Zheng et al. 2022 ; Lin et al. 2024 ) . However, since poisoned data is not available in practice, the ideal values of TAC cannot be obtained. Due to this limitation, existing methods ( Liu et al. 2018a ; Zheng et al. 2022 ; Wu & Wang 2021 ; Li et al. 2023 ; Lin et al. 2024 ) compute the contribution of neurons to the success of backdoor attacks using their own approaches, but their results often show low consistency with TAC, leading to ineffective backdoor removal. To address this problem, we propose a novel backdoor removal method by accurately reconstructing the effects of TAC in the latent representation with an overview provided in Figure 1 . Among intermediate layers, TAC in the latent representation, i.e, the output of the layer just before the classification layer, can be critical for the success of backdoor attacks because the effects of TAC in earlier layers propagate and accumulate in the latent representation, which then directly affects misclassification through the classification layer. If the effects of TAC in the latent representation can be inferred solely from clean data, defenders can approximate the model’s outputs on poisoned data without them and eliminate their influence from the model. Thus, reconstructing TAC in the latent representation enables robust backdoor removal. Specifically, we first reconstruct TAC in the latent representation by computing a minimal perturbation in that representation required to misclassify any clean data into the poisoned class. This is motivated by two key properties of TAC in the latent representation: (i) because triggers are realized through minimal modifications to clean data in order to remain undetectable, the resulting changes (i.e., TAC) in the latent representation between clean and poisoned inputs are necessarily small; and (ii) despite being minimal, these changes are sufficient to induce misclassification into the poisoned class. Actually, Figure 2 shows that the minimal perturbation obtained in this way is strongly similar and correlated with TAC in the latent representation. We then apply the obtained perturbation for model fine-tuning, which effectively removes the backdoor while preserving clean accuracy. Figure 1: Overview of our proposed method. Our method consists of two stages: (1) reconstructing TAC in the latent representation, which involves computing the minimal perturbation that forces any clean data to be classified into each class and then identifying the poisoned class based on L^{2} norms of the optimized perturbations, and (2) removing the backdoor by fine-tuning with the optimized perturbation of the poisoned class. (a) BadNets (b) Trojan (c) Blend (d) WaNet Figure 2: The perturbations obtained by our method and TAC in the latent representation for CIFAR-10 on ResNet-18. For each neuron in the latent representation, we plot the TAC value on the horizontal axis and the minimal perturbation of the poisoned class on the vertical axis. Our main contributions are summarized as follows: 1. Method to Reconstruct TAC in the Latent Representation. We propose a method to reconstruct TAC in the latent representation by computing the minimal perturbation that forces any clean data to be misclassified into a specific class and identifying the poisoned class from the perturbations in all classes. First, we formulate the optimization problem of finding such a perturbation as a convex quadratic program. We then clarify the conditions under which such a perturbation exists and derive the analytical solution. For the poisoned class, the perturbation obtained by solving the optimization can be regarded as a surrogate that reproduces the effect of TAC. Therefore, reconstructing TAC in the latent representation requires identifying the poisoned class, even though in practice the defender typically does not know it in advance. 2. Method to Identify the Poisoned Class via Perturbation Norms. We propose a method to identify the poisoned class by selecting the perturbation whose L^{2} norm is unusually small and can be detected as a statistical outlier. This is supported by the fact that backdoor training forces data with triggers to be classified into the poisoned class by effectively shifting its decision boundary toward the region of clean data. Consequently, the minimal perturbation required to misclassify clean data into the poisoned class tends to be smaller than that for other classes. 3. Backdoor Removal Method from the Optimized Perturbation. We propose a backdoor removal method that leverages the TAC effects estimated by our method of the poisoned class. Concretely, we fine-tune the model using a loss that enforces clean data in the latent representation, even when perturbed toward the poisoned class, to be classified into their

Read the complete text