Prototype Guided Backdoor Defense
Venkat Adithya A, Sunayana Samavedam, Saurabh Saini, Avani Gupta, P J Narayanan · 2025
Read Prototype Guided Backdoor Defense by Venkat Adithya A, Sunayana Samavedam, Saurabh Saini, Avani Gupta, P J Narayanan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20925.txt.
Introduction
A backdoor attack poisons a few training images so a model fails on cue whenever a hidden trigger appears. Venkat Adithya Amula and four co-authors propose a defense in 2025 that works after training, without knowing which trigger the attacker used.
Their method watches the geometry of the model's inner activations. Poisoned inputs drift toward the trigger in that space, so a fine-tuning loss penalizes such drift, guided by clean prototypes of each class. The approach held up across trigger styles, including semantic triggers built from real image content. The team also reports the first defense against a new semantic attack on celebrity face photos, a hard case for older methods.
Catalog record
| CREATOR | Venkat Adithya A, Sunayana Samavedam, Saurabh Saini, Avani Gupta, P J Narayanan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-20925
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Prototype Guided Backdoor Defense Venkat Adithya A, Sunayana Samavedam, Saurabh Saini, Avani Gupta, P J Narayanan Abstract Deep learning models are susceptible to backdoor attacks involving malicious attackers perturbing a small subset of training data with a trigger to causes misclassifications. Various triggers have been used including semantic triggers that are easily realizable without requiring attacker to manipulate the image. The emergence of generative AI has eased generation of varied poisoned samples. Robustness across types of triggers is crucial to effective defense. We propose Prototype Guided Backdoor Defense (PGBD), a robust post-hoc defense that scales across different trigger types, including previously unsolved semantic triggers. PGBD exploits displacements in the geometric spaces of activations to penalize movements towards the trigger. This is done using a novel sanitization loss of a post-hoc fine-tuning step. The geometric approach scales easily to all types of attacks. PGBD achieves better performance across all settings. We also present the first defense against a new semantic attack on celebrity face images. Project page: this https URL . 1 Introduction Can a face-recognition based access control system contain a backdoor that lets in anyone with a specific tattoo? Can such a backdoor be created by tampering with a small fraction of the training data? The answer to both questions is yes. Backdoor attacks [ 13 , 19 , 54 ] using poisoned training data is a serious risk to AI systems. Given the training data size and the complexity of handling them, risk of poisoning some of it is very real. A backdoor scenario studied in the literature maliciously steers the classifier to a chosen target label (say, the identity of the manager) when a specific trigger (such as a tattoo) is present in the input sample. Several such backdoor attacks have been proposed before; defenses for many have also been proposed. Pre-hoc defense involves detecting poisoned training samples before the model is trained [ 56 , 48 , 60 , 71 , 23 ] . More interesting are post-hoc methods that sanitize a poisoned model using a few fine-tuning epochs to recover a clean model [ 36 , 75 , 76 ] . Previous methods did not generalize to all attacks [ 36 , 76 , 79 ] , were unable to retain model utility post defense [ 75 ] , or were heavily reliant on synthesized trigger priors [ 63 , 75 ] . Post-hoc defense scenario for a k -class classification problems has access to the following: the trained poisoned model M_{B} with a backdoor, a small amount D_{S} of clean (without trigger) training data, and the target class label t to which the poisoned samples are directed. Methods like Neural Cleanse [ 63 ] can be used to infer t . A poisoned model has high Clean Accuracy (CA) (i.e., assigns correct labels to clean samples) and high Attack Success Ratio (ASR) (i.e., assigns label t to poisoned samples). We sanitize M_{B} using a few fine-tuning epochs on D_{S} to yield a model with a low ASR and a high CA. In this paper, we present Prototype Guided Backdoor Defense (PGBD) , a robust and scalable post-hoc model-sanitization method that defends backdoor attacks by geometrically manipulating the model’s activation space during sanitization. A new sanitization loss (used in conjunction with the original classification loss during sanitization epochs) penalizes the movement away from ground-truth class towards the target-class. The sanitization loss depends on the angular alignment of the sample’s gradient to the Prototype Activation Vector (PAV) to the target class. This is similar to using a CAV loss for debiasing models [ 22 ] ; our losses are based on class-specific prototypes. The geometric approach of PGBD scales easily to multiple types of attacks and adapts to different configurations. Base variant of PGBD assumes that the target class t is known, like MCL [ 75 ] , state-of-the-art post-hoc method. We also present a variant NT-PGBD with similar performance ( Tab. 4 ) that does not need t . Our contributions are: \circ PGBD, a novel post-training backdoor defense strategy using controlled geometric manipulation of activation spaces. The geometric approach is simple, highly configurable, and generalizes to a variety of backdoor attacks. We also present variations that do not need the target class, uses synthesized triggers, and handles non-fixed targets. \circ Improved performance on multiple attacks and multiple datasets with no discernible weakness ( Tab. 2 ), particularly in ASR reduction. The performance of NT-PGBD also exceeds others ( Tab. 4 ) with minimal inputs. \circ To the best of our knowledge, first-ever defense against semantic attacks on a new semantic attack dataset (like [ 51 , 9 , 66 ] ), with larger trigger variations based on real-world occluded celebrity faces [ 16 ] . The dataset and code will be publicly released for research purposes. 2 Related Works Balanced Scalable Robust Configurable FT ✗ ✗ ✗ ✗ NAD [ 36 ] ✓ ✗ ✗ ✗ FT-SAM [ 79 ] ✓ ✓ ✗ ✗ I-BAU [ 76 ] ✓ ✓ ✓ ✗ MCL [ 75 ] ✓ ✓ ✗ ✓ PGBD (Ours) ✓ ✓ ✓ ✓ Table 1 : Compared to naive fine-tuning (FT) and other post-hoc defenses, PGBD is configurable (able to utilize additional attack scenario information during defense), scalable (able to perform well across different types of attacks), robust (maintains performance with model and dataset changes), and balanced (balances the defense objectives of minimizing Attack Success Rate while retaining Clean Accuracy. We briefly discuss backdoor data poisoning attacks, and their defense with a focus on model sanitization methods. Concept Based Model Improvement: Gupta et al. [22] introduced concept distillation for (de)sensitizing a model for a certain concept by moving model activations against (or towards) a particular CAV direction. CAV (Concept Activation Vector) indicates the activation space direction that points towards the location of a given concept [ 30 ] . Recently, Dong et al. [15] introduced Language-Guided CAV to utilize knowledge in CLIP and activation sample reweighing to enhance model correction by dynamically training with samples and aligning predictions with relevant concepts. CBMs [ 31 ] use manually defined vectors for supervision to train model to focus on certain concepts. Interactive methods like [ 6 , 3 , 53 ] use user interaction to tune models for specific concepts. We utilize the debiasing capability of Gupta et al. [22] in the backdoor setting with class-specific directions to define the trigger concept. Attacks: Based on the kind of trigger, backdoor data poisoning attacks are of three types: (i) Patch/Localized trigger-based attacks use perturbations that alter only a small local region of the image [ 20 , 11 , 74 ] . (ii) Functional trigger based variety of attacks perturb image globally, are generally imperceptible [ 45 , 38 ] and do not require dataset label modification ( i.e . clean-label attack ) [ 1 , 41 ] . Dynamic backdoor attacks [ 44 , 50 , 37 ] can be either functional or patch-based and add a sample-level uniqueness constraint on the trigger by learning it as a function of both the image and the target class. (iii) Semantic trigger based attacks use realistic triggers that naturally fit into the dataset scenes. These