Breaking the Stealth-Potency Trade-off in Clean-Image Backdoors with Generative Trigger Optimization

Binyan Xu, Fan Yang, Di Tang, Xilin Dai, Kehuan Zhang · 2025

Read Breaking the Stealth-Potency Trade-off in Clean-Image Backdoors with Generative Trigger Optimization by Binyan Xu, Fan Yang, Di Tang, Xilin Dai, Kehuan Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07210.txt.

Introduction

Binyan Xu and four co-authors break a trade-off that has limited clean-image backdoor attacks on neural networks. Such attacks poison training with only label changes, no visible trigger, but success usually demands a poison rate high enough to drag down clean accuracy, betraying the attack. Their system, Generative Clean-Image Backdoors, instead optimizes the trigger itself, using a conditional InfoGAN to find naturally occurring image features that act as potent, separable triggers.

Because these triggers stand apart from task-relevant features, the victim model learns the backdoor from very few poisoned examples, with clean accuracy dropping by less than one percent. The attack adapted across six data sets, five designs, and four tasks, including the first clean-image backdoors shown for regression and segmentation. It resisted most current defenses, a sobering result for model security.

Catalog record

CREATORBinyan Xu, Fan Yang, Di Tang, Xilin Dai, Kehuan Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-07210

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Breaking the Stealth-Potency Trade-off in Clean-Image Backdoors with Generative Trigger Optimization Binyan Xu, Fan Yang, Di Tang, Xilin Dai, Kehuan Zhang Abstract Clean-image backdoor attacks, which use only label manipulation in training datasets to compromise deep neural networks, pose a significant threat to security-critical applications. A critical flaw in existing methods is that the poison rate required for a successful attack induces a proportional, and thus noticeable, drop in Clean Accuracy (CA), undermining their stealthiness. This paper presents a new paradigm for clean-image attacks that minimizes this accuracy degradation by optimizing the trigger itself. We introduce G enerative C lean-Image B ackdoors (GCB), a framework that uses a conditional InfoGAN to identify naturally occurring image features that can serve as potent and stealthy triggers. By ensuring these triggers are easily separable from benign task-related features, GCB enables a victim model to learn the backdoor from an extremely small set of poisoned examples, resulting in a CA drop of less than 1%. Our experiments demonstrate GCB’s remarkable versatility, successfully adapting to six datasets, five architectures, and four tasks, including the first demonstration of clean-image backdoors in regression and segmentation. GCB also exhibits resilience against most of the existing backdoor defenses. Code — https://github.com/binyxu/GCB Introduction Deep Neural Networks (DNNs) are widely used in applications like facial recognition ( 2 ) , autonomous driving ( 15 ) , and medical image diagnosis ( 27 ) . However, backdoor attacks threaten their widespread adoption. By poisoning a small fraction of the training data ( 29 ) , an adversary can implant a hidden backdoor, causing the model to generate targeted mispredictions when a specific trigger is present in inputs. A particularly insidious variant is the clean-image backdoor , where the attack is executed without any image modification, typically by manipulating labels. This poses a significant threat in scenarios where data annotation is outsourced. For instance, CIB ( 4 ) demonstrated a one-to-one backdoor in multi-label classification by simply relabeling all qualified images from a source to a target class. More recently, FLIP ( 19 ) proposed a label-optimization technique to mimic the behavior of a surrogate poisoned-image model, extending the attack’s applicability. Figure 1: Breaking the Stealth-Potency Trade-off. Average Attack Success Rate (ASR) vs. Clean Accuracy (CA) drop across all datasets. Baselines must sacrifice stealth (CA drop) for attack success. In contrast, our method (GCB, \bigstar ) delivers a highly effective attack with negligible CA drop. Although existing methods can achieve high Attack Success Rates (ASR), their stealthiness is fundamentally limited by a clear trade-off between attack potency and model accuracy, as visualized in Fig. 1 . The figure, which averages performance across six datasets, shows that all existing methods follow a distinct curve: to achieve higher ASR, they must accept a significantly higher Clean Accuracy (CA) Drop. For example, to exceed 50% ASR, state-of-the-art methods like FLIP ( 19 ) often incur an average CA Drop of over 8%. This conspicuous degradation compromises stealthiness and undermines its practicality in real-world scenarios where model performance is closely monitored. This drop in CA is not an artifact of a specific method but a direct consequence of the clean-label attack paradigm, attributed to what ( 44 ) term the ”natural backdoor trigger” effect. When a subset of training images is relabeled, the i.i.d. nature of the data dictates that a similar proportion of the benign test set will naturally share the features that correlate with the mislabeling. The victim model learns this spurious correlation, leading to a CA drop that is directly proportional to the poison rate. This establishes a clear trade-off: greater stealthiness (a lower CA drop) demands a lower poison rate, which traditionally weakens the attack. The central challenge, therefore, becomes: How can we break this trade-off, designing a trigger so potent that its corresponding backdoor is both highly effective and exceptionally stealthy? This paper addresses this challenge head-on. We introduce Generative Adversarial Clean-Image Backdoors (GCB), a novel framework that creates such highly effective triggers, enabling successful attacks with a poison rate as low as 0.1%. This, in turn, reduces the average CA drop to a mere 0.2% and a maximum of 0.5% for any class. However, this optimization is non-trivial, as we must identify features that already exist within benign data, subject to 3 constraints: (1) Existence : The optimized trigger pattern must naturally exist in the training set. (2) Separability : Images with and without the trigger must be easily distinguishable for the model to learn the backdoor from a very low poison rate. (3) Irrelevancy : The trigger features must be orthogonal to the primary classification task to avoid degrading clean accuracy. To simultaneously satisfy these constraints, we develop C-InfoGAN, a novel conditional generative framework. C-InfoGAN is designed to find an optimal ”trigger function” by using a GAN architecture in a new way: (a) For Existence , we employ an adversarial discriminator to constrain the generator’s output to the natural data manifold, guaranteeing that any identified trigger pattern is a valid, naturally occurring feature. (b) For Separability , we build on InfoGAN by training a generator with two distinct latent codes (representing triggered and benign states) and maximizing the distance in the feature space between the images they produce. (c) For Irrelevancy , we condition all components of the framework on the ground-truth class labels, forcing the framework to find trigger features that are independent of the class-discriminative features. Property↓ CIB FLIP CIBA GCB (ours) CA Drop \leq 1\% ✗ ✗ ✗ ✓ Poison Rate \leq 1\% ✗ ✗ ✗ ✓ ASR \geq 90\% ✓ ✓ ✗ ✓ Scalability (Datasets) ✓ ✗ ✗ ✓ Transferability (Architectures) ✓ ✗ ✓ ✓ Generalizability (Tasks) ✗ ✗ ✗ ✓ Table 1: Comparison between SOTA clean-image backdoors. Our extensive experiments validate the superior stealth and effectiveness of GCB. Across 6 datasets including MNIST, CIFAR-10, CIFAR-100, GTSRB, Tiny-ImageNet, and ImageNet, GCB achieves ASRs up to 100% (e.g., 97.9% on CIFAR-10) with less than a 1% CA drop, using a mere 0.5% poison rate per source class. The method is robust across architectures (ResNet, VGG, ViT) and shows remarkable generalizability, extending for the first time to complex vision tasks like multi-label classification, regression, and segmentation. Even in a challenging scenario where the adversary accesses only 10% of the training data, GCB achieves a 90.3% ASR with a 0.15% CA drop on CIFAR-10. Furthermore, GCB demonstrates resilience against most of existing SOTA backdoor defenses. A summary comparison is provided in Table 1 . Our contributions are three-fold: • Breaking the Stealth-Potency Trade-off : We are the first to demonstrate a clean-image backdoor that is simultaneously highly potent ( \geq 90\% ASR) and exceptionally stealthy (negligible CA drop \leq 1\% with \leq 0.5\% poison rate) on all datasets, effectively breaking the conventional trade-off that plagues existing methods. • Broad Applicability and Generalization : Our method demonstrates exceptional adaptability across 6 datasets, 5 architectures, and 4 tasks. Crucially, it is the first clean-image attack framework shown to be effective for regression and segmentation tasks, dramatically expanding the threat landscape. • Novel Attack Method : We introduce a novel attack methodology based on a conditional InfoGAN, which uniquely reframes the generator as a trigger function and a recognizer as a score

Read the complete text