Strategic Sample Selection for Improved Clean-Label Backdoor Attacks in Text Classification

Onur Alp Kirci, M. Emre Gursoy✉ · 2025

Read Strategic Sample Selection for Improved Clean-Label Backdoor Attacks in Text Classification by Onur Alp Kirci, M. Emre Gursoy✉ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15934.txt.

Introduction

Kirci and Gursoy hone clean-tag back-door hits on text sort tools by pick craft. Back-door hits plant a cue that flips a tool's pick on cue. Clean-tag hits keep the true tag, which makes them hard to land. Three pick crafts aim to lift hit force in that hard case. Crafts hunt hosts the tool gets wrong or scores with low trust. Cues go in those weak hosts to bind cue to aim tag.

The crafts test on four known back-door hit forms in clean dress. Three text sets and four tool types host the test runs. Sets span film tales, sense tales, and hate speech posts. Min craft, the top of the three, lifts hit rates a lot. Clean scores hold near flat as hit rates climb in runs. The crafts beat a top clean hit way, BITE, in the runs.

Catalog record

CREATOROnur Alp Kirci, M. Emre Gursoy✉
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15934

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Strategic Sample Selection for Improved Clean-Label Backdoor Attacks in Text Classification Onur Alp Kirci, M. Emre Gursoy✉ Abstract Backdoor attacks pose a significant threat to the integrity of text classification models used in natural language processing. While several dirty-label attacks that achieve high attack success rates (ASR) have been proposed, clean-label attacks are inherently more difficult. In this paper, we propose three sample selection strategies to improve attack effectiveness in clean-label scenarios: Minimum, Above50, and Below50. Our strategies identify those samples which the model predicts incorrectly or with low confidence, and by injecting backdoor triggers into such samples, we aim to induce a stronger association between the trigger patterns and the attacker-desired target label. We apply our methods to clean-label variants of four canonical backdoor attacks (InsertSent, WordInj, StyleBkd, SynBkd) and evaluate them on three datasets (IMDB, SST2, HateSpeech) and four model types (LSTM, BERT, DistilBERT, RoBERTa). Results show that the proposed strategies, particularly the Minimum strategy, significantly improve the ASR over random sample selection with little or no degradation in the model’s clean accuracy. Furthermore, clean-label attacks enhanced by our strategies outperform BITE, a state of the art clean-label attack method, in many configurations. 1 Introduction Backdoor attacks have emerged as a potent threat to the integrity of machine learning models, particularly in text classification and natural language processing (NLP). By injecting a small fraction of poisoned samples into the training data, an attacker can implant a hidden behavior in the model: when a predefined trigger pattern appears in a sample, the model misclassifies it to an attacker-specified target label. In the absence of the trigger, the model behaves normally and produces correct label predictions, thus maintaining high clean accuracy and evading detection [ 5 , 6 ] . Several prominent backdoor attacks have been developed for text classification, such as InsertSent [ 7 ] , WordInj [ 2 , 9 ] , StyleBkd [ 16 ] , and SynBkd [ 17 ] . Most of the attacks fall under the dirty-label category, i.e., attackers modify both the injected poison sample and its label. On the other hand, clean-label attacks in which labels are unaltered are gaining increasing attention due to their stealthiness and difficulty of detection [ 1 , 22 , 25 ] . Yet, clean-label attacks are inherently more challenging since poisoned samples already match the target label; thus, the model has less incentive to associate the trigger with the target class. Consequently, clean-label variants of existing attacks do not perform as well as they do in dirty-label scenarios. To overcome this challenge and improve attack effectiveness in clean-label scenarios, in this paper, we propose three sample selection strategies: Minimum , Above50 , and Below50 , which exploit model uncertainty to strategically select which samples in the training dataset to poison. While the Random selection strategy used in existing works, i.e., a portion of the training dataset is randomly selected and the trigger is injected into the selected samples, performs well in dirty-label scenarios, there is room for improvement in clean-label scenarios. Our key insight in the three selection strategies is that injecting the trigger into samples for which the model exhibits low confidence or incorrect predictions can encourage stronger associations between the trigger and the target label. To implement these strategies without knowledge of the final deployed model, we propose to utilize a surrogate model and demonstrate cross-model transferability of our selected samples. We apply our strategies to clean-label variants of four well-known textual backdoor attacks (InsertSent, WordInj, StyleBkd, SynBkd). We evaluate them using experiments on three datasets (IMDB, SST2, HateSpeech) and four model types (LSTM, BERT, DistilBERT, RoBERTa). We show that our proposed sample selection strategies yield significant improvements in attack success rate (ASR) compared to the Random strategy used in prior works, with minimal impact on clean accuracy (CACC). The Minimum strategy generally performs the best. Remarkably, our clean-label attacks using the Minimum strategy outperform the state of the art clean-label BITE attack [ 22 ] in many configurations. Furthermore, experiments with varying poison rates and surrogate models demonstrate the feasibility of our approach and show that especially transformer-to-transformer transferability is high. In summary, our main contributions can be summarized as follows: • We propose three sample selection strategies (Minimum, Above50, and Below50) to improve the effectiveness of clean-label textual backdoor attacks. Our attacks are based on the intuition of injecting triggers into those samples that are predicted with low confidence or correctness. • We conduct an extensive empirical evaluation of our sample selection strategies across four attacks, three datasets, and four model types. Results show that our strategies consistently improve ASR with minimal or no cost to CACC, compared to Random selection. • We show that, using our sample selection strategies, classic dirty-label backdoor attacks (such as InsertSent, WordInj, StyleBkd, SynBkd) can be transformed into powerful clean-label attacks that rival or surpass BITE, a state of the art clean-label attack. 2 Preliminaries 2.1 Background and Notation We assume a text classification setup where \mathcal{D}_{\text{train}} denotes the training dataset, \mathcal{D}_{\text{test}} denotes the test dataset, and \mathcal{M} denotes the classification model learned using \mathcal{D}_{\text{train}} . Each sample is denoted by (x,y)\in\mathcal{D}_{\text{train}} , where x is a text document and y is its corresponding ground truth label. For example, the document x could be a tweet or e-mail, and the label y=0 indicates that there is no hate speech in the tweet, whereas y=1 indicates the presence of hate speech. The goal of \mathcal{M} is to correctly predict the labels of previously unseen data, e.g., predict whether a previously unseen document contains hate speech. More formally, it is desired that for a test sample (x_{\text{t}},y_{\text{t}})\in\mathcal{D}_{\text{test}} , the model should predict \mathcal{M}(x_{\text{t}})=y_{\text{t}} . The clean accuracy (CACC) of the model \mathcal{M} can be measured as: \text{CACC}=\frac{\sum_{(x_{\text{t}},y_{\text{t}})\in\mathcal{D}_{\text{test}}}\mathbb{I}(\mathcal{M}(x_{\text{t}})=y_{\text{t}})}{|\mathcal{D}_{\text{test}}|} (1) where \mathbb{I}(\cdot) is the indicator function, equal to 1 if its argument is true and 0 otherwise. 2.2 Backdoor Attacks A backdoor attack on a text classification model involves poisoning \mathcal{D}_{\text{train}} with malicious samples, causing the model \mathcal{M} to learn a specific trigger pattern that it associates with an attacker-chosen target label. The percentage of \mathcal{D}_{\text{train}} that is poisoned by the attacker is called the poison rate and denoted by \rho . The attacker injects a trigger (for example, a specific word or sentence) in \rho\times|\mathcal{D}_{\text{train}}| samples so that \mathcal{M} associates the trigger pattern with the target label y_{\text{target}} . It is desired by the attacker that at test time, the backdoored model \mathcal{M} will predict y_{\text{target}} for test samples which contain the trigger (regardless of the remaining contents in the sample), whereas it will predict the correct label for test samples which do not contain the trigger. The Attack Success Rate (ASR) of a backdoor attack can be measured by the fraction of originally clean test samples that the backdoored model classifies as y_{\text{target}} after the trigger is injected. Let \mathcal{D}_{\text{bd}}\subset\mathcal{D}_{\text{test}} be a subset of test samples with original labels other than y_{\text{target}} , and let g(\cdot) be the function that injects the trigger. ASR can be measured as: \text{ASR}=\frac{\sum_{(x_{i},y_{i})\in\mathcal{D}_{\text{bd}}}\mathbb{I}(\mathcal{M}(g(x_{i}))=y_{\text{target}})}{|\mathcal{D}_{\text{bd}}|} (2) Typically, a backdoor attack aims to satisfy two goals simultaneously: achieving high ASR and maintaining high CACC. The latter is important for stealth. Since backdoor attacks aim to

Read the complete text