SEP-Attack: A Simple and Effective Paradigm for Transfer-Based Textual Adversarial Attack Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates DOI: 10.1145/3774904.3793042 ISBN: 979-8-4007-2307-0/2026/04 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Natural language processing
Han Liu, Zhi Xu, Xiaotong Zhang, Feng Zhang, Xiaoming Xu, Wei Wang, Fenglong Ma, Hong Yu · 2026
Read SEP-Attack: A Simple and Effective Paradigm for Transfer-Based Textual Adversarial Attack Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates DOI: 10.1145/3774904.3793042 ISBN: 979-8-4007-2307-0/2026/04 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Natural language processing by Han Liu, Zhi Xu, Xiaotong Zhang, Feng Zhang, Xiaoming Xu, Wei Wang, Fenglong Ma, Hong Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24958.txt.
Introduction
Han Liu leads SEP-Attack, a simple paradigm for text attacks transferring across models. Such attacks build hostile examples on surrogate models, yet text transfer work is thin. Submodels often get equal weight, or importance scores mislead. SEP-Attack draws diverse ensemble weights from a determinantal point process. It builds a confidence metric from those weights to score word importance and draft candidates. Each candidate gets a transferability score, and only the top ones become final examples, beating baselines on four data sets and two real-world APIs.
Catalog record
| CREATOR | Han Liu, Zhi Xu, Xiaotong Zhang, Feng Zhang, Xiaoming Xu, Wei Wang, Fenglong Ma, Hong Yu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45054 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.24958
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SEP-Attack: A Simple and Effective Paradigm for Transfer-Based Textual Adversarial Attack Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates DOI: 10.1145/3774904.3793042 ISBN: 979-8-4007-2307-0/2026/04 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Natural language processing Han Liu, Zhi Xu, Xiaotong Zhang, Feng Zhang, Xiaoming Xu, Wei Wang, Fenglong Ma, Hong Yu Abstract . Despite the strong performance of deep neural networks in modern Web and language applications, they remain vulnerable to adversarial attacks, especially transferable attacks that generate adversarial examples using surrogate models without accessing the victim model. Transferable attacks in the text domain are still under-explored, with only a few studies addressing this challenging issue, often with suboptimal results due to equal treatment of submodels or inaccurate estimation of importance scores. To address these challenges, we propose a simple yet effective paradigm for transfer-based textual adversarial attack, named SEP-Attack. Specifically, we employ the Determinantal Point Process (DPP) to generate diverse surrogate ensemble weights, representing the transferability of submodels. Using these weights, we introduce a new metric to evaluate prediction confidence scores, which in turn are used to calculate word importance scores and generate adversarial candidates. Finally, we quantify the transferability score for each candidate and select the top ones as the final transferable adversarial examples. Experiments conducted on four datasets and two real-world APIs validate the efficacy of SEP-Attack, significantly outperforming state-of-the-art baselines. † † cc-license: by 1. Introduction Deep neural networks (DNNs) and large language models (LLMs) have become the backbone of modern Web-based applications, supporting tasks such as content moderation ( Huang 2025 ; Girón et al. 2025 ; Chen et al. 2025 ) , online recommendation ( Wu et al. [n. d.] ; Tang et al. 2025 ; Liu et al. 2025a ) , and misinformation detection ( Ahmad et al. 2026 ; Liu et al. 2025b ; Xu et al. 2025 ) . Despite their widespread adoption and strong performance, growing evidence shows that these models remain highly vulnerable to adversarial attacks ( Chen et al. 2022 ; Yuan et al. 2019 ) . Such vulnerabilities raise serious societal and ethical concerns when models are deployed on the Web, where adversarial attacks can amplify harmful content, evade moderation systems, or trigger biased or misleading decisions. Understanding such risks is vital for building safe and reliable Web AI systems. Figure 1 . The overview of our proposed SEP-Attack framework, which consists of three main components. (1) Generating diversity-based surrogate ensemble weights with the Determinantal Point Process (DPP). (2) Generating adversarial examples via the surrogate ensemble model, with deeper red hues representing lower confidence scores under corresponding weights; and (3) Selecting transferable adversarial examples according transferability scores. Existing adversarial attack methods can be divided into two categories based on the accessibility level of victim models: white-box attacks ( Ebrahimi et al. 2018 ; Meng and Wattenhofer 2020 ) and black-box attacks ( Li et al. 2020 ; Zeng and Xiong 2021 ) . White-box attacks allow the attacker full access to the victim model, including its architecture, parameters, and training data. Although these attacks are highly idealistic and impractical in most real-world scenarios, they are still valuable in controlled environments such as internal testing and model sharing. In contrast, black-box attacks assume that the attacker has no knowledge of the model’s internal workings, which is more realistic in practical applications. Black-box attack methods can be further classified into query-based attacks and transfer-based attacks . Query-based attacks need to frequently query the victim model until an adversarial example is generated, which are probably limited by query restrictions and detection mechanisms. Transfer-based attacks aim to generalize adversarial vulnerabilities across different models without accessing any information of the victim models, making them particularly concerning for real-world applications. Most existing transfer-based attacks have primarily focused on computer vision ( Qin et al. 2022 ; Chen et al. 2024 ; Liu et al. 2017 ; Ge et al. 2023 ) , where they often achieve their attacks by setting a target function and utilizing gradient descent on a surrogate model. However, these approaches face challenges in text attacks due to the discrete nature of text and variations in tokenization algorithms across different models ( Yuan et al. 2021 ; Kwon and Lee 2023 ) . This challenging issue is still in its infancy and under-explored in the text domain. HAWR ( Yuan et al. 2021 ) proposes a method to generate adversarial examples by deriving highly-transferable adversarial word replacement rules through analyzing the changes in the ensemble’s log-likelihood predictions caused by word substitutions. Ensemble ( Kwon and Lee 2023 ) generates a transfer-based adversarial example by leveraging TextFooler ( Jin et al. 2020 ) to generate adversarial examples on an ensemble model and subsequently transfer them to the victim model for the attack. However, these methods have several limitations when it comes to generating transferable text adversarial examples. On the other hand, the TextFooler-based approach calculates word importance by removing words from the sentence. This removal alters the context, causing inaccurate importance estimates that compromise the attack success rate. To address these challenges and to support robustness research for responsible Web AI, we propose SEP-Attack, a S imple yet E ffective P aradigm for transfer-based textual adversarial Attack . Specifically, "simple" refers to the straightforward and easily implementable core concept of SEP-Attack. Meanwhile, "effective" indicates that SEP-Attack demonstrates superior performance, significantly outperforming other strong baselines. An overview of SEP-Attack is illustrated in Figure 1 . In SEP-Attack, we propose to utilize the Determinantal Point Process (DPP) to sample diverse surrogate ensemble weights to represent the levels of the transferability of submodels, resulting in a set of transferable adversarial examples. To address the challenge of accurately calculating word importance, we propose an approach that involves updating the important words and subsequently removing the unimportant ones. This strategy aims to mitigate the issues arising from inaccurate word importance calculations. Finally, we identify transferable adversarial examples among all the examples generated from the ensemble model. We conduct experiments on four benchmark datasets, two real-world APIs (Alibaba Cloud and Google Cloud), and large language models. The results demonstrate that SEP-Attack achieves a significantly higher attack success rate compared to other strong baselines while also maintaining the lowest query budget cost 1 1 1 The source code is publicly available at https://github.com/ZevineXu/SEP-Attack . 2. Related Work 2.1. Query-Based Black-Box Attacks Query-based black-box attacks aim to generate adversarial samples by querying the black-box victim models. Two main ways to achieve query-based attacks are the soft and hard-label settings. In the soft-label setting, attackers can access the model’s output scores (i.e., probability distributions) and use them to design attack algorithms ( Gao et al. 2018 ; Jin et al. 2020 ; Li et al. 2019 ; Lee et al. 2022 ) . For example, DeepWordBug ( Gao et al. 2018 ) focuses on generating character-level perturbations on important words using output scores. TextFooler ( Jin et al. 2020 ) uses output scores to calculate word-level importance and performs attacks by a greedy-based method. TextBugger ( Li et al. 2019 ) aims to identify important sentences and replace