AIM: A dditional Im age Guided Generation of Transferable Adversarial Attacks
Teng Li, Xingjun Ma, Yu-Gang Jiang · 2025
Read AIM: A dditional Im age Guided Generation of Transferable Adversarial Attacks by Teng Li, Xingjun Ma, Yu-Gang Jiang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01106.txt.
Introduction
Teng Li, Xingjun Ma, and Yu-Gang Jiang sharpen fake images that fool vision models into a chosen wrong answer. Such attacks matter because a tweak too small to see can swing a model's call, and the best fakes work on models they never met. Past makers of these fakes fought overfitting but ignored extra meaning that could help the fake travel. Their 2025 module, AIM, adds that meaning.
A plug-in part reads a guide image from the target class and injects its traits into the fake. New loss rules blend the injected traits for both aimed and unaimed attacks. Broad tests show the fakes fool fresh models more often than past designs. The authors offer the module as a drop-in boost for attack research and defense testing.
Catalog record
| CREATOR | Teng Li, Xingjun Ma, Yu-Gang Jiang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-01106
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AIM: A dditional Im age Guided Generation of Transferable Adversarial Attacks Teng Li, Xingjun Ma, Yu-Gang Jiang Abstract Transferable adversarial examples highlight the vulnerability of deep neural networks (DNNs) to imperceptible perturbations across various real-world applications. While there have been notable advancements in untargeted transferable attacks, targeted transferable attacks remain a significant challenge. In this work, we focus on generative approaches for targeted transferable attacks. Current generative attacks focus on reducing overfitting to surrogate models and the source data domain, but they often overlook the importance of enhancing transferability through additional semantics. To address this issue, we introduce a novel plug-and-play module into the general generator architecture to enhance adversarial transferability. Specifically, we propose a Semantic Injection Module (SIM) that utilizes the semantics contained in an additional guiding image to improve transferability. The guiding image provides a simple yet effective method to incorporate target semantics from the target class to create targeted and highly transferable attacks. Additionally, we propose new loss formulations that can integrate the semantic injection module more effectively for both targeted and untargeted attacks. We conduct comprehensive experiments under both targeted and untargeted attack settings to demonstrate the efficacy of our proposed approach. Code — https://terrytengli.com/s/Ce83N Shanghai Key Lab of Intell. Info. Processing, School of CS, Fudan University Introduction Over the past decades, deep neural networks (DNNs) have achieved significant success across various fields, including computer vision ( Krizhevsky, Sutskever, and Hinton 2012 ) and natural language processing ( Hochreiter and Schmidhuber 1997 ) . In computer vision, DNNs are widely applied to real-world tasks such as image classification ( He et al. 2016 ; Vaswani et al. 2017 ) , object detection ( Redmon et al. 2016 ) . However, research ( Goodfellow, Shlens, and Szegedy 2015 ) has demonstrated that DNNs are vulnerable to adversarial examples ( Szegedy et al. 2013 ) , which are modified inputs by small, imperceptible adversarial perturbations ( Goodfellow, Shlens, and Szegedy 2015 ) . Moreover, adversarial examples have been shown to transfer across different model architectures ( Zhang et al. 2022 ) , data domains ( Naseer et al. 2019 ) and modality ( Chen et al. 2023 ; Chen et al. 2022 ) . In other words, attacks crafted on one model or dataset can remain effective when applied to other models or datasets. This adversarial transferability poses a significant threat to the deployment of DNNs in real-world applications. Transferable adversarial attacks can be crafted using various methods, which can be broadly categorized into two main types: iterative methods ( Madry et al. 2017 ) and generative methods ( Poursaeed et al. 2018 ) . Iterative attacks directly optimize the input space to generate adversarial examples, while generative attacks focus on pre-training a generator model to produce these examples. Iterative methods are often more time-consuming and may result in poorer adversarial transferability compared to generative methods, due to issues like gradient vanishing ( Li et al. 2020 ) . Attacks can also be classified based on their target: targeted attacks ( Wang et al. 2023 ) and untargeted attacks ( Zhang et al. 2022 ) . Untargeted attacks aim to cause the model to predict any incorrect label, whereas targeted attacks seek to force the model to output a specific label. In the context of transferable attacks, targeted attacks are generally considered more challenging than untargeted ones ( Wang et al. 2023 ) , primarily due to the risk of overfitting the surrogate model and the lack of information about the target class distribution. The overfitting issue can be mitigated using data augmentation strategies ( Li et al. 2024 ) , feature loss objectives (e.g., feature disruption ( Zhang et al. 2022 ) , batch neighborhood similarity ( Naseer et al. 2021 ) ), and unsupervised training techniques (e.g., contrastive learning ( Li et al. 2023 ) ). However, these methods are suboptimal because they primarily address overfitting rather than explicitly improving transferability. Moreover, when an adversarial noise generator is trained on a specific target dataset or surrogate model architecture, the perturbations it produces may overfit to that particular context. To address this limitation, we propose to incorporate additional context-agnostic semantics to better guide the generation of transferable adversarial examples. Designing a new generator architecture for this purpose is challenging. To overcome this, we introduce the Semantic Injection Module (SIM), a lightweight and plug-and-play module that integrates an additional guiding image into the adversarial generator, enhancing its ability to produce more transferable adversarial examples. With SIM, we can flexibly use different guiding images to facilitate either targeted or untargeted transferable attacks. For targeted attacks, we incorporate semantic guidance from images associated with the target concept (label), improving the precision of targeted transferability. For untargeted attacks, we use guiding images from incorrect classes to help mitigate overfitting to the input image and surrogate model. Moreover, we introduce new loss formulations for adversarial loss to effectively integrate SIM into the training objectives of generative attacks. In summary, our main contributions are: • We present a novel approach for achieving targeted transferable attacks by incorporating an additional image as guiding semantics. Specifically, we propose a lightweight plug-and-play Semantic Injection Module (SIM) that can be used with general adversarial generators. • We investigate training objectives for generative attacks within both targeted and untargeted frameworks, including logit-level and feature-level approaches. Based on this analysis, we propose new training loss formulations that improve the effectiveness of SIM across different types of guiding semantics. • We conduct extensive experiments to evaluate the efficacy of our proposed approach. Our results show that it achieves superior transferability for targeted attacks and performs on par with state-of-the-art methods for untargeted attacks. Figure 1: Our framework introduces a novel semantic injection module (SIM) into the adversarial generator G\left(\left(\cdot,\cdot\right),\theta_{g}\right) . The generator takes a source image x and a guiding image x_{\text{guide}} as inputs and outputs an adversarial example x_{\text{adv}} . The SIM component utilizes the feature map from the previous layer and the guiding image x_{\text{guide}} to produce an enhanced feature map that incorporates the semantics from the guiding image. For targeted attacks (Tar.), we define the training objectives using logit contrastive loss and mid-layer similarity loss, which direct the adversarial example x_{\text{adv}} towards the target guiding image x_{\text{guide}} in both the logit and feature spaces. For untargeted attacks (Untar.), we introduce an enhanced mid-layer similarity loss to push x_{\text{adv}} away from both the clean image x and the guiding image x_{\text{guide}} in the feature space. Related Work Transferable Adversarial Attack Existing transferable adversarial attacks can be broadly classified into two types: iterative attacks and generative attacks . Iterative attacks optimize adversarial examples by constructing logits-oriented loss functions. For example, the Fast Gradient Sign Method (FGSM) ( Goodfellow, Shlens, and Szegedy 2015 ) applies one-step perturbations to the input image in the direction of the input gradient. The Projected Gradient Descent (PGD) attack enhances adversarial strength through techniques such as random initialization, multi-step perturbation, and clipping ( Madry et al. 2017 ) . Xie et al. (2019) improved iterative FGSM’s ( Kurakin, Goodfellow, and Bengio 2018 ) transferability with diverse data augmentation. Additionally, feature-space attacks, such as DR ( Lu et al. 2020 ) , improve adversarial strength by