NODE-AdvGAN: Improving the transferability and perceptual similarity of adversarial examples by dynamic-system-driven adversarial generative model
Xinheng Xie, Yue Wu, Cuiyu He · 2024
Read NODE-AdvGAN: Improving the transferability and perceptual similarity of adversarial examples by dynamic-system-driven adversarial generative model by Xinheng Xie, Yue Wu, Cuiyu He (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03539.txt.
Introduction
Xinheng Xie, Yue Wu, and Cuiyu He propose a new way to craft fake images that fool vision models, in a 2024 paper. Such images carry tiny changes that people cannot see but models read wrongly. Good fakes help builders train tougher models. Their method treats the making of a fake as a smooth, flowing process, guided by an equation that tracks how a generator changes over time.
The flowing design yields fakes that look closer to the real image than older methods give. A second version tunes the noise used in training, which helps the fakes fool new models they were not built against. In tests, both versions won more often than rival methods. They also kept better image quality, a pairing that makes them useful for probing weak spots in vision systems.
Catalog record
| CREATOR | Xinheng Xie, Yue Wu, Cuiyu He |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-03539
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NODE-AdvGAN: Improving the transferability and perceptual similarity of adversarial examples by dynamic-system-driven adversarial generative model Xinheng Xie, Yue Wu, Cuiyu He Abstract Understanding adversarial examples is crucial for improving model robustness, as they introduce imperceptible perturbations to deceive models. Effective adversarial examples, therefore, offer the potential to train more robust models by eliminating model singularities. We propose NODE-AdvGAN, a novel approach that treats adversarial generation as a continuous process and employs a Neural Ordinary Differential Equation (NODE) to simulate generator dynamics. By mimicking the iterative nature of traditional gradient-based methods, NODE-AdvGAN generates smoother and more precise perturbations that preserve high perceptual similarity when added to benign images. We also propose a new training strategy, NODE-AdvGAN-T, which enhances transferability in black-box attacks by tuning the noise parameters during training. Experiments demonstrate that NODE-AdvGAN and NODE-AdvGAN-T generate more effective adversarial examples that achieve higher attack success rates while preserving better perceptual quality than baseline models. Journal: Information Science 1 Introduction Adversarial examples are inputs crafted by adding carefully designed perturbations to mislead deep neural networks (DNNs), posing significant security threats to machine learning applications [ 1 ] . These perturbations are typically imperceptible to the human eye, but can cause models to make incorrect predictions with high confidence [ 2 , 3 , 4 ] . Adversarial attacks have been widely studied across various domains, including face recognition [ 5 , 6 ] and autonomous driving [ 7 , 8 ] , where model reliability is crucial. Figure 1 demonstrates an adversarial example attacking a well-trained Inception-v3 [ 9 ] classifier. While the original benign image (left) is correctly classified as an electric fan with 99.7\% confidence, the adversarial version (right) is misclassified as an hourglass with 100\% confidence. Despite being nearly indistinguishable to the human eye, the adversarial perturbation effectively deceives the model. Figure 1 : An example of a benign image (left) and its adversarial counterpart (right). The process of generating adversarial images can be mathematically formulated as \boldsymbol{x}_{\text{adv}}=\boldsymbol{x}+{\delta}(\boldsymbol{x})\text{ subject to }\|{\delta}(\boldsymbol{x})\|_{p}\leq\epsilon, (1) where \boldsymbol{x} is the benign image, \boldsymbol{x}_{\text{adv}} is its adversarial counterpart, and {\delta}(\boldsymbol{x}) denotes the adversarial perturbation. The adversarial algorithm optimizes perturbations to deceive the target model f while adhering to a predefined perturbation budget \epsilon , ensuring imperceptibility. We will use \delta(\boldsymbol{x},f) to explicitly denote the need for access to f during inference. In a white-box attack scenario where the target model’s architecture and parameters are fully accessible, the objective is to find a perturbation \delta(\boldsymbol{x},f) that maximizes the misclassification likelihood while adhering to a predefined perturbation constraint: \underset{\|{\delta}(\boldsymbol{x},f)\|_{p}\leq\epsilon}{\text{argmax}}\,J({\boldsymbol{\Theta}},\boldsymbol{x}+{\delta}(\boldsymbol{x},f),\boldsymbol{y}), (2) where J is the attack loss function, \boldsymbol{y} is the true label of \boldsymbol{x} , and \boldsymbol{\Theta} represents the model parameters. For efficient adversarial generation, gradient-based methods are widely used. The FGSM [ 10 ] crafts perturbations by computing and following the gradient direction of the loss function, while its iterative variant I-FGSM [ 11 ] significantly enhances both attack effectiveness and visual similarity through carefully controlled multi-step gradient updates within \epsilon -constraints. Figure 1 visualizes this process, demonstrating an adversarial image generated via I-FGSM applied to Inception-v3 [ 9 ] . In a black-box attack , where the target model’s architecture and parameters are unknown, basic gradient-based methods such as the FGSM [ 10 ] and I-FGSM [ 11 ] often fail to deceive the model effectively. To address this, transfer attacks are commonly employed, which generate adversarial examples using surrogate models to attack the target model. Refined variants, such as Momentum Iterative FGSM (MI-FGSM) [ 12 ] and Nesterov Iterative FGSM (NI-FGSM) [ 5 ] , enhance transferability through advanced gradient update strategies—momentum-based stabilization and Nesterov-style lookahead, respectively. These approaches adaptively refine perturbations, thereby reducing overfitting to the surrogate and enhancing generalization across diverse model architectures [ 11 ] . However, traditional gradient-based methods still rely on hand-crafted iterative gradient directions, which may suboptimally explore the perturbation space and limit transferability. Beyond gradient-based approaches, machine learning-based adversarial attack methods leverage generative models or evolutionary algorithms [ 13 , 14 , 15 , 16 , 17 , 18 , 19 ] . Among them, Adversarial Generative Adversarial Networks (AdvGAN) [ 13 ] and its variants [ 14 , 16 , 18 ] have emerged as powerful alternatives. The generator \mathcal{G} in these methods maps clean inputs to perturbations, i.e., \boldsymbol{x}\mapsto\mathcal{G}(\boldsymbol{x})=\delta(\boldsymbol{x}) , while a discriminator ensures perturbations remain imperceptible. The trained generator achieves efficient adversarial example generation through direct inference, eliminating iterative optimization overhead. While AdvGAN is effective in generating adversarial examples, it struggles to balance visual similarity and adversarial transferability. AdvGAN employs dynamic distillation rather than transfer-attacks for black-box scenarios [ 13 ] , but shows limited transfer efficiency. Moreover, AdvGAN often introduces excessive perturbations, thereby sacrificing visual similarity in favour of higher attack success rates (ASR) [ 20 ] . To address this, we adopt a dynamical systems perspective inspired by the iterative nature of gradient-based attacks, model adversarial example generation as a continuous evolution process. Specifically, unlike iterative gradient-based methods relying on manual updates, we employ Neural Ordinary Differential Equations (NODEs) [ 21 ] to automatically learn per-step perturbations for adversarial example generation. NODEs enable dynamic and continuous transformations of input images, allowing finer control over perturbations, which may improve both perceptual similarity and attack robustness. In addition, we propose a new training strategy that significantly improves the transferability of the generated adversarial examples across diverse model architectures. Through the combination of these two techniques, our model demonstrates a significant improvement in generating adversarial examples with higher visual similarity and enhanced ASR in both white-box and black-box settings. Our Contribution This work aims to generate adversarial images with higher ASR, improved visual similarity, and enhanced transferability. These images can be combined with the original training set as an augmented dataset to enhance model robustness. Our key innovation lies in modelling the adversarial example generation process as a continuous evolution, employing a NODE network to generate perturbations, thereby yielding our proposed NODE-AdvGAN model. Additionally, we introduce a novel training strategy to enhance transferability further in our model, referred to as NODE-AdvGAN-T. A dynamic-system perspective The generation of adversarial examples can be interpreted as a continuous-time dynamic process, where an initial benign image is gradually transformed into its adversarial counterpart. Observing the iterative updates in I-FGSM ( 7 ), MI-FGSM ( 8 ), and NI-FGSM ( 9 ), we recognize that some traditional adversarial attack methods implicitly define discrete dynamical systems through perturbation updates. This process structurally resembles the numerical approximation for solving a Ordinary Differential Equation (ODE) with some handcrafted forcing function F(\cdot) . Note that such manual designs remain suboptimal for solving the functional extremum problem in Eqn. ( 2 ) due to heuristic limitations. Unlike gradient-based methods that rely on manual selection of discrete update rules, we model the perturbation evolution using a NODE framework: \dot{\boldsymbol{v}}(t)=F(t,\boldsymbol{v},\boldsymbol{y},{\boldsymbol{\Theta}_{\textbf{NODE}}}),\quad\boldsymbol{v}(0)=\boldsymbol{x},\quad\boldsymbol{v}(T)=\boldsymbol{x}_{\text{adv}}, (3) where the function F represents the learnable vector field guiding the perturbation process, and \boldsymbol{\Theta}_{\textbf{NODE}} denotes the set of trainable parameters in the neural network that parametrizes F . This formulation may offer several advantages: 1. Smoothness in the Optimization Process. Continuous-time models as in Eqn. (3) produce smooth perturbation trajectories, allowing gradual rather than abrupt updates. This enables finer control over perturbation budget, yielding