TAIGen: Training-Free Adversarial Image Generation via Diffusion Models

Susim Roy, Anubhooti Jain, Mayank Vatsa, Richa Singh · 2025

Read TAIGen: Training-Free Adversarial Image Generation via Diffusion Models by Susim Roy, Anubhooti Jain, Mayank Vatsa, Richa Singh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15020.txt.

Introduction

Susim Roy, Anubhooti Jain, Mayank Vatsa, and Richa Singh introduce, in twenty twenty-five, a training-free method to craft adversarial images with diffusion models. Adversarial images are tweaked pictures that fool classifiers. Past generative attacks made poor images and cost much compute. Diffusion models make fine images but need hundreds of steps. Their method, TAIGen, needs only a handful of steps from an unconditional diffusion model, with no training. Its key insight is that tweaks injected at a middle mixing stage work as well as tweaks at every stage.

A channel strategy applies attention maps to one color channel and guided tweaks to the other two. Image quality stayed high. Attack success against several target models was strong, and generation was ten times faster.

Catalog record

CREATORSusim Roy, Anubhooti Jain, Mayank Vatsa, Richa Singh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15020

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TAIGen: Training-Free Adversarial Image Generation via Diffusion Models Susim Roy, Anubhooti Jain, Mayank Vatsa, Richa Singh Abstract Adversarial attacks from generative models often produce low-quality images and require substantial computational resources. Diffusion models, though capable of high-quality generation, typically need hundreds of sampling steps for adversarial generation. This paper introduces TAIGen, a training-free black-box method for efficient adversarial image generation. TAIGen produces adversarial examples using only 3-20 sampling steps from unconditional diffusion models. Our key finding is that perturbations injected during the mixing step interval achieve comparable attack effectiveness without processing all timesteps. We develop a selective RGB channel strategy that applies attention maps to the red channel while using GradCAM-guided perturbations on green and blue channels. This design preserves image structure while maximizing misclassification in target models. TAIGen maintains visual quality with PSNR above 30 dB across all tested datasets. On ImageNet with VGGNet as source, TAIGen achieves 70.6% success against ResNet, 80.8% against MNASNet, and 97.8% against ShuffleNet. The method generates adversarial examples 10× faster than existing diffusion-based attacks. Our method achieves the lowest robust accuracy, indicating it is the most impactful attack as the defense mechanism is least successful in purifying the images generated by TAIGen. 1 Introduction Figure 1 : Images with their adversarially attacked counterparts. The first column is the clean images. The second is adversarial images generated using BPDA+EOT attack for the CelebA-HQ and AutoAttack for the ImageNet datasets. The third column is the adversarial images generated using our proposed TAIGen attack. Diffusion models have quickly become a cornerstone in generative AI and their performance has surpassed the previous benchmarks in many tasks [ 15 , 12 , 6 ] . Diffusion models have shown to be successful in overcoming the issues faced by previous models such as training instabilities by GANs or the limited expressiveness by the autoregressive models. Additionally, the semantic space of diffusion models stays consistent over the timesteps [ 31 ] which can be used for image manipulation without re-training. They have been utilized to generate adversarial examples, which can lead deep learning models to fail at their intended tasks. Some works have explored generating adversarial samples using diffusion models [ 27 , 56 , 33 ] . As can be seen in Figure 1 , the different attack methods add unwanted artifacts to certain regions in faces(top row) and in multi-subject images(bottom row) affecting it’s quality. However, most of them are unrestricted in nature and utilize diffusion models in a white-box setting. They also utilize almost all the timesteps involved in the diffusion generation process which is inefficient. Finally, those methods have not fully utilized the underlying variation of the training dataset stored in the model which undermines the generative capability. We propose a training-free method, TAIGen, that utilizes only a handful of timesteps to generate adversarial examples in a quick and robust manner by selectively modifying the RGB channels of the image. We first find the significant timesteps by using key timestep [ 60 ] for convergence of Gaussian distribution to the data distribution. We further take advantage of attention maps as well as GradCAMs [ 44 ] to perturb the images. The RGB channels are modified selectively with this information as discussed later in detail. We showcase the performance of the proposed algorithm on three datasets – CIFAR-10, CelebA-HQ, and ImageNet datasets along with GradCAM analysis for the resulting adversarial images. 2 Related Work Figure 2 : The proposed TAIGen adversarial attack where masked GradCAM and Attention Map are utilized for N time steps in an iterative manner. We also use MI-FGSM [ 16 ] during the iteration to introduce momentum guidance. The DDPM Sampler denotes the noise prediction model and the backward process scheduler as a single unit. In this section, we review the current landscape for different adversarial attacks and purification methods. Adversarial Attacks: Adversarial Attacks continue to mislead deep learning models. Current research has shown the impressive success of adversarial attacks on a variety of models and modalities. The attacks can be categorized as white, gray, and black-box attacks based on the information available to the attacker about the source model. Further, they can be categorized based on their formulation as gradient-based, patch-based, and semantic-based methods. The adversarial perturbation can be solved as a constrained optimization problem, like FGSM [ 18 ] , PGD [ 36 ] , or CW [ 7 ] attacks, they are restricted by l_{p} -norm and utilize gradients of the source model. These attacks have been further improved by using parameters like momentum in MI-FGSM [ 16 ] or AdaMSI-FGM [ 34 ] attacks. Another way is to target semantic space to create adversarial examples for more natural samples like ColorFool [ 45 ] . These adversarial samples can also be generated, as has been done using VAEs, GANs [ 48 , 55 , 29 ] , and more recently, diffusion models. With GANs, there are attacks like the Latent-HSJA attack [ 38 ] , which generates unrestricted adversarial examples in a black-box setting, or the GMAA attack [ 32 ] , which creates a whole adversarial manifold over a point-wise generation. Owing to the poor quality of generated samples, especially on high-quality datasets, Diffusion models have been used instead of GANs to generate the adversarial samples. The models can utilize gradients as in AdvDiff [ 13 ] , a training-free method, where PGD gradients are injected into the sampling of generative models giving two novel guidance techniques called adversarial and noise sampling guidance for adversarial example generation. AdvDiffuser [ 9 ] also generates unrestricted adversarial examples and utilizes GradCAM [ 44 ] to retain important regions, only perturbing the less important ones. Even for face recognition systems, diffusion models have been used for generation. Adv-Diffusion [ 33 ] is one such attack that protects face identity by masking them using a reference image via a latent diffusion model. Another approach is Diff-AM [ 50 ] , which is a diffused-based adversarial makeup transfer method used for face protection by first having a text-guided makeup removal module, followed by image-guided adversarial makeup transfer. An ensemble of face recognition models is used as the attack strategy within this method. DiffAttack [ 27 ] is an attack that breaks diffusion-based adversarial purification methods by proposing a novel deviated reconstruction loss. These diffusion-based attacks are able to generate high-quality adversarial samples, however, with our work, we propose a training-free, less-time-consuming diffusion-based generation attack. Adversarial Defense and Purification: With attack, several defense strategies have also been proposed in the literature, and similar to adversarial attacks, a variety of architectures can be utilized to defend against adversarial samples. Adversarial training still remains one of the most effective defense techniques. A self-supervised adversarial training method, CAFD [ 59 ] , was proposed to remove adversarial noise in the class activation space. Another adversarial training method [ 41 ] was proposed using generative models with a disentangled latent space to generate low, mid, and high-level changes in the samples. Several works have also studied adversarial robustness and detection in face recognition, including efforts on universal perturbation detection [ 1 ] , attack-agnostic perturbation detectors [ 2 ] , and robustness analysis of deep models against adversarial

Read the complete text