NatADiff: Adversarial Boundary Guidance for Natural Adversarial Diffusion

Max Collins, Jordan Vice, Tim French, Ajmal Mian · 2025

Read NatADiff: Adversarial Boundary Guidance for Natural Adversarial Diffusion by Max Collins, Jordan Vice, Tim French, Ajmal Mian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20934.txt.

Introduction

Max Collins and co-authors craft photo fakes that trip image tools in a more life-like way. Most past fakes are boxed by tight rules and look off from the slips tools make in the wild. Wild slips often smuggle bits of the wrong class into a shot, which lets the tool take a short cut. Their 2025 method, NatADiff, steers a paint model toward the seam of the true and wrong classes.

Time-hop sampling and beefed class guides steer the paint run. Hit rates match top past tools, the team finds. Shots stay more true to life than boxed fakes by their checks. Such fakes can teach labs what cues a tool leans on. That lesson feeds guards that hold in the wild, not just in the lab.

Catalog record

CREATORMax Collins, Jordan Vice, Tim French, Ajmal Mian
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE147 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20934

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

NatADiff: Adversarial Boundary Guidance for Natural Adversarial Diffusion Max Collins, Jordan Vice, Tim French, Ajmal Mian Abstract Adversarial samples exploit irregularities in the manifold “learned” by deep learning models to cause misclassifications. The study of these adversarial samples provides insight into the features a model uses to classify inputs, which can be leveraged to improve robustness against future attacks. However, much of the existing literature focuses on constrained adversarial samples, which do not accurately reflect test-time errors encountered in real-world settings. To address this, we propose ‘NatADiff’, an adversarial sampling scheme that leverages denoising diffusion to generate natural adversarial samples. Our approach is based on the observation that natural adversarial samples frequently contain structural elements from the adversarial class. Deep learning models can exploit these structural elements to shortcut the classification process, rather than learning to genuinely distinguish between classes. To leverage this behavior, we guide the diffusion trajectory towards the intersection of the true and adversarial classes, combining time-travel sampling with augmented classifier guidance to enhance attack transferability while preserving image quality. Our method achieves comparable white-box attack success rates to current state-of-the-art techniques, while exhibiting significantly higher transferability across model architectures and improved alignment with natural test-time errors as measured by FID. These results demonstrate that NatADiff produces adversarial samples that not only transfer more effectively across models, but more faithfully resemble naturally occurring test-time errors when compared with other generative adversarial sampling schemes. 1 Introduction Deep learning models can react unpredictably when there is domain difference between training and test data ( Szegedy et al., 2014 ; Goodfellow et al., 2015 ) . Constrained adversarial attacks exploit this vulnerability, adding visually imperceptible pixel-level perturbations to deliberately fool models into misclassification ( Szegedy et al., 2014 ; Goodfellow et al., 2015 ; Madry et al., 2018 ; Croce and Hein, 2020 ) . More recently, unconstrained adversarial attacks have been proposed which allow for unrestricted perturbation magnitudes, provided the resulting adversarial image lies sufficiently close to the natural image manifold ( Song et al., 2018 ; Chen et al., 2023a ; Chen et al., 2023b ) . Defences to these attacks have been proposed ( Szegedy et al., 2014 ; Madry et al., 2018 ; Gu and Rigazio, 2015 ; Xu et al., 2018 ; Samangouei et al., 2018 ; Nie et al., 2022 ) ; however, they largely target attacks formed by adding perturbations to natural images–overlooking the existence of natural adversarial samples. Natural adversarial samples are more commonly known as test-time errors, and they represent the strongest class of unconstrained adversarial attack, as they are valid (perturbation-free and naturally occurring) model inputs that are erroneously classified ( Hendrycks et al., 2021 ) . The absence of an adversarial perturbation renders many defensive measures ineffective ( Agarwal et al., 2022 ) . Furthermore, natural adversarial samples have been widely studied in the literature, and they have been found to exhibit high transferability–where multiple classifiers incorrectly classify the same sample ( Hendrycks et al., 2021 ) . It is hypothesized that this is caused by classifiers independently learning to rely on the same erroneous contextual cues to shortcut classification and reduce training losses without generalising to the underlying task ( Hendrycks et al., 2021 ; Geirhos et al., 2020 ; Arjovsky et al., 2020 ) . Generating natural adversarial samples offers an opportunity to better understand the mechanisms underpinning test-time errors. Prior work has sought to achieve this by using classifier gradients to perturb the sampling process of generative adversarial networks (GANs) and denoising diffusion models ( Song et al., 2018 ; Chen et al., 2023b ; Dai et al., 2024 ; Chen et al., 2025 ) . However, GAN-based approaches lack theoretical justification for perturbing the sample path, and doing so often degrades image quality ( Karras et al., 2019 ; Abdal et al., 2019 ) . Alternatively, directly injecting classifier gradients into the diffusion sampling trajectory can result in generating constrained adversarial samples ( Vaeth et al., 2024 ; Shen et al., 2024 ) (see Figure 1 (c)). Moreover, existing methods do not account for the link between learned erroneous contextual cues and test-time errors. We propose NatADiff , a highly transferable, diffusion-based ( Ho et al., 2020 ; Song et al., 2021a ) adversarial sample generation method. NatADiff leverages the link between contextual cues and test-time errors by guiding the diffusion sampling trajectory towards the intersection of the adversarial and true classes, a technique we define as “adversarial boundary guidance”. Additionally, we incorporate classifier augmentations to reduce the strength of the constrained adversarial perturbation and to further guide the sampling trajectory towards regions of the image manifold that incorporate features from the adversarial class. We find that NatADiff-generated samples achieve comparable white-box (same target and victim classifier) attack success rates to current state-of-the-art adversarial attacks, while exhibiting significantly higher transferability (different target and victim classifier) across models. Furthermore, samples generated using NatADiff align more closely with known test-time errors (with respect to their Fréchet inception distance (FID) ( Fréchet, 1957 ) ) than those generated through adversarial classifier guidance alone ( Dai et al., 2024 ) . These results demonstrate that NatADiff produces adversarial samples that not only transfer more effectively across models, but more faithfully resemble naturally occurring test-time errors. To summarize our contributions: (i) We propose NatADiff, incorporating classifier transformations, gradient normalization, and time-travel sampling ( Shen et al., 2024 ; Lugmayr et al., 2022 ; Yu et al., 2023 ) to improve adversarial classifier guidance and image quality; (ii) We design an adversarial boundary guidance algorithm to reliably navigate the complex, learned manifold, allowing us to generate natural adversarial samples with significantly higher transferability than existing approaches. (iii) We explore how convolution and transformer based classifiers perceive natural adversarial samples, exposing interesting properties of the feature representations learned by deep learning models. 2 Definitions and Preliminaries Constrained, unconstrained, and natural adversarial samples. Broadly speaking there are three categories of adversarial sample: unconstrained, constrained, and natural. Let f:\mathcal{I}_{\mathcal{U}}\rightarrow\mathcal{Y} be a trained image classifier, \mathcal{I}_{\mathcal{U}} be the set of allowable image inputs, \mathcal{I}_{\mathcal{N}}\subseteq\mathcal{I}_{\mathcal{U}} be the set of natural images, \mathcal{Y} be the set of image classification labels, and \mathcal{O}:\mathcal{I}_{\mathcal{U}}\rightarrow\mathcal{Y} be an oracle (“perfect” human) classifier. Unconstrained adversarial samples require only that the image is misclassified: \mathcal{A}_{U}\triangleq\{x\in\mathcal{I}_{\mathcal{U}}:f(x)\neq\mathcal{O}(x)\} ( Song et al., 2018 ) . Constrained adversarial samples are restricted to an \epsilon -neighbourhood about some natural image: \mathcal{A}_{C}\triangleq\{x+\delta\in\mathcal{I}_{\mathcal{U}}:x\in\mathcal{I}_{\mathcal{N}},\lVert\delta\rVert_{p}\leq\epsilon,f(x+\delta)\neq\mathcal{O}(x+\delta)\} ( Szegedy et al., 2014 ) . Natural adversarial samples are natural images that are misclassified: \mathcal{A}_{N}\triangleq\{x\in\mathcal{I}_{\mathcal{N}}:f(x)\neq\mathcal{O}(x)\} ( Hendrycks et al., 2021 ) . Finally, it follows from the above definitions that \mathcal{A}_{\mathcal{N}}\subseteq\mathcal{A}_{\mathcal{C}}\subseteq\mathcal{A}_{\mathcal{U}} . Natural adversarial samples are a well-documented phenomenon in deep learning ( Hendrycks et al., 2021 ) . Literature suggests that they typically occur when deep learning models learn to rely on erroneous contextual cues to shortcut classification, as opposed to truly learning to distinguish between classes ( Hendrycks et al., 2021 ; Geirhos et al., 2020 ; Arjovsky et al., 2020 ) (see Appendix E for examples). These cues are typically features within an image that are highly correlated with a target class but not indicative of the class. For instance, a model that uses oceanic environments as a cue for predicting “shark”

Read the complete text