Does simple trump complex? Comparing strategies for adversarial robustness in DNNs
William Brooks, Marelie H Davel, Coenraad Mouton · 2025
Read Does simple trump complex? Comparing strategies for adversarial robustness in DNNs by William Brooks, Marelie H Davel, Coenraad Mouton (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-18019.txt.
Introduction
Neural networks can be fooled by tiny changes to their inputs, and many training tricks claim to make them harder to fool. William Brooks, Marelie H Davel, and Coenraad Mouton ask in this 2025 paper whether a simple trick works as well as a complex one. Both tricks aim to widen the margin, the gap between a data point and the line where the model changes its answer.
Using a VGG-16 model on the CIFAR-10 image set, the team took each method apart and tested its pieces one by one. They measured how well each version stood up to two standard attacks. The results show which parts of the complex method truly add strength and which add little. That guidance can help builders design sturdier models without extra bulk.
Catalog record
| CREATOR | William Brooks, Marelie H Davel, Coenraad Mouton |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-18019
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Does simple trump complex? Comparing strategies for adversarial robustness in DNNs William Brooks, Marelie H Davel, Coenraad Mouton Abstract Deep Neural Networks (DNNs) have shown substantial success in various applications but remain vulnerable to adversarial attacks. This study aims to identify and isolate the components of two different adversarial training techniques that contribute most to increased adversarial robustness, particularly through the lens of margins in the input space – the minimal distance between data points and decision boundaries. Specifically, we compare two methods that maximize margins: a simple approach which modifies the loss function to increase an approximation of the margin, and a more complex state-of-the-art method (Dynamics-Aware Robust Training) which builds upon this approach. Using a VGG-16 model as our base, we systematically isolate and evaluate individual components from these methods to determine their relative impact on adversarial robustness. We assess the effect of each component on the model’s performance under various adversarial attacks, including AutoAttack and Projected Gradient Descent (PGD). Our analysis on the CIFAR-10 dataset reveals which elements most effectively enhance adversarial robustness, providing insights for designing more robust DNNs. 1 Introduction Deep neural networks (DNNs) have transformed numerous fields and have achieved remarkable success in tasks ranging from image classification to natural language processing. Despite their widespread adoption, DNNs are inherently vulnerable to adversarial perturbations – small perturbations to the input data that lead a deep learning model to misclassify the input, often with high confidence [ 19 ] . This vulnerability poses challenges where reliability and security of machine learning models are paramount. The exact reason for the susceptibility of DNNs to these perturbations remains unknown and is an ongoing area of research. Several methods have been developed to generate adversarial examples and evaluate the robustness of DNNs [ 6 , 7 , 15 , 16 ] . Popular attack algorithms, such as Projected Gradient Descent (PGD) [ 15 ] , have become standard tools for testing the robustness of machine learning models. These attack algorithms aim to exploit the vulnerability of neural networks to adversarial examples and current research aims to improve the robustness of DNNs, by building defenses to such perturbations [ 2 , 3 , 17 , 22 ] . Popular defences against adversarial attacks, such as Adversarial Training (AT) [ 10 , 15 ] , aim to enhance the robustness of these models by explicitly exposing them to adversarial examples during training. Despite being effective, this approach is computationally expensive as it requires generating adversarial perturbations during training and does not guarantee robustness against all types of attacks. Margin-based techniques, while often similarly computationally expensive, have been explored as an alternative due to their ability to offer a better robustness-accuracy trade-off compared to methods like PGD adversarial training [ 9 , 26 ] . Margin-based techniques focus on increasing the margin – the minimum distance between a sample and its decision boundary – in the input space. Large margins in the input space have been shown to be correlated with improved adversarial robustness of DNNs [ 8 ] . The work by Xu et al. [ 26 ] and Elsayed et al. [ 9 ] primarily focused on increasing margins, utilizing innovative approaches to margin maximization (MM) of DNNs. Elsayed et al. introduced a novel loss function based on the first-order Taylor approximation of the margin, which maximizes the margin at any layer, demonstrating improvements in adversarial robustness. Xu et al. built on this concept by identifying the vulnerability of data points with smaller margins and proposing Dynamics-Aware Robust Training (DyART), a technique that prioritizes increasing these smaller margins in the input space. DyART achieved near state-of-the-art performance on benchmarks such as RobustBench [ 5 ] improving on recognized baselines such as AT [ 15 ] , TRADES [ 27 ] , MMA [ 8 ] , GAIRAT [ 28 ] , MAIL [ 21 ] and AWP [ 24 ] under various perturbation bounds. Both the approaches by Elsayed et al. [ 9 ] and Xu et al. [ 26 ] focus on MM and introduce loss functions for increasing margins in the input space to improve the adversarial robustness of DNNs. Despite the progress made by these margin-based techniques, the techniques themselves are complex and it is not clear which elements most contribute to enhancing adversarial robustness. To address this question, we conduct a detailed analysis of the adversarial robustness of models trained using the techniques proposed by Xu et al. and Elsayed et al. We use AutoAttack [ 7 ] , a state-of-the-art evaluation method, to systematically compare the performance of these methods and identify the key factors contributing to their robustness. The primary contributions of this study are as follows: 1. An evaluation of the adversarial robustness of models trained using Xu et al. and Elsayed et al.’s techniques, 2. Identification of the impactful components of these methods in enhancing adversarial robustness, 3. Insights into the aspects which matter when constructing adversarially robust classifiers. The remainder of this paper is organized as follows: Section 2 provides an overview of adversarial training, margin-based techniques, and the work by Xu et al. [ 26 ] and Elsayed et al. [ 9 ] . Section 3 describes the approach followed to disentangle the effects of the underlying elements of each technique and describes the individual components analysed. Section 4 describes the experimental setup, while the results of the analysis are presented in Section 5 . 2 Background In this section, we provide background information on adversarial training and the two main methods we consider. First (Section 2.1 ) we provide a brief introduction to adversarial training in general, and how the robustness of a model is typically evaluated. Following this, we describe how margins are defined and discuss the commonalities of adversarial training techniques that maximize margins (Section 2.2 ). Finally, we provide an overview of the MM methods of Elsayed et al. and Xu et al. in Sections 2.3 and 2.4 , respectively. 2.1 Adversarial Training and Evaluation Adversarial examples pose a considerable challenge to the robustness of deep neural networks (DNNs). The vulnerability of DNNs to these adversarial examples has sparked significant research into methods that can mitigate their effect. Although AT is the standard approach for enhancing the robustness of classifiers, it often results in a decrease in clean accuracy (accuracy when considering standard samples, not adversarially manipulated ones), a phenomenon known as the accuracy-robustness trade-off [ 20 ] . Therefore, current research aims to develop robust training methods able to provide the best possible robustness to adversarial attacks with as little possible drop in performance on clean examples. This is an active area of research and many methods have been proposed [ 8 , 26 , 27 ] . Conversely, the goal of adversarial attack algorithms are to fool a classifier by slightly perturbing clean examples. This has led to a research arms race where stronger adversarial attacks are developed to fool robust training methods, examples of which are Projected Gradient Descent (PGD) [ 15 ] , Fast Adaptive Boundary (FAB) [ 6 ] , DeepFool [ 16 ] , Fast Gradient Sign Method (FGSM) [ 10 ] , and the Carlini&Wagner (C&W) attack [ 4