A combination of noise and bilateral filters achieve supralinear and scalable adversarial robustness in CNNs

Nicolas Stalder [email protected] Benjamin F. Grewe [email protected], Matteo Saponati [email protected] Pau Vilimelis Aceituno [email protected] Institute of NeuroinformaticsETH Zürich, University of ZürichWinterthurerstrasse 190, 8057 Zürich, Switzerland · 2026

Read A combination of noise and bilateral filters achieve supralinear and scalable adversarial robustness in CNNs by Nicolas Stalder [email protected] Benjamin F. Grewe [email protected], Matteo Saponati [email protected] Pau Vilimelis Aceituno [email protected] Institute of NeuroinformaticsETH Zürich, University of ZürichWinterthurerstrasse 190, 8057 Zürich, Switzerland (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02267.txt.

Introduction

Stalder and co-authors harden image classifiers by combining two simple preprocessing steps. Deep networks can be fooled by adversarial examples, which is a real risk when such systems are deployed. Training against attacks works well but costs a lot of compute, and it is tuned to the attack types it has seen. Adding Gaussian noise or filtering the image each help a bit, but only modestly on their own.

Theory in the paper shows the two tricks work through different mechanisms that complement each other. When they are combined, the gain in robustness is supralinear, more than the sum of the parts. A simple preprocessor that adds Gaussian noise and then applies a bilateral filter is tested on CNNs. The experiments confirm the combined effect. The method offers robustness without the cost of adversarial training.

Catalog record

CREATORNicolas Stalder [email protected] Benjamin F. Grewe [email protected], Matteo Saponati [email protected] Pau Vilimelis Aceituno [email protected] Institute of NeuroinformaticsETH Zürich, University of ZürichWinterthurerstrasse 190, 8057 Zürich, Switzerland
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.02267

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A combination of noise and bilateral filters achieve supralinear and scalable adversarial robustness in CNNs Nicolas Stalder [email protected] Benjamin F. Grewe [email protected], Matteo Saponati [email protected] Pau Vilimelis Aceituno [email protected] Institute of NeuroinformaticsETH Zürich, University of ZürichWinterthurerstrasse 190, 8057 Zürich, Switzerland Abstract The vulnerability of deep neural networks to adversarial examples poses a significant challenge for real-world deployment. Existing techniques to enhance deep network robustness rely on adversarial training, an approach that is powerful but computationally intensive and typically tailored to specific attack types. To address these limitations, existing works have explored techniques such as adding gaussian noise or filtering images, both of which can boost the network robustness to various adversarial attacks, albeit modestly. Here, we theoretically demonstrate that these two approaches enhance robustness against adversarial attacks through complementary mechanisms, resulting in supralinear robustness when combined. Building on this insight, we experimentally show that a simple preprocessor combining Gaussian noise and bilateral filtering yields supralinear improvements in adversarial robustness with minimal computational cost. Next, we combine our preprocessor with adversarial training and test on RobustBench to assess its supralinear improvement over state-of-the-art defenses. First, this combination ranks second on AutoAttack and third overall, while using only ∼ \sim 35% of the training FLOPs, using a model with 50% less parametets, trained with ∼ \sim 33% of the epochs and ∼ \sim 15% the data compared to state-of-the-art defenses. Second, our method scales efficiently, matching the accuracy of competing models with roughly 2–8× less total compute across ∼ \sim 3 orders of magnitude. Overall, our approach provides a principled and easily integrable framework for enhancing adversarial robustness, offering negligible computational overhead and a simple yet theoretically grounded design. 1 Introduction A decade ago, Convolutional Neural Networks (CNNs) achieved superhuman performance in object recognition tasks 10 ; 33 ; 26 . However, targeted pixel-level perturbations of the original image can cause CNNs to make incorrect predictions 6 ; 23 , while being often imperceptible to humans 9 . These adversarial attacks (AAs) present a significant challenge when CNNs are used to solve real-world problems, for example, self-driving systems, 40 , facial recognition 50 ; 30 , and many others. Adversarial training remains one of the most effective defenses against such attacks 23 ; 51 , but it is computationally expensive, needing around 9x more floating point operations (FLOPs) 4 and therefore scaling poorly with model size. Additionally, its robustness is tied to attacks seen during training 49 , which can lead to difficulties when deploy in real-world scenarios. In contrast, simple filtering techniques or image corruptions using additive noise can improve robustness to certain adversarial attacks with minimal computational cost 57 . However, no single filtering or image corruption method has proven broadly effective across various attack types (see Section 2 for details). Importantly, these approaches have largely been developed in isolation, and a systematic evaluation of their combined effect on adversarial robustness is still lacking. Motivated by these observations, we asked whether a simple, theoretically grounded combination of filtering and additive noise could enhance adversarial robustness while easily integrating with existing defense methods. We address this question both mathematically and with extensive experiments with both standard CNNs and state-of-the-art models, making the following contributions: 1. We show mathematically that Gaussian noise and filtering enhance adversarial robustness through distinct mechanisms, and their combination protects against a broad class of attacks (Section 4 ). 2. We verify this result empirically, showing that Gaussian noise and filters can yield a supralinear gain in adversarial robustness (Section 5.1 ). 3. When combined with adversarial training, we achieve +0.6% higher robust accuracy compared to the previous state-of-the-art, while using only \sim 35% of the training FLOPs (Section 5.2 ). 4. Our preprocessor scales efficiently across model sizes, reducing the training compute needed to reach competitive robustness by up to 15× (Section 5.2 ).. 2 Related work We review existing defense mechanisms against adversarial attacks, which we group these methods into three categories that are particularly relevant to this work. Introducing artificial samples in the training dataset . Introducing artificial samples into the training data is a commonly used strategy in machine learning, and also includes the most prominent adversarial defense method. The most prominent approach integrates adversarial examples into the training process 23 ; 39 ; 52 , generally referred to as adversarial training. These defenses, when combined with synthetic data generated by diffusion models 51 ; 4 , currently represent the SotA on visual datasets 12 . However, their applicability in real-world scenarios is limited due to the high computational cost of adversarial training, which requires increasingly large and better artificial datasets to maintain effectiveness 4 . Moreover, they may fail to defend against perturbations not encountered during training and in some cases, even increase susceptibility to such attacks 49 , necessitating costly retraining whenever new attack types emerge. Noise addition during training also belongs to this category. Simpler techniques such as Gaussian, Poisson, or uniform noise addition during training can improve robustness to adversarial attacks 46 ; 19 , while also enhancing a network’s resilience to noise at inference time 46 ; 35 ; 11 . Additive noise and random transformation methods . The second category encompasses methods that introduce randomness at inference time to inhibit adversarial attacks by making gradients unreliable. This randomness can be implemented via various techniques: noise addition to input data 46 , noise addition within the network 35 ; 11 , random input transformations such as resizing 53 , or applying a randomly selected transformation from a set 41 . To mitigate the accuracy degradation introduced by randomness, these methods often incorporate additional mechanisms. First, they train models with noise to improve the inference accuracy under noise addition 46 ; 35 ; 11 . Second, they employ ensembles of stochastic models, which classify samples via majority vote 11 ; 35 ; 34 . However, ensemble methods drastically increase computational cost during inference, limiting their practicality in real-time or resource-constrained settings. Filtering methods . In the third category, adversarial perturbations are filtered out through various means. These include simple methods like Gaussian filtering 57 and bilateral filtering 48 ; 42 , as well as more complex image processing strategies such as JPEG compression 25 ; 17 ; 15 . Another line of work employs denoising neural networks (NNs) 36 ; 24 , which can enhance robustness but come with significant computational overhead during both training and inference. A further key limitation of NN-based preprocessors is their own vulnerability to adversarial attacks, which can undermine their defensive effectiveness 24 . More recent work explores combining noise addition with denoising NNs 7 . This approach leverages the synergy between added noise and subsequent denoising to improve robust accuracy, as the denoiser simultaneously attenuates adversarial perturbations and filters out the introduced noise. Combining filtering and additive noise. Our preprocessor combines bilateral filtering (a filtering methods) and Gaussian noise addition (a type of additive noise perturbation) during both training and inference. Thus, our approach is effectively a combination of the three defense mechanisms described above. To the best of our knowledge, such combination has not yet been explored, nor has the joint use of any simple noise and filtering methods applied during both training

Read the complete text