NERO-Net: A Neuroevolutionary Approach for the Design of Adversarially Robust CNNs CCS: Computing methodologies Neural networks CCS: Computing methodologies Bio-inspired approaches CCS: Security and privacy Software and application security

Inês Valentim, Nuno Antunes, Nuno Lourenço · 2026

Read NERO-Net: A Neuroevolutionary Approach for the Design of Adversarially Robust CNNs CCS: Computing methodologies Neural networks CCS: Computing methodologies Bio-inspired approaches CCS: Security and privacy Software and application security by Inês Valentim, Nuno Antunes, Nuno Lourenço (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25517.txt.

Introduction

Valentim, Antunes, and Lourenço evolve neural networks that resist attacks by shape, not by extra training. Most defense work hardens weights, while the wiring itself goes unsearched. NERO-Net breeds convolutional nets whose plain-trained forms keep high scores under attack. Its fitness rewards post-attack accuracy without losing clean accuracy. The best net holds 87 percent clean and a third of its score under a fast attack. Plain retraining lifts those to 93 and 47 percent. Hard training on top reaches forty against a strong attack suite.

Catalog record

CREATORInês Valentim, Nuno Antunes, Nuno Lourenço
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51367
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25517

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

NERO-Net: A Neuroevolutionary Approach for the Design of Adversarially Robust CNNs CCS: Computing methodologies Neural networks CCS: Computing methodologies Bio-inspired approaches CCS: Security and privacy Software and application security Inês Valentim, Nuno Antunes, Nuno Lourenço Abstract . Neuroevolution automates the complex task of neural network design but often ignores the inherent adversarial fragility of evolved models which is a barrier to adoption in safety-critical scenarios. While robust training methods have received significant attention, the design of architectures exhibiting intrinsic robustness remains largely unexplored. In this paper, we propose NERO-Net, a neuroevolutionary approach to design convolutional neural networks better equipped to resist adversarial attacks. Our search strategy isolates architectural influence on robustness by avoiding adversarial training during the evolutionary loop. As such, our fitness function promotes candidates that, even trained with standard (non-robust) methods, achieve high post-attack accuracy without sacrificing the accuracy on clean samples. We assess NERO-Net on CIFAR-10 with a specific focus on L ∞ L_{\infty} -robustness. In particular, the fittest individual emerged from evolutionary search with 33% accuracy against FGSM, used as an efficient estimator for robustness during the search phase, while maintaining 87% clean accuracy. Further standard training of this individual boosted these metrics to 47% adversarial and 93% clean accuracy, suggesting inherent architectural robustness. Adversarial training brings the overall accuracy of the model up to 40% against AutoAttack. 1. Introduction The ubiquity of Artificial Neural Networks (ANNs) means that the vulnerabilities of these models have also become the center of attention of malicious actors. In the image domain, a critical vulnerability lies in adversarial examples ( 19 ; 37 ) : inputs containing small perturbations designed to deceive ANNs and induce misclassifications. Humans are often immune to these attacks, since the perturbed samples tend to be visually indistinguishable from their clean counterparts. This vulnerability has triggered an arms race, with adversarial training ( 30 ) (i.e., augmenting training data with adversarial examples) emerging as the standard defense. While alternatives like adversarial detection ( 31 ) exist, research remains skewed toward robust learning and regularization ( 32 ) , largely overlooking the potential of intrinsically robust architectures. While NeuroEvolution (NE) automates complex architecture design, it has historically prioritized predictive performance over robustness. The limited literature addressing this gap often makes compromising decisions to manage computational costs. Specifically, the prevalent use of cell-based search spaces with fixed backbones ( 32 ; 17 ; 13 ) restricts the emergence of novel topologies, while the integration of adversarial training ( 20 ) during the search conceals the architecture’s contribution to robustness. To address these limitations, we propose a N euro E volutionary approach for the design of adversarially RO bust artificial neural Net works (NERO-Net). We introduce novel mechanisms at the evaluation level, employing a fitness function that co-optimizes adversarial and clean performance. Candidate solutions undergo standard training, ensuring that the resulting robustness is intrinsic to the architecture rather than a by-product of adversarial training. Focusing on image classification tasks and the design of robust Convolutional Neural Networks (CNNs), we show NERO-Net’s efficacy on CIFAR-10 ( 28 ) . Under restricted evolutionary training budgets, the fittest individual achieved 33% adversarial accuracy (FGSM adversary in L_{\infty} ) and 87% clean accuracy. Extended standard training improved these metrics to 47% and 93%, respectively. When further refined via adversarial training, the model reached \sim 40% robust accuracy against AutoAttack. Remarkably, the discovered architecture exhibits multi-threat robustness, resisting L_{2} -bounded perturbations despite being optimized solely for an L_{\infty} threat model. In summary, our contributions are: • We propose NERO-Net , a neuroevolutionary framework that employs specialized fitness evaluation mechanisms to co-optimize accuracy and adversarial robustness; • We introduce a flexible genotypic representation that expands the search space by encoding tunable computational blocks and supporting a wider spectrum of topological connectivity patterns ; • We demonstrate that evolution can successfully navigate this complex landscape to discover architectures exhibiting intrinsic robustness , independent of specialized defenses. The remainder of this paper is organized as follows. Section 2 introduces key concepts related to adversarial robustness and Section 3 reviews related work. Section 4 details the proposed approach. The experimental setup and the main findings of our experiments are presented and discussed in Sections 5 and 6 , focusing on the evolutionary search and on further training after evolution, respectively. Section 7 concludes the paper and addresses future work. 2. Adversarial Robustness In the image domain, an adversarial example x^{adv} ( 19 ; 37 ) is typically generated by adding small L_{p} -norm perturbations to a benign sample x , such that \|x-x^{adv}\|_{p}\leq\epsilon , where \epsilon is the perturbation budget and usually p\in\left\{0,1,2,\infty\right\} ( 5 ; 15 ) . Although x^{adv} is similar to the clean sample, the model gives it a highly different (and incorrect) prediction ( 37 ; 18 ) . Considering an untargeted setting (a sample is misclassified as any incorrect class ( 6 ) ) where the attacker has full access to the model, the Fast Gradient Sign Method (FGSM) ( 19 ) is a one-step gradient-based attack defined as follows for the L_{\infty} -norm: x^{adv}=x+\epsilon\cdot\sign\left(\nabla_{x}L(x,y)\right) where y is the true label, \nabla_{x}L(x,y) is the gradient of the cross-entropy (CE) loss with respect to the clean image and x^{adv} is clipped to the valid data range. The Projected Gradient Descent (PGD) method ( 30 ) is an iterative, and stronger, variant of FGSM with smaller update steps. The starting point of the attack is usually a randomly perturbed sample (bounded by \epsilon ) around the original input x ( 30 ) . The APGD method ( 9 ) further extends the PGD attack to progressively reduce the step size in an automated way, based on how the optimization is proceeding. A momentum term is also added, allowing the previous update to influence the current one. These attacks can be adapted to the L_{2} -norm ( 31 ) : the clipping operation is changed to the projection onto the L_{2} -ball, and each update step follows the direction of the normalized gradient, i.e., \frac{\nabla_{x}L(x,y)}{\left\|\nabla_{x}L(x,y)\right\|_{2}} . A targeted version of the attacks can also be obtained by minimizing the loss for a specific target class, instead of maximizing it for the true class. Heuristic approaches that approximate the robustness of a model by performing adversarial attacks are the standard evaluation practice ( 7 ) , since exact computations are usually intractable ( 5 ; 7 ) . AutoAttack (AA) ( 9 ) stands out among these approaches and tests adversarial robustness through an ensemble of diverse attacks: an untargeted APGD attack on the CE loss, an APGD attack on the targeted version of the Difference of Logits Ratio (DLR) loss, a targeted Fast Adaptive Boundary (FAB) attack ( 8 ) , as well as a Square attack ( 1 ) . It is adopted by the RobustBench ( 7 ) benchmark, which uses standardized evaluation methodologies to keep track of the progress made in adversarial robustness. 3. Related Work There is a body of work in the literature that specifically explores the relationship between architecture and adversarial robustness ( 24 ; 25 ; 34 ) . That is the case of the work by 24 ( 24 ) , which focuses on evaluating the impact of

Read the complete text