Evaluating the Impact of Adversarial Attacks on Traffic Sign Classification using the LISA Dataset
Nabeyou Tadessa 1 (Student), Balaji Iyangar 2 (Associate Professor), Mashrur Chowdhury 3 (Professor) · 2025
Read Evaluating the Impact of Adversarial Attacks on Traffic Sign Classification using the LISA Dataset by Nabeyou Tadessa 1 (Student), Balaji Iyangar 2 (Associate Professor), Mashrur Chowdhury 3 (Professor) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06835.txt.
Introduction
Traffic sign classifiers can be fooled by nearly invisible tweaks, and Nabeyou Tadessa and two co-authors quantify that risk in a 2025 computer vision paper. Adversarial attacks add carefully crafted perturbations that flip a model's answer. Most earlier studies used simple digit datasets rather than real driving imagery.
A convolutional neural network was trained to classify forty-seven kinds of traffic signs from the LISA dataset. Two standard attacks were applied: the fast gradient sign method, a one-step perturbation, and projected gradient descent, a stronger iterative version. Accuracy fell sharply as perturbation size grew, showing clear susceptibility to adversarial examples. The authors present the study as groundwork for defenses tailored to real-world traffic sign recognition, where a fooled classifier is a safety problem rather than a curiosity.
Catalog record
| CREATOR | Nabeyou Tadessa 1 (Student), Balaji Iyangar 2 (Associate Professor), Mashrur Chowdhury 3 (Professor) |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06835
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating the Impact of Adversarial Attacks on Traffic Sign Classification using the LISA Dataset Nabeyou Tadessa 1 (Student), Balaji Iyangar 2 (Associate Professor), Mashrur Chowdhury 3 (Professor) Abstract Adversarial attacks pose significant threats to machine learning models by introducing carefully crafted perturbations that cause misclassification. While prior work has primarily focused on MNIST and similar datasets, this paper investigates the vulnerability of traffic sign classifiers using the LISA Traffic Sign dataset. We train a convolutional neural network to classify 47 different traffic signs and evaluate its robustness against Fast Gradient Sign Method (FGSM) and Projected Gradient Descent (PGD) attacks. Our results show a sharp decline in classification accuracy as the perturbation magnitude increases, highlighting the model’s susceptibility to adversarial examples. This study lays the groundwork for future exploration into defense mechanisms tailored for real-world traffic sign recognition systems. I Introduction Deep learning models have achieved remarkable success in a wide range of applications, including image classification, natural language processing, and autonomous driving. Despite their impressive performance, these models are vulnerable to adversarial attacks, which are small, intentionally crafted perturbations that can cause the model to make incorrect predictions with high confidence. Research on adversarial robustness has focused primarily on standard benchmark datasets such as MNIST, CIFAR-10, and ImageNet. However, the real-world implications of adversarial attacks extend beyond simple datasets to safety-critical domains such as traffic sign recognition, where misclassifications can have severe consequences. In this paper, we investigate adversarial vulnerabilities in a traffic sign classification system using the LISA Traffic Sign dataset. We train a convolutional neural network to recognize 47 different traffic sign categories and evaluate the model’s robustness against two popular white-box attack methods: Fast Gradient Sign Method (FGSM) and Projected Gradient Descent (PGD). By analyzing how classification accuracy degrades under adversarial perturbations of varying magnitudes, we aim to better understand the risks of deploying deep learning models in real-world autonomous systems. This work replicates the methodology of previous studies conducted on simpler datasets, but adapts the evaluation to a more complex and practically relevant dataset. The findings serve as a baseline for future research on defense mechanisms tailored to traffic sign recognition tasks. II Related Work Adversarial attacks on machine learning models were first brought to attention by Szegedy et al. (2014), who showed that deep neural networks could be easily fooled by adding small, imperceptible perturbations to the input data, leading to misclassifications. Building on this, Goodfellow et al. (2015) introduced the Fast Gradient Sign Method (FGSM), a computationally efficient white-box attack that uses the model’s gradients to craft adversarial examples. Subsequently, Madry et al. (2018) proposed Projected Gradient Descent (PGD), a more powerful iterative variant of FGSM that identifies stronger adversarial inputs within a defined perturbation bound. These foundational works have spurred extensive research into adversarial robustness, including adversarial training, detection mechanisms, and certified defenses (Athalye et al., 2018; Cohen et al., 2019). However, most evaluations have centered on relatively simple and controlled datasets such as MNIST and CIFAR-10, limiting the generalizability of findings. In contrast, complex, real-world datasets like the LISA Traffic Sign dataset—which includes traffic signs under varying illumination and environmental conditions—have received limited attention in adversarial robustness research. To address this gap, our work applies established attack methodologies to the LISA dataset, aiming to assess the vulnerability of traffic sign recognition systems in more realistic settings. III Dataset and Classifier Description III-A LISA Traffic Sign Dataset The LISA Traffic Sign dataset is a widely used benchmark for evaluating traffic sign recognition models in real-world scenarios. It comprises over 7,800 annotated video frames captured from a vehicle-mounted camera in urban environments, encompassing 47 distinct classes of U.S. traffic signs, such as Stop, Speed Limit, Yield, and No U-Turn signs (Mogelmose et al., 2012). The dataset is particularly valued for its realistic driving conditions, including variations in illumination, weather, motion blur, camera angles, and partial occlusions, which more closely mimic the challenges faced by autonomous driving systems in real-time deployment. Unlike synthetic or standardized datasets such as MNIST or GTSRB (German Traffic Sign Recognition Benchmark), the LISA dataset is characterized by significant intra-class variability and environmental noise, making it more challenging and better suited for evaluating robust deep learning models (Laroca et al., 2021). Images are typically resized to 128×128 pixels to meet the input dimension requirements of modern convolutional neural networks (CNNs), ensuring computational feasibility and compatibility with pretrained architectures. For experimental consistency, the dataset is divided into training and testing subsets that preserve the original class distribution, which is crucial for preventing class imbalance biases and for conducting fair performance evaluations using metrics such as accuracy, precision, recall, and F1-score (Zhu et al., 2016). Several studies have used the LISA dataset to develop and benchmark approaches such as multi-scale CNNs, attention mechanisms, and domain adaptation techniques that aim to improve detection and classification accuracy in unconstrained environments. III-B Convolutional Neural Network Classifier We employ a custom-designed convolutional neural network (CNN) architecture to perform multi-class classification over a dataset comprising 47 distinct traffic sign categories. CNNs have been widely adopted for image classification tasks due to their ability to automatically learn hierarchical feature representations from raw image data (LeCun et al., 1998; Krizhevsky et al., 2012). Our architecture is inspired by standard deep learning practices for traffic sign recognition (Ciresan et al., 2012; Sermanet, LeCun, 2011), and is deliberately kept compact to facilitate adversarial robustness analysis. The network consists of three convolutional layers with increasing depth, employing 32, 64, and 128 filters respectively, each with a kernel size of 3×3. Every convolutional operation is followed by a Rectified Linear Unit (ReLU) activation function to introduce non-linearity, and a 2×2 max-pooling layer to downsample the feature maps, thereby reducing computational complexity and promoting spatial invariance. This progressively abstracts features from low-level edges and textures to higher-level semantic patterns, as observed in typical CNN hierarchies (Zeiler, Fergus, 2014). The extracted features are then flattened and passed through two fully connected (dense) layers. The final layer outputs a 47-dimensional softmax probability vector, corresponding to the classification confidence scores for each traffic sign class. Training is carried out using the Adam optimizer (Kingma, Ba, 2015), with an initial learning rate of 0.001. The loss function used is categorical cross-entropy, a standard choice for multi-class classification problems. To enhance convergence and model stability, input images are normalized across all RGB channels to have a mean of 0.5 and a standard deviation of 0.5. This normalization step ensures that input values are centered and scaled appropriately, which is known to accelerate training and reduce internal covariate shift (Ioffe, Szegedy, 2015). This model serves as our baseline classifier and is subsequently used to assess the impact of adversarial perturbations in a controlled evaluation setting. We explore how imperceptible perturbations can degrade classification performance, a phenomenon first highlighted in the work of Szegedy et al. (2014) and further developed by Goodfellow et al. (2015) in the context of adversarial machine learning. IV Attack Methods IV-A Fast Gradient Sign Method (FGSM) The Fast Gradient Sign Method (FGSM) is one of the most widely used adversarial attack techniques. Introduced by Goodfellow et al., FGSM generates adversarial examples by adding a perturbation to the original input image in the direction of the gradient of