Adversarial Universal Stickers: Universal Perturbation Attacks on Traffic Sign using Stickers

Anthony Etim, Jakub Szefer · 2025

Read Adversarial Universal Stickers: Universal Perturbation Attacks on Traffic Sign using Stickers by Anthony Etim, Jakub Szefer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-18724.txt.

Introduction

Etim and Szefer show how plain black and white stickers can fool road sign readers in this twenty twenty-five paper. Most past attacks needed a fresh trick mark for each image, which is slow and hard to use. A shared mark that works on many signs at once would pose a much larger risk.

Inside, the authors build one set of sticker marks that can be placed the same way on many types of signs. They test the marks on street view photos rather than on real signs on real roads. The marks fool common sign-reading models at a high rate on United States sign data. The work flags a cheap and real risk for self-driving cars.

Catalog record

CREATORAnthony Etim, Jakub Szefer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-18724

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adversarial Universal Stickers: Universal Perturbation Attacks on Traffic Sign using Stickers Anthony Etim, Jakub Szefer Abstract . Adversarial attacks on deep learning models have proliferated in recent years. In many cases, a different adversarial perturbation is required to be added to each image to cause the deep learning model to misclassify it. This is ineffective as each image has to be modified in a different way. Meanwhile, research on universal perturbations focuses on designing a single perturbation that can be applied to all images in a data set, and cause a deep learning model to misclassify the images. This work advances the field of universal perturbations by exploring universal perturbations in the context of traffic signs and autonomous vehicle systems. This work introduces a novel method for generating universal perturbations that visually look like simple black and white stickers, and using them to cause incorrect street sign predictions. Unlike traditional adversarial perturbations, the adversarial universal stickers are designed to be applicable to any street sign: same sticker, or stickers, can be applied in same location to any street sign and cause it to be misclassified. Further, to enable safe experimentation with adversarial images and street signs, this work presents a virtual setting that leverages Street View images of street signs, rather than the need to physically modify street signs, to test the attacks. The experiments in the virtual setting demonstrate that these stickers can consistently mislead deep learning models used commonly in street sign recognition, and achieve high attack success rates on dataset of US traffic signs. The findings highlight the practical security risks posed by simple stickers applied to traffic signs, and the ease with which adversaries can generate adversarial universal stickers that can be applied to many street signs. 1. Introduction Deep Neural Networks (DNNs) have revolutionized machine learning applications, yet they remain inherently vulnerable to adversarial perturbations – subtle, often imperceptible modifications to input data that can drastically alter model predictions ( Chakraborty et al. 2018 ) . First identified by Szegedy et al. ( Szegedy 2013 ) , these adversarial examples expose fundamental weaknesses in deep learning models, particularly in safety-critical domains like autonomous driving, biometric authentication, and medical imaging ( Goodfellow et al. 2014 ) , ( Kumar et al. 2024 ) . As DNNs continue to be integrated into real-world applications, their susceptibility to adversarial attacks raises significant concerns about security, reliability, and trustworthiness. One of key domains where DNNs can be applied is autonomous vehicles, where street sign recognition can be easily done by the DNN to help an autonomous vehicle navigate physical world. Unfortunately, adversarial perturbations can prevent correct street sign recognition or classification. Existing adversarial perturbation work has been applied in the context of traffic sign recognition and object detection, and attackers have demonstrated various perturbation strategies. Existing attacks include physical sticker attacks ( Eykholt et al. 2018 ) where various stickers are placed on street signs to cause the street sign to not be correctly recognized. More recent work on adversarial shadows ( Zhong et al. 2022 ) shows that light shadows can achieve same effect; the shadows are simple, however, generating them in practice may be difficult, e.g., on a cloudy day. Other work has shown light-based manipulations ( Hsiao et al. 2024 ) where bright light spots are shone on street signs to cause them to be misclassified. All of these attacks leverage model vulnerabilities to induce erroneous street sign predictions. These attacks highlight not only the fragility of DNN-based perception systems but also the practical feasibility of adversarial manipulations in physical environments. One limitation of the attacks is that the perturbations are specific to each traffic sign. In other setting, universal adversarial perturbations (UAPs) have been shown to pose a particularly severe threat, as they can fool a model across multiple inputs with a single, input-agnostic perturbation ( Moosavi-Dezfooli et al. 2017 ) . Unlike targeted adversarial attacks, including the existing ones that attack street signs ( Eykholt et al. 2018 ; Zhong et al. 2022 ; Hsiao et al. 2024 ) , UAPs generalize across diverse samples, significantly compromising model robustness in real-world scenarios ( Weng et al. 2024 ) . In this work, we investigate the impact of universal adversarial perturbations (UAPs) on the specific case of traffic sign classification systems. We focus on the design of simple black and white stickers, and find how these stickers can be placed at a common coordinate on any street sign to cause it to be misclassified. Our experiments demonstrate that a single location can be exploited across multiple sign types to consistently induce misclassification, highlighting a critical vulnerability in deep learning-based recognition systems. Without a need for a complex perturbation, a simple black or white sticker can cause a street sign to be misclassified and have the machine learning model generate confidence score of up to 90%. Further, unlike targeted attacks that require sign-specific modifications, our findings reveal that single location where one or two stickers are located on any traffic sign can cause misclassification, enabling a universal attack strategy that generalizes across different street signs. Further, to enable safe experimentation with adversarial images and street signs, this work presents a virtual setting that leverages Street View images of street signs, rather than need to physically modify street signs, to test the attacks. Due to practical constraints, and considering potential safety issues, actual street signs were not used nor modified for this work. The attacks are evaluated by modifying images from Street View. This further demonstrates that attackers can leverage easily accessible Street View images to test their attacks and find the locations for the adversarial universal stickers to place on the street signs. Our insights have significant implications for the security of autonomous driving systems, as the suggests that attackers can design efficient, low-cost perturbations capable of misleading a model without requiring precise adjustments for each individual sign. Additionally, our results emphasize the need for more robust defense mechanisms that account for spatially invariant attack strategies, as current adversarial training and input transformation techniques may fail against universal perturbations that exploit shared model weaknesses. 1.1. Contributions The contributions of this work are as follows: (1) We demonstrate the first example of universal perturbation attacks targeting specifically street signs. (2) We show that it is possible to enable safe experimentation with adversarial images and street signs by using a virtual setting that leverages Street View images of real street signs, without need to actually modify real signs – which may be illegal or dangerous. (3) We demonstrate that a simple black or white sticker located strategically on the face of the street sign can cause misclassification with confidence score (of the incorrect classification) as high as 90%. (4) We show that for single or double white or black stickers it is possible to find common coordinates on the tested street sign such that each street sign is misclassified. 2. Background In this section, we provide a brief overview of adversarial attacks and the LISA dataset, which contains images of U.S. street signs. We also discuss LISA-CNN, the victim machine learning model used for street sign classification in this work. While we utilize LISA-CNN, we apply it to

Read the complete text