The Spectrum Strikes Back: Infrared POV Attacks on Traffic Sign Classification ∗ Both authors contributed equally to this work.

Michael Kühr ∗ , Mevlüt Yildirim ∗ , Maximilian Luedecke, Mohammad Hamad, Sebastian Steinhorst · 2026

Read The Spectrum Strikes Back: Infrared POV Attacks on Traffic Sign Classification ∗ Both authors contributed equally to this work. by Michael Kühr ∗ , Mevlüt Yildirim ∗ , Maximilian Luedecke, Mohammad Hamad, Sebastian Steinhorst (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30153.txt.

Introduction

Michael Kühr, Mevlüt Yildirim, and three colleagues attack traffic sign classifiers with light that humans cannot see. Self-driving cars rely on cameras to read road signs. Most physical attacks stick visible patches on signs. This team instead uses near-infrared light and persistence of vision. Rapid flashes paint content that cameras register but people miss.

The display can show dynamic content and be triggered remotely. Digital simulation first finds the best position for the device. Real-world tests then use two different traffic signs. Twelve machine learning models from several families face the attack. Distances reach twenty meters, under varied lighting conditions. Attack success rates run high across the test scenarios. The authors propose defenses on two levels. Near-infrared cutoff filters block the light physically. A software detector spots the attack's traces in images.

Catalog record

CREATORMichael Kühr ∗ , Mevlüt Yildirim ∗ , Maximilian Luedecke, Mohammad Hamad, Sebastian Steinhorst
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.30153

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Spectrum Strikes Back: Infrared POV Attacks on Traffic Sign Classification ∗ Both authors contributed equally to this work. Michael Kühr ∗ , Mevlüt Yildirim ∗ , Maximilian Luedecke, Mohammad Hamad, Sebastian Steinhorst Abstract Traffic sign classification is a crucial task for autonomous vehicles, and numerous attacks against it have been identified. A majority of physical adversarial attacks involve attaching patches to traffic signs or projecting perturbations on them. While they demonstrate high effectiveness, they are perceptible to humans. At the same time, light-based attacks outside the human visible spectrum are known but have limitations in their dynamic adaptability. We propose a persistence-of-vision-based attack that operates in the near-infrared light spectrum. With the possibility of showing dynamic, remotely triggered content, this allows a stealthy physical adversarial attack against traffic sign classification. By identifying the optimal position through digital simulation, we conduct extensive real-world evaluations using two different traffic signs, 12 machine learning models from different families, multiple distances up to 20 meters, and varying illumination conditions. Our evaluation shows high attack success rates across our test scenarios. We propose near-infrared cutoff filters and a software-based detection mechanism as defenses, and tackle limitations of the near-infrared persistence of vision display by prototyping a human-visible RGB version of it. CMOS Complementary Metal-Oxide-Semiconductor POV persistence of vision LED light-emitting diode ML Machine Learning PWM pulse-width modulation PCB printed circuit board ASR attack success rate GTSRB German Traffic Sign Recognition Benchmark TN true negative TP true positive BFS breadth-first search I Introduction While autonomous vehicles are becoming reality [ 35 , 53 ] , the attack surface of such cars increases with the integration of perception sensors [ 57 , 19 , 15 ] , such as LiDARs or cameras. Among these sensors, cameras are often used as a single source of information for tasks like traffic sign detection, lane detection, or traffic light recognition [ 19 , 25 ] . As a result, camera-based perception has become a critical target for attacks. Specifically, physical adversarial attacks have been investigated by different research communities [ 21 , 54 , 4 , 30 ] . Fig. 1 : Infrared-based persistence of vision displays are a physical adversarial attack that can target traffic sign classification while being stealthy to humans. We identify the optimal placement through a digital simulation to ensure high attack success. As a result, traffic sign classifiers will misclassify the sign. These attacks against camera-based perception have been explored using a wide range of techniques, including printed stickers on traffic signs [ 17 ] , projector-based attacks [ 33 ] , or light-based attacks in the human-visible [ 13 ] and invisible spectrum [ 44 , 51 ] . Such attacks target the ML ( ML ) models that are used in autonomous vehicles to perform tasks such as traffic sign detection. Among them, attacks operating outside the human-visible spectrum are particularly concerning, as they show high stealthiness and are difficult or impossible to detect by humans [ 51 ] . Previous studies identified that autonomous vehicles can perceive light sources in this infrared spectrum [ 44 , 51 ] . Additionally, infrared-sensitive cameras are already used in driver assistance systems to increase perception in nighttime scenarios [ 3 ] and are being researched by the automotive industry for use in adverse environmental conditions [ 41 ] . This makes near-infrared attacks both practical and safety-critical. However, existing infrared-based physical attacks face important limitations: They rely on static perturbations or continuous light emission [ 51 ] and often require high-power laser beams [ 44 ] . As a result, these attacks lack flexibility, do not support selective triggering, and offer limited adaptability once deployed, which restricts their practicality in real-world settings. Motivated by the limitations of existing physical adversarial attacks in Table I , we introduce a new physical adversarial attack based on a dynamically reconfigurable and triggerable infrared light source . As shown in Figure 1 , we realize this attack using a POV ( POV ) display that operates in the near-infrared spectrum and can display dynamic, remotely triggered adversarial patterns. Unlike prior infrared attacks, our POV display does not rely on high-power lasers [ 44 ] but instead operates using commercially available infrared LED [ 29 ] . By leveraging fast rotation, we exploit the POV mechanism, and our POV display shows spatially structured infrared patterns without relying on static physical patches. This design enables three key capabilities that distinguish our attack from prior work (i) the attack can display dynamically reconfigurable content, allowing adaptation to different target assets and models without redeployment (ii) it can be selectively activated by controlling the infrared LED while maintaining rotation, enabling the adversarial effect without permanently altering the appearance of the traffic sign (iii) it remains highly stealthy, as the emitted infrared light is invisible to human observers and the rotating POV display appears transparent when inactive. These properties differentiate our approach from static physical attacks such as stickers [ 17 ] and from human-visible projections [ 33 ] . TABLE I : Comparison of existing physical attacks with our POV display attack. Attack Dynamic Triggered Stealth Remote Transferable RP 2 [ 17 ] ✗ ✗ ✗ ✓ ✗ SLAP [ 33 ] ✓ ✓ ✗ ✓ ✓ AdvLB [ 13 ] ✗ ✓ ✗ ✓ ✗ ILR attack [ 44 ] ✗ ✓ ✓ ✓ ✓ ICSL Attack [ 51 ] ✗ ✓ ✓ ✓ ✗ Ours ( POV display) ✓ ✓ ✓ ✓ ✓ To deploy this attack reliably, we provide a digital simulation to identify the optimal placement of freely configurable content in the POV display on a traffic sign. By applying different transformations [ 2 ] within our digital simulation, we ensure that our attack shows high robustness under different physical conditions, such as varying distances and illumination conditions. This simulation-driven placement optimization is critical for real-world effectiveness. Guided by the simulation results, we conduct extensive real-world evaluations across different traffic signs, POV display sizes, illumination conditions, and 12 ML models spanning multiple architectures and training datasets, demonstrating high ASR . To mitigate this threat, we evaluate both a hardware-based defense using near-infrared cutoff filters and a software-based detection mechanism that exploits sensor-specific spectral artifacts. Finally, we discuss the broader implications of POV-based attacks and show that similar threats can also arise when deploying POV displays in the human-visible spectrum. In summary, our contributions are: • Reconfigurable and triggerable infrared attack: We present a physical adversarial infrared POV display attack that enables high stealthiness and dynamically reconfigurable, remotely triggerable perturbations against camera-based perception. • Digital simulation of our POV display attack: We digitally simulate of our attack to identify the optimal positioning of the POV display. • Extensive real-world evaluation: By performing physical tests with varying distances, displayed content, POV display sizes, and ML models, we comprehensively evaluate our attack and demonstrate its effectiveness. • Defense against our attack, including evaluation: We propose defense and detection methods to protect traffic sign classification models against our POV display attack. II Background This section introduces background information on infrared light and the POV effect on which our attack is based. II-A Infrared Characteristics of Cameras Typical CMOS ( CMOS ) image

Read the complete text