Adversarial Examples in Environment Perception for Automated Driving
Jun Yan, Huilin Yin🖂 · 2025
Read Adversarial Examples in Environment Perception for Automated Driving by Jun Yan, Huilin Yin🖂 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08414.txt.
Introduction
Jun Yan and Huilin Yin present a 2025 review of adversarial examples in the perception systems of self-driving cars. Deep neural networks read cameras and sensors to spot lanes, signs, and obstacles. Tiny crafted changes to those inputs, invisible to people, can flip a network's answer and create real danger on the road.
The review surveys a decade of work on such attacks and the defenses built against them. Attack types range from altered images to physical objects placed in the scene. Defenses include training on attacked inputs and checking inputs at run time. The authors map what is known, where gaps remain, and why robust perception is central to trustworthy driving systems.
Catalog record
| CREATOR | Jun Yan, Huilin Yin🖂 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-08414
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adversarial Examples in Environment Perception for Automated Driving Jun Yan, Huilin Yin🖂 Abstract The renaissance of deep learning has led to the massive development of automated driving. However, deep neural networks are vulnerable to adversarial examples. The perturbations of adversarial examples are imperceptible to human eyes but can lead to the false predictions of neural networks. It poses a huge risk to artificial intelligence (AI) applications for automated driving. This survey systematically reviews the development of adversarial robustness research over the past decade, including the attack and defense methods and their applications in automated driving. The growth of automated driving pushes forward the realization of trustworthy AI applications. This review lists significant references in the research history of adversarial examples. 1 Introduction Deep learning has been hugely successful over the past decade, powered by Graph Processing Units (GPUs), big data, and human intelligence. This success has spurred an artificial intelligence (AI) renaissance, enabling amazing applications like chat assistants, embodied robotics, and autonomous driving. In the past decade, AI technologies have matured enough for autonomous driving to be productized. The Society of Automotive Engineers (SAE) categorizes driving levels from no automation (Level 0) to full automation (Level 5), aiming for fully autonomous driving [ 1 ] . With AI advancements, some countries have introduced decrees for testing fully autonomous systems. Figure 1: The growth of papers related to adversarial robustness [ 2 ] @Nicholas Carlini’s Blog. However, deep neural networks are vulnerable to adversarial attacks [ 3 , 4 , 5 , 6 ] where slight raw data perturbations fool networks into wrong predictions. Many pieces of research have delved into the exploration to promote AI security, including attacks [ 3 , 4 , 5 ] , defenses [ 6 , 7 ] , systematic evaluations [ 8 , 9 , 10 ] , and interpretations [ 11 , 12 ] . Fig. 1 shows huge research interest in adversarial robustness, although valuable scientific problems may be saturated. This saturation validates the impact and significant of the adversarial robustness research. The issue of adversarial examples relates to the security risks of cyber-physical systems. In these systems, adversarial examples can serve as malicious data in the Internet of Vehicles. For instance, an automated vehicle’s decision-making system can be misled by maliciously modifying a traffic sign. These adversarial examples reveal AI systems’ vulnerabilities, inducing wrong decisions and potential security risks. Understanding adversarial examples’ characterization and creation is critical for designing secure cyber-physical systems and ensuring the information systems’ robustness. Meanwhile, other security and privacy risks also harm AI technologies’ trustworthiness. Fig. 2 shows a macro story of AI technology risks. Adversarial examples primarily threaten during the inference phase of AI systems. Despite the importance of paying attention to other AI risks, this survey mainly reviews the research history of adversarial examples. Giving attention to adversarial robustness research is critical to advancing the development of intelligent vehicles. The existence of adversarial examples poses a huge threat to the tasks of automated driving, including traffic sign recognition [ 13 ] , vehicle detection [ 14 ] , trajectory prediction [ 15 ] , LiDAR perception [ 16 ] , lane segmentation [ 17 ] , and SLAM (Simultaneous Localization and Mapping) [ 18 ] . Fig. 3 demonstrates the adversarial vulnerability risk towards the automated driving, which indicates the necessity to advance the research on adversarial robustness. This review introduces adversarial examples’ theories, methods, and automated driving applications. In particular, it focuses on the adversarial examples related to the environment perception systems for automated driving. Section 2 interprets fundamental concepts. Section 3 describes representative adversarial attack methods. Section 4 recalls adversarial defense methods. Section 5 introduces adversarial examples in automated driving applications. Section 6 highlights adversarial examples’ relationship to the Safety of the Intended Functionality (SOTIF). Section 7 provides a future outlook for adversarial robustness research. Finally, Section 8 concludes the review. Figure 2: Deep learning systems and the encountered attacks. Adversarial attacks happen in the model prediction process. Figure 3: The threat of adversarial examples in the practical tasks of automated driving. 2 Theory Preliminary Table 1: Notations & Explanations Symbol Description x_{0} A clean sample \tilde{x_{i}} An adversarial example \mathbf{x} The vectors of clean data \mathbf{y} The vectors of labels \mathbf{\tilde{x}} The vectors of adversarial examples \epsilon The perturbation budget \mathcal{B}(x_{0},\epsilon) The neighborhood ball of x_{0} with radius of \epsilon x^{\prime} A sample in \mathcal{B}(x_{0},\epsilon) \mathbf{x^{\prime}} The vector sample in \mathcal{B}(x_{0},\epsilon) y_{0} The groundtruth label \mathbf{I} The unit matrix \nabla_{z}J(\cdot) The gradient of a scalar function J with respect to \mathbf{z} f_{\mathbf{\Theta}} The neural network function with the parameter space \mathbf{\Theta} \delta The added perturbation \|\boldsymbol{x}\|_{p}(p\geq 1) The vector p -norm of \boldsymbol{x}=\left[x_{1}\mid,\ldots,x_{d}\right] , defined as \|x\|_{p}=\left(\sum_{i=1}^{d}\left|x_{i}\right|^{p}\right)^{1/p} \|x\|_{\infty} infinity norm of \boldsymbol{x}=\left[x_{1}\mid,\ldots,x_{d}\right] , defined as \|x\|_{\infty}=\max_{i\in[d]}\left|x_{i}\right| \mathcal{L}(\boldsymbol{\cdot}) The adversarial loss function K The number of classes in a classification task L The Lipschitz constant \odot Hadamard product This section reviews the essential concepts and theory preliminary in the adversarial examples research. Table 1 gives essential notations which would be utilized to illustrate the studies. The following subsections review the mechanisms of gradient-based adversarial attacks, adversarial training, and randomized smoothing. 2.1 Gradient-based Adversarial Attacks Given the original examples \mathbf{x_{0}} , a successful adversary aims to find the relative adversarial examples \mathbf{\tilde{x}}=\mathbf{{x}_{0}}+\mathbf{\Delta} that can deceive the visual system with the small perturbation \mathbf{\Delta} . It is a constrained optimization problem that the adversarial examples locate in the norm sphere of original examples defined in Eq. ( 1 ): \underset{\mathbf{\tilde{x}}}{\operatorname{argmax}}f(\mathbf{\tilde{x}})\text{ s.t. }\mathbf{\tilde{x}}\in\mathcal{B}\left(\mathbf{x}_{0}\right), (1) where f(\mathbf{\tilde{x}}) denotes the deceit on the classifier function f(.) and \mathcal{B}\left(\mathbf{x}_{0}\right) is a small region (norm sphere) with the adversarial perturbations. The norm sphere \mathcal{B}\left(\mathbf{x}_{0}\right) is also a constrained set that the \ell_{p} norm can measure the distance defined in Eq. ( 2 ): \mathcal{B}\left(\mathbf{x}_{0}\right)=\left\{\mathbf{\tilde{x}}:\left\|\mathbf{\tilde{x}}-\mathbf{x}_{0}\right\|_{p}\leq\epsilon\right\}. (2) An original groundtruth label is y_{0} . There exist two types of attack categories. If the adversarial example \tilde{x}_{i} belongs to a specific class y_{t} , this is a targeted attack defined in Eq. ( 3 ): \underset{{\tilde{x}_{i}}}{\operatorname{argmax}}f({\tilde{x}_{i}})=y_{t}. (3) This means that the adversary induces the model to misclassify the data as the specific wrong label. Otherwise, it is an untargeted attack defined in Eq. ( 4 ): \underset{{\tilde{x}_{i}}}{\operatorname{argmax}}f({\tilde{x}_{i}})\neq y_{0}. (4) In such a scenario, the adversary induces the model to misclassify the data as the unspecific wrong label. The gradient-based attack is a \ell_{\infty} -norm steepest descent attack. The adversary utilizes a linear approximation of the objective function to search for the perturbations. Assumed that g(.) is an attack procedure, \mathbf{x} and \mathbf{x^{\prime}} is a batch of clean data and the searched examples in the neighborhood of \mathbf{x} . Eq. ( 5 ) defines the linear approximation of first-order Taylor expansion. g(\mathbf{x^{\prime}})\approx g\left(\mathbf{x}\right)+\nabla g\left(\mathbf{x}\right)^{T}\left(\mathbf{x^{\prime}}-\mathbf{x}\right). (5) A closed-form solution defined in Eq. ( 6 )of this constrained optimization problem can be derived: \mathbf{x}^{\prime}=\mathbf{x}+\epsilon\operatorname{sign}\left(\nabla g\left(\mathbf{x}\right)\right). (6) The symbol \operatorname{sign}(\cdot)\in\{+1,-1\} denotes element-wise sign values. Eq. ( 6 ) is a mathematical form of the fast gradient sign method (FGSM), which is a milestone work of AI security. The FGSM attack pipeline can realize both untargeted and targeted attacks. If the adversary runs the FGSM method for multiple iterations T , Eq. ( 7 ) can be deduced: \boldsymbol{x}_{t+1}=\Pi\left(\boldsymbol{x}_{t}+\alpha\operatorname{sign}\left(\nabla