Adversarial Robustness Analysis of Cloud-Assisted Autonomous Driving Systems
Maher Al Islam and Amr S. El-Wakeel · 2026
Read Adversarial Robustness Analysis of Cloud-Assisted Autonomous Driving Systems by Maher Al Islam and Amr S. El-Wakeel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-04349.txt.
Introduction
Al Islam and El-Wakeel probe cross-layer attacks on cloud-assisted driving, where perception and control run on remote servers. They build a hardware testbed joining real-time perception, control and communication. A cloud YOLOv8 detector faces white-box Fast Gradient Sign Method and Projected Gradient Descent attacks, while network foes add delay and packet loss. Attacks badly degrade perception, with Projected Gradient Descent cutting precision and recall to roughly a third. Delays of 150 to 250 milliseconds and packet loss up to 5 percent destabilize control, delaying actuation and breaking rules.
Catalog record
| CREATOR | Maher Al Islam and Amr S. El-Wakeel |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22881 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.04349
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adversarial Robustness Analysis of Cloud-Assisted Autonomous Driving Systems Maher Al Islam and Amr S. El-Wakeel Abstract Autonomous vehicles increasingly rely on deep learning–based perception and control, which impose substantial computational demands. Cloud-assisted architectures offload these functions to remote servers, enabling enhanced perception and coordinated decision-making through the Internet of Vehicles (IoV). However, this paradigm introduces cross-layer vulnerabilities, where adversarial manipulation of perception models and network impairments in the vehicle–cloud link can jointly undermine safety-critical autonomy. This paper presents a hardware-in-the-loop IoV testbed that integrates real-time perception, control, and communication to evaluate such vulnerabilities in cloud-assisted autonomous driving. A YOLOv8-based object detector deployed on the cloud is subjected to white-box adversarial attacks using the Fast Gradient Sign Method (FGSM) and Projected Gradient Descent (PGD), while network adversaries induce delay and packet loss in the vehicle–cloud loop. Results show that adversarial perturbations significantly degrade perception performance, with PGD reducing detection precision and recall from 0.73 and 0.68 in the clean baseline to 0.22 and 0.15 at ϵ = 0.04 \epsilon=0.04 . Network delays of 150–250 ms, corresponding to transient losses of approximately 3–4 frames, and packet loss rates of 0.5–5% further destabilize closed-loop control, leading to delayed actuation and rule violations. These findings highlight the need for cross-layer resilience in cloud-assisted autonomous driving systems. I Introduction Autonomous vehicles (AVs) are envisioned as the backbone of next-generation intelligent transportation systems, promising to reduce human error and enhance road safety. Yet, a series of real-world incidents, from Tesla’s perception failures to Uber’s fatal pedestrian crash, underscore persistent vulnerabilities in AV perception and decision-making pipelines [ 9 ] . Despite major advances in sensing, control, and connectivity, modern AVs remain susceptible to safety-critical disruptions under uncertain environmental and cyber-physical conditions [ 19 ] . With nearly 1.9 million global road fatalities each year [ 17 ] , ensuring trustworthy and robust autonomy has become a high priority for intelligent transportation systems. To evaluate and validate autonomous driving stacks, most research has relied on simulation platforms such as CARLA, MetaDrive, and ApolloScape [ 8 ] , or benchmark datasets like KITTI, nuScenes, and Cityscapes [ 3 ] , among others. While these resources support scalable experimentation, they inherently abstract away real-world uncertainties such as sensor degradation, stochastic disturbances, and network latency. In contrast, physical testbeds such as Duckietown [ 14 ] enable closed-loop, real-time experimentation of perception and control modules under degraded sensing and communication. By bridging simulation-based assurance and real-world operation, such testbeds offer a pragmatic foundation for studying system-level robustness in IoT-enabled autonomy [ 12 ] . Building on this foundation, recent research in AV has shifted toward cloud-assisted architectures that distribute perception and control intelligence between vehicles and cloud servers. In these systems, on-vehicle clients perform sensing and actuation only, while the cloud executes computationally intensive modules for perception, prediction, and decision-making [ 18 , 15 , 20 ] . For example, Schafhalter et al. introduced a hierarchical task allocation framework that dynamically partitions workloads between the edge and cloud to balance latency and inference accuracy [ 15 ] . Zhao et al. extended this concept through distributed coordination, enabling multiple vehicles to share intermediate representations via the cloud for cooperative perception and control [ 20 ] . Collectively, these frameworks demonstrate the operational advantages of centralized intelligence, but also expose new cross-layer vulnerabilities, where perception degradation and network impairment can cascade through the control loop and compromise driving safety. Adversarial AI exploits the vulnerability of deep neural networks where small human-imperceptible perturbations can drastically alter model predictions [ 13 ] . Such attacks are generally classified as white-box or black-box , depending on the attacker’s knowledge of the model’s architecture and parameters. In the white-box setting, the adversary has full access to the model’s parameters and gradients, enabling direct manipulation of detector outputs through methods such as Fast Gradient Sign Method (FGSM) [ 5 ] and Projected Gradient Descent (PGD) [ 10 ] . In contrast, black-box attacks operate without internal access, relying on query-based or transfer-based strategies, including physical perturbations such as adversarial patches or reflective overlays [ 2 ] , to mislead models like YOLO [ 7 ] and cause missed detections of critical objects such as stop signs and pedestrians [ 1 ] . Concurrently, network-layer adversaries disrupt cloud communication by injecting delay, packet loss, or replayed data, destabilizing control synchronization between vehicles and the cloud. Previous studies have shown that even modest latency or loss can propagate timing errors through the control stack, resulting in unsafe maneuvers or rule violations [ 4 , 16 , 6 ] . Network impairments intensify the impact of adversarial perception by disrupting the timely delivery and execution of vision-based control commands. While prior studies examine perception or communication robustness independently, few works experimentally quantify their joint impact in a real-world IoV setting. To address these cross-layer threats, this paper presents an IoV testbed to assess the robustness of cloud-assisted autonomous driving systems under coordinated adversarial conditions. The framework integrates real-time perception, control, and communication modules, enabling systematic experimentation with adversarial AI and network-layer adversary. A white-box adversary perturbs visual inputs to degrade YOLOv8-based object detection, while a network adversary, modeled following the MITRE ATT&CK framework [ 11 ] , injects latency and packet loss in the vehicle–cloud loop. Together, these experiments provide a reproducible foundation for analyzing how perception degradation and network impairment compromise decision reliability and driving safety. The main contributions of this paper are summarized as follows: • Development of a cloud-assisted IoV testbed integrating perception, control, and communication layers for the evaluation of adversarial robustness. • Implementation of white-box adversarial attacks (FGSM and PGD) on YOLOv8 object detection to assess robustness under adversarial perturbations. • Modeling of network-layer adversaries using the MITRE ATT&CK framework to inject delay and packet loss effects on closed-loop control stability. • Evaluation of adversarial AI and network adversary to characterize their impact on perception accuracy and decision reliability in cloud-assisted autonomous driving. The remainder of this paper is organized as follows. Section II presents the technical background. Section III introduces the IoV testbed architecture and threat models. Section IV details the experimental setup for robustness evaluation, and Section V discusses results across perception and control layers. Section VI concludes with key insights on cross-layer robustness in cloud-assisted autonomous driving, and Section VII acknowledges the support received for this work. II Preliminaries This section provides an overview of the underlying models and adversarial methods that support our experimental framework. We outline the YOLOv8 detection backbone and its training loss, followed by gradient-based white-box adversarial methods such as FGSM and its iterative extension PGD, which are used for robustness evaluation. II-A YOLO-based Object Detection YOLO is a single-stage object detection framework that jointly optimizes localization and classification to achieve real-time inference from raw visual inputs. The YOLOv8 variant builds upon this architecture with enhanced feature representation and detection efficiency, making it well suited for real-time perception in cloud-assisted IoV systems. Given an input image x , the network predicts bounding boxes b_{i} , class labels c_{i} , and confidence scores p_{i} using composite loss: L=\lambda_{\text{box}}L_{\text{CIoU}}+\lambda_{\text{cls}}L_{\text{BCE}}+\lambda_{\text{dfl}}L_{\text{DFL}}, (1) where L_{\text{CIoU}} , L_{\text{BCE}} , and L_{\text{DFL}} correspond to localization, classification, and distribution focal losses, respectively [ 7 ] .