ReasonBreak: Probing Vulnerabilities in Reasoning-Enabled Vision-Language-Action Models for Autonomous Driving
Mohammadreza Teymoorianfard, Jean-Philippe Monteuuis, Jonathan Petit, Amir Houmansadr · 2026
Read ReasonBreak: Probing Vulnerabilities in Reasoning-Enabled Vision-Language-Action Models for Autonomous Driving by Mohammadreza Teymoorianfard, Jean-Philippe Monteuuis, Jonathan Petit, Amir Houmansadr (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29114.txt.
Introduction
Teymoorianfard and colleagues probe reasoning-enabled vision-language-action models for self-driving cars under realistic input corruptions. Using NVIDIA's Alpamayo models in closed tests, attacks succeed on up to 89 percent of reasoning targets and 72 percent of path targets, raising crash rates. The study is the first broad black-box test of such models under text corruptions, with a reasoning test framework covering meaning, structure, and safety. The authors also release a benchmark for attacks and defenses on reasoning, and they urge stronger testing and defenses for driving safety.
Catalog record
| CREATOR | Mohammadreza Teymoorianfard, Jean-Philippe Monteuuis, Jonathan Petit, Amir Houmansadr |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58477 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29114
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ReasonBreak: Probing Vulnerabilities in Reasoning-Enabled Vision-Language-Action Models for Autonomous Driving Mohammadreza Teymoorianfard, Jean-Philippe Monteuuis, Jonathan Petit, Amir Houmansadr Abstract Vision-Language-Action (VLA) models with integrated reasoning have been proposed for end-to-end autonomous driving, assuming a tight coupling between reasoning and trajectory generation. However, the robustness of such systems under realistic input perturbations remains largely unexplored. We show that these models are highly vulnerable to realistic input perturbations, achieving up to 89% attack success rate (ASR) on reasoning and up to 72% on trajectory manipulation in closed-loop simulation, leading to increased collision rates and degraded safety metrics. Using NVIDIA’s recent Alpamayo models as representative industry-developed VLAs, we conduct the first systematic black-box study of reasoning-enabled VLA models under realistic textual input corruptions, evaluating their impact on reasoning and driving behavior. We introduce a reasoning-aware evaluation framework capturing both semantic and structural aspects of reasoning, along with safety-centric measures. We also introduce a benchmark for evaluating attacks and defenses on reasoning–trajectory interactions in autonomous driving. Our results highlight the need for rigorous evaluation and improved defenses to ensure the safety of reasoning-enabled VLA systems in autonomous driving. Figure 1 : ReasonBreak pipeline. We corrupt only the small textual input channel while keeping the dominant non-text fixed, then measure reasoning shifts, trajectory degradation, and safety impact. 1 Introduction Vision-Language-Action (VLA) models are emerging as a prominent direction for end-to-end autonomous driving. This trend is increasingly visible in industry-scale systems: NVIDIA’s Alpamayo family introduces reasoning-enabled VLA models that couple grounded reasoning with trajectory prediction 44 ; 33 . By incorporating language, VLA systems augment conventional end-to-end driving pipelines 4 ; 9 ; 15 ; 8 ; 7 with high-level context and task constraints 22 ; 3 ; 34 ; 56 ; 44 ; recent variants further expose intermediate reasoning before action generation 14 ; 24 ; 51 ; 44 . The integration of reasoning into VLA-based driving systems introduces a new and largely unexplored dimension of risk, as intermediate reasoning is tightly coupled with downstream trajectory generation. However, existing studies on VLA vulnerabilities have primarily focused on robotic manipulation settings and models without explicit reasoning components 43 ; 55 ; 29 ; 28 ; 52 ; 21 . These settings differ fundamentally from autonomous driving in both objectives and failure modes. In driving systems, errors directly correspond to safety violations 35 ; 9 rather than task-level inaccuracies. As a result, the role of reasoning as a potential source of vulnerability in safety-critical autonomous driving systems remains largely unexplored. In real-world deployment, VLA-based driving systems may receive textual inputs through imperfect language interfaces, including speech-to-text transcription, in-vehicle dialogue systems, and downstream text preprocessing pipelines 2 ; 12 ; 47 . Such interfaces do not provide a clean, canonical text channel: environmental noise, speaker variability, accent differences, segmentation errors, and normalization artifacts can all change the surface form of the input text command 39 ; 37 ; 13 ; 40 ; 10 ; 5 . Consequently, VLA models such as Alpamayo, which operate on textual instructions, are naturally exposed to noisy and imperfect input text in realistic settings. Prior work has shown that autoregressive language models are sensitive to surface-form perturbations, where small changes to spelling, casing, or character composition can significantly alter model behavior, particularly in reasoning tasks 17 ; 1 ; 27 . Motivated by this observation, we study VLA vulnerabilities under a query-based black-box setting that reflects these practical constraints, and ask whether realistic input text perturbations can influence reasoning and lead to unsafe behavior. We find that corrupted inputs disrupt the intended reasoning–action coupling in reasoning-enabled driving VLAs: reasoning shifts and trajectory deviations are only weakly correlated, with manipulated reasoning often failing to induce corresponding control changes and large trajectory deviations sometimes occurring with little reasoning change. This exposes reasoning as a practically exploitable failure surface. Under closed-loop interaction, realistic textual corruptions achieve up to 72% ASR for trajectory manipulation and up to 62% ASR for semantic reasoning manipulation, while also inducing structural reasoning failures such as length inflation and denial-of-service (DoS), where model refuses to generate any token. These perturbations translate into safety-critical degradation, increasing downstream failures such as collisions, off-road behavior, and wrong-lane events. We make the following contributions: • First systematic study of reasoning vulnerabilities in VLA-based autonomous driving. We study reasoning-enabled VLA models in safety-critical autonomous driving using a safety-centric evaluation pipeline that combines fine-grained driving metrics (collision rate, near-encounter, time-to-collision) with reasoning-aware analysis. We find that (i) both reasoning and trajectory can be manipulated to induce unsafe behavior, (ii) reasoning and trajectory are weakly correlated under manipulated inputs despite architectural coupling, and (iii) RL post-training improves benign robustness but can amplify safety risks when attacks succeed. We further show that lightweight rule-based filtering substantially mitigates these vulnerabilities. • Reasoning as an attack surface under realistic black-box constraints. We identify reasoning as a distinct and previously underexplored attack surface in VLA systems, and show that both semantic and structural properties of reasoning (e.g., content and length) can be manipulated under realistic input perturbations. We study this in a constrained, query-based black-box setting with limited input control, and adapt reasoning attacks (e.g., slowdown and DoS) to demonstrate their impact on safety-critical behavior. • Benchmark and dataset for reasoning–safety evaluation in autonomous driving. We release the first benchmark and dataset for evaluating reasoning–safety interactions in VLA-based autonomous driving, mapping input conditions to intermediate reasoning outputs and safety-critical outcomes. 2 Background and Related Work 2.1 Vulnerabilities of VLAs Vision-Language-Action (VLA) models jointly process visual observations and language inputs to generate sequential actions, enabling end-to-end decision making in embodied settings 22 ; 3 . Recent work has explored such models in robotic manipulation 22 ; 34 ; 3 ; 46 ; 25 and autonomous driving 56 ; 54 ; 36 ; 45 ; 44 . In this work, we focus on Alpamayo 44 , a recent reasoning-enabled VLA system for autonomous driving. Given their deployment in physical systems, VLA models expose multiple safety-critical attack surfaces that have recently been explored. Prior work has identified vulnerabilities at the perception level, including physical sensor attacks 29 and adversarial patches 28 ; 52 ; 42 ; 49 , as well as at the model level through action-freezing 43 and backdoor attacks 55 . Language-based attacks can also induce unsafe behaviors 21 , alongside agentic black-box frameworks that exploit model interactions 48 . More recently, multimodal attacks that jointly manipulate visual and textual inputs have been shown to amplify attack effectiveness and bypass alignment mechanisms 50 . However, existing studies on VLA vulnerabilities have primarily focused on robotic manipulation settings and models without explicit reasoning components 42 ; 50 ; 52 . These works typically target input-level or policy-level weaknesses and evaluate failures in terms of task-level degradation or trajectory deviation, where small errors do not necessarily imply unsafe behavior. In contrast, autonomous driving requires evaluating safety-critical outcomes, where even minor perturbations can lead to severe consequences 35 ; 9 . Recent work has examined robustness in autonomous-driving VLMs and language-driven driving systems, including black-box/visual attacks, decision-making robustness, and instruction counterfactual robustness 41 ; 53 ; 6 ; 18 . However, these studies do not address reasoning-enabled driving VLAs as dual-output systems, where textual corruptions may affect