Pre-VLA : Preemptive Runtime Verification for Reliable Vision-Language-Action and World-Model Rollouts * Equal Contribution † Corresponding Author: Junwu Xiong, Zhijun Meng

Zhen Sun 1,4 * , Yongjian Guo 2,4 * , Haoran Sun 3 , Luqiao Wang 1,4 , Wei Lu 4 , Jiachi Ji 1 , Shengzhe Ji 5 , Junwu Xiong 4 † , Zhijun Meng 1 † · 2026

Read Pre-VLA : Preemptive Runtime Verification for Reliable Vision-Language-Action and World-Model Rollouts * Equal Contribution † Corresponding Author: Junwu Xiong, Zhijun Meng by Zhen Sun 1,4 * , Yongjian Guo 2,4 * , Haoran Sun 3 , Luqiao Wang 1,4 , Wei Lu 4 , Jiachi Ji 1 , Shengzhe Ji 5 , Junwu Xiong 4 † , Zhijun Meng 1 † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22446.txt.

Introduction

Sun and colleagues present Pre-VLA, a runtime verification system for vision-language-action models and world models. Poor actions can cause physical failures or misleading rollouts with wasted rendering. Pre-VLA checks action validity before execution or imagination, using a multimodal backbone and a light dual-branch head. It predicts safety confidence and critic-derived advantage scores for candidate action chunks. Training blends focal classification, advantage regression and soft calibration to handle class imbalance. On the LIBERO benchmark, success rises from 30.79 percent to 37.62 percent, with fewer steps.

Catalog record

CREATORZhen Sun 1,4 * , Yongjian Guo 2,4 * , Haoran Sun 3 , Luqiao Wang 1,4 , Wei Lu 4 , Jiachi Ji 1 , Shengzhe Ji 5 , Junwu Xiong 4 † , Zhijun Meng 1 †
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51840
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.22446

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Pre-VLA : Preemptive Runtime Verification for Reliable Vision-Language-Action and World-Model Rollouts * Equal Contribution † Corresponding Author: Junwu Xiong, Zhijun Meng Zhen Sun 1,4 * , Yongjian Guo 2,4 * , Haoran Sun 3 , Luqiao Wang 1,4 , Wei Lu 4 , Jiachi Ji 1 , Shengzhe Ji 5 , Junwu Xiong 4 † , Zhijun Meng 1 † Abstract While large vision-language-action (VLA) models and generative world models (WM) have advanced long-horizon embodied intelligence, their practical deployment remains challenged by uncertainty in learning-based action generation. Low-quality actions may cause physical failures during execution or lead to misleading world-model rollouts with redundant rendering costs. To address this issue, we propose Pre-VLA , a unified runtime verification architecture that performs preemptive action validity assessment before physical execution or world-model imagination. Pre-VLA leverages an efficient multimodal backbone with modality-aware pooling and a lightweight dual-branch head to predict both safety confidence and critic-derived advantage scores for candidate action chunks. To handle severe class imbalance and unstable boundary decisions, we train Pre-VLA with a multi-task objective combining Focal classification, advantage regression, and soft-threshold calibration. During deployment, a dual-mode preemptive resampling scheduler filters low-quality actions and triggers adaptive resampling under a limited computation budget. Experiments on the LIBERO benchmark show that Pre-VLA improves the average closed-loop success rate across four suites from 30.79% to 37.62% over RynnVLA-002, reduces task execution steps, achieves 183.9 ms average forward verification time per action chunk, and mitigates error accumulation in world-model rollouts. I Introduction In embodied intelligent long-horizon operational tasks, large vision-language-action (VLA) models [ 22 , 4 ] and action-conditioned world models (WM) [ 32 , 18 ] have been widely employed to generate control policies and predict complex physical futures [ 27 , 38 , 36 ] . By transforming heterogeneous multimodal sensory streams into unified discrete or continuous representations, these foundational models endow robotic agents with remarkable semantic generalization capabilities and abstract reasoning skills across various open-world environments [ 39 ] . In parallel, generative world models serve as neural simulators that synthesize predictive visual futures conditioned on candidate actions, thereby enabling proactive planning and multi-step lookahead verification [ 21 ] . Despite these promising advances, existing embodied models still face the challenge of learning-based generative uncertainty during practical deployment [ 13 ] . At each planning cycle, the candidate actions generated by the VLA policy may be affected by distributional shifts, temporal error accumulation, or insufficient confidence calibration [ 8 ] . Once low-quality actions enter the downstream pipeline, they may introduce risks in two scenarios: in physical execution, they can cause collisions, object drops, or irreversible kinematic violations; in world model imagination, although the WM can produce relatively stable future predictions under reasonable action conditions, biased or unsafe action inputs may lead to blurry frames, target position drift, distorted physical relationships, or even false-success rollouts [ 20 ] , causing visual and physical errors to accumulate while incurring additional GPU rendering costs [ 14 , 16 ] . Therefore, establishing a runtime verification mechanism capable of preemptive safety assessment and candidate action filtering has become a fundamental prerequisite for trustworthy embodied intelligence. Fig. 1 : Overview of the dual-mode runtime verification pipeline of Pre-VLA . However, designing an effective runtime verification framework for highly dynamic robotic systems cannot be achieved by simply adding a filtering module, as it faces several challenges [ 6 ] . First, robotic tasks typically involve multimodal information, including language, vision, proprioceptive states, and actions. Improper handling of such high-dimensional heterogeneous data can introduce considerable computational overhead [ 15 ] ; for robotic control pipelines that require continuous operation, excessive verification latency may affect the stability of action execution [ 2 ] . Second, existing embodied runtime evaluation modules mainly focus on evaluating environmental states or prediction results, making it difficult to directly assess the safety and validity of candidate actions before they enter physical execution or world model imagination [ 33 ] . Therefore, constructing a lightweight pre-verification mechanism for action chunks is crucial for reliable runtime safety assurance.In addition, real-world offline exploration data is often limited [ 4 ] and suffers from severe class imbalance. Since standard safe trajectories dominate the data distribution [ 34 , 21 ] , rare yet critical catastrophic failure samples can be overwhelmed by abundant safe samples during standard cross-entropy optimization [ 31 , 37 ] . This imbalance weakens the model’s ability to identify high-risk actions and makes it more prone to over-confidence or decision oscillations near safety boundaries. To address the above limitations, we propose Pre-VLA , a unified runtime verification architecture that seamlessly integrates runtime safety constraints into the foundational inference pipeline of embodied agents, as shown in Fig 1 . The core idea of Pre-VLA is to leverage the efficient unified multimodal backbone of the advanced WorldVLA [ 8 ] network to jointly represent language instructions, visual observations, proprioceptive states, and candidate actions. By introducing dedicated action and state tokenizers, Pre-VLA encodes multi-source inputs within a unified text-image representation space and extracts the final-layer hidden states of the backbone as a low-overhead feature basis for subsequent action validity verification.To handle the complex coupling among heterogeneous features, we design an explicit modality-aware pooling layer, which uses predefined masks to separate the independent contributions of text instructions, visual observations, proprioceptive states, and action chunks. The concatenated multimodal feature vector is then fed into a minimalist dual-branch feed-forward network. The primary classification branch outputs a safety confidence score, while the parallel regression branch predicts a continuous long-horizon advantage score derived from the Critic. To address the prevalent dataset imbalance and mitigate boundary oscillations, we construct a multi-task joint optimization objective that combines Focal Loss [ 23 ] for hard-example-focused classification, a mean squared error regression loss for physical regularization, and an adaptive Soft-threshold Loss for smooth probability calibration. During physical execution or world model imagination, the dual-modal preemptive resampling scheduler leverages the above dual-branch predictions to dynamically intercept anomalous action chunks before they trigger unrecoverable kinematic violations or expensive simulation rendering loops. In this way, Pre-VLA effectively maintains the system safety boundary under a limited resampling budget. We conduct a comprehensive evaluation of Pre-VLA on the LIBERO [ 24 ] robotic manipulation benchmark, covering action validity discrimination, closed-loop physical execution, world model rollouts, ablation studies, and task-level case studies under stronger baseline settings. Experimental results show that Pre-VLA achieves an F1 score of 0.8303 and an accuracy of 0.9542 on the independent LIBERO test set, while reducing the false pass rate of invalid actions to 0.0200, indicating its ability to distinguish valid actions from high-risk candidates. In closed-loop execution experiments across four LIBERO suites, Pre-VLA improves the average success rate from 30.79% to 37.62% compared with RynnVLA-002 [ 7 ] , yielding an absolute gain of 6.83 percentage points. Meanwhile, it reduces the number of task execution steps, suggesting that action filtering helps the policy enter valid execution trajectories more efficiently. Runtime analysis further shows that the average forward verification time of Pre-VLA for a single candidate action chunk is approximately 183.9 ms, indicating manageable computational overhead. In addition, qualitative world model rollout results on LIBERO tasks demonstrate that Pre-VLA can filter low-quality actions before they enter the WM, thereby mitigating

Read the complete text