VLA-Cache: Towards Efficient Vision-Language-Action Model via Adaptive Token Caching in Robotic Manipulation

Siyu Xu, Yunke Wang, Chenghao Xia, Dihao Zhu, Tao Huang, Chang Xu · 2025

Read VLA-Cache: Towards Efficient Vision-Language-Action Model via Adaptive Token Caching in Robotic Manipulation by Siyu Xu, Yunke Wang, Chenghao Xia, Dihao Zhu, Tao Huang, Chang Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-02175.txt.

Introduction

Siyu Xu and co-authors speed up robot control models by caching the parts of the scene that do not change, in a paper from 2025. Vision-language-action models turn camera views and spoken orders into robot motion, but they are heavy to run. Real-time control leaves little room for waste.

Their method, VLA-Cache, spots visual tokens that barely change between frames and reuses their stored computations. Tokens tied to the task and likely to matter are still recomputed, guarding accuracy. A layer-wise rule adjusts how much is reused, based on where attention concentrates. On two simulators and a real robot, the method ran up to about seventy percent faster and raised control frequency. Task success barely moved.

Catalog record

CREATORSiyu Xu, Yunke Wang, Chenghao Xia, Dihao Zhu, Tao Huang, Chang Xu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-02175

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

VLA-Cache: Towards Efficient Vision-Language-Action Model via Adaptive Token Caching in Robotic Manipulation Siyu Xu, Yunke Wang, Chenghao Xia, Dihao Zhu, Tao Huang, Chang Xu Abstract Vision-Language-Action (VLA) model can process instructions and visual perception to directly generate actions as output in an end-to-end fashion due to its strong multi-modal reasoning capabilities. While the performance of VLA models is promising, their computational cost can be substantial. This raises challenge for applying them on robotics tasks, which requires real-time decision-making to respond quickly to environmental changes. Since robotic control involves sequential decision-making, the visual input often exhibits minimal variation between successive steps. A natural idea is to reuse the computational results of unchanged visual tokens from the last step. Motivated by this idea, we propose VLA-Cache, an efficient vision-language-action model. VLA-Cache incorporates a token-selection mechanism that compares the visual input at each step with the input from the previous step, adaptively identifying visual tokens with minimal changes. The computational results for these unchanged tokens are then reused in subsequent steps via KV-cache, thereby significantly improving the efficiency of the VLA-Cache model. Experimental results on both simulation ( e.g. , LIBERO benchmark and SIMPLER) and real-world robot valid VLA-Cache can achieve practical acceleration with minimal sacrifice in success rate. 1 Introduction Learning a robust and generalizable policy for robotic manipulation through policy learning has long been a challenging problem ( Kim et al. 2020 ) , with traditional reinforcement learning approaches ( Choi et al. 2024 ; Bica et al. 2021 ) often suffering from poor robustness and limited generalization. Recently, the rapid advancement of foundational Vision-Language Models (VLMs) ( Awadalla et al. 2023 ; Liu et al. 2024b ) has demonstrated remarkable capabilities in multimodal understanding and generalization. Leveraging large-scale real-world robotic datasets ( O’Neill et al. 2024 ; Fang et al. 2024 ) , pioneering works ( Zitkovich et al. 2023 ; Octo Model Team et al. 2024 ; Niu et al. 2024 ; Kim et al. 2024 ) have introduced Vision-Language-Action (VLA) models, which integrate vision and language modalities to directly generate robotic actions in an end-to-end manner. This emerging paradigm holds great promise for enhancing the adaptability and generalization of robotic control systems, but leaves a large computational demand. Figure 1: During the inference of the VLA model, static tokens of the input image remain largely consistent across steps. This consistency allows for caching the computations of these tokens from the previous step and improving the efficiency of inference. To mitigate the extensive cost of VLA models, existing works often adopt generic acceleration techniques, such as model lightweighting ( Wen et al. 2024 ) , quantization ( Park et al. 2024 ) , and early exit ( Yue et al. 2024 ) . However, these approaches fail to account for the unique characteristics of VLA models, leading to suboptimal efficiency gains and limited performance improvements. In this paper, we argue that robotic manipulation, characterized by sequential action-scene interactions, inherently prioritizes visual inputs related to the robotic arm and the target object, while the background remains largely static and less critical. As illustrated in Figure 1 , the static tokens of the input image remain largely consistent across steps. In this context, the background tokens, which contribute significantly to computational overhead and repeat across sequential steps in the VLA process, are often redundant. As a result, we propose VLA-Cache , a novel approach that identifies and reuses static tokens across sequential VLA steps. Specifically, static tokens in each step refer to visual tokens that exhibit minor changes compared to the previous step. Instead of recomputing these tokens, VLA-Cache directly substitutes them with their cached representations from the preceding step, significantly reducing redundant computations and improving inference efficiency. Nevertheless, we observe that model precision is highly sensitive to task-relevant tokens ( i.e. , those related to the robotic arm and the target object) in the ablation study, where even a slight positional shift can lead to a significant performance drop. To address this, we introduce a fine-grained selection scheme that filters out task-relevant tokens from the static token set, ensuring that these critical tokens continue to undergo full computational interactions, thereby preserving model accuracy while maintaining efficiency. Additionally, based on the observation that attention distributions within the VLA decoder vary significantly across different layers, we propose a layer-adaptive strategy that adjusts the fraction of reused tokens based on each layer’s attention concentration. We evaluate VLA-Cache on a diverse set of robotic manipulation tasks in the LIBERO benchmark, where it demonstrates over 1.7× acceleration compared to the baseline, with only slight drop on the success rate. Furthermore, VLA-Cache is deployed on the Kinova Jaco robot arm, showing that it can achieve practical acceleration in real-world scenarios. 2 Related Work Vision-Language-Action Models. Large-scale vision-language models (VLMs) have significantly advanced multimodal learning by integrating image understanding and language reasoning ( Liu et al. 2024b ; Bai et al. 2023 ) . Extending these capabilities, Vision-Language-Action (VLA) models ( Zitkovich et al. 2023 ; Li et al. 2023 ) incorporate an action modality, enabling end-to-end visuomotor control. These models typically adopt large VLM backbones ( Touvron et al. 2023 ) and fine-tune them on robot data ( O’Neill et al. 2024 ) , with approaches varying from discretizing actions as language-like tokens ( Kim et al. 2024 ; Chi et al. 2023 ) to incorporating specialized diffusion policy heads ( Black et al. 2024 ) . Despite their effectiveness in tasks like object retrieval and assembly ( Huang et al. 2024 ; Zhao et al. 2023 ) , VLA models demand substantial computation, making real-time deployment challenging, particularly in resource-constrained environments. Acceleration for Vision-Language Models. Acceleration techniques for VLMs, such as quantization ( Xie et al. 2024 ) and pruning ( Lin et al. 2024a ) , have shown success in vision-language tasks but often overlook the real-time demands of action generation. Token-level methods like FastV ( Chen et al. 2025 ) and SparseVLM ( Zhang et al. 2024 ) optimize inference by pruning or merging redundant tokens, but their effectiveness in VLA tasks, which require short and highly specialized action sequences, remains unclear. Some works address efficiency by modifying VLA architectures, such as DeeR-VLA ( Yue et al. 2024 ) , which dynamically adjusts inference depth, and QAIL ( Park et al. 2024 ) , which integrates quantization-aware training. Others, like RoboMamba ( Liu et al. 2024c ) and TinyVLA ( Wen et al. 2024 ) , focus on replacing traditional attention mechanisms or training compact models from scratch, often requiring re-training and additional data collection. In contrast, VLA-Cache offers a training-free acceleration approach by selectively caching static tokens and recomputing only dynamic or task-relevant ones, preserving crucial temporal cues while reducing inference latency and improving real-time robotic control efficiency. 3 Preliminary 3.1 Vision-Language-Action Models Vision-Language-Action (VLA) models extend large-scale VLMs to generate robotic actions based on multimodal inputs, including visual observations and task instructions. These models are typically trained on large-scale datasets, such as Open X Embodiment ( O’Neill et al. 2024 ) , which contains over a million real-world robot trajectories. The training pipeline involves a pre-trained vision encoder ( Liu et al. 2021 ; Radford et al. 2021 ) extracting image

Read the complete text