RoboECC : Multi-Factor-Aware Edge-Cloud Collaborative Deployment for VLA Models
Zihao Zheng 1 1 , Hangyu Cao 2 2 , Jiayu Chen 1 1 , Sicheng Tian 3 3 Chenyue Li 2 2 , Maoliang Li 1 1 , Xinhao Sun 4 4 , Guojie Luo 1 1 , † Xiang Chen 1 1 · 2026
Read RoboECC : Multi-Factor-Aware Edge-Cloud Collaborative Deployment for VLA Models by Zihao Zheng 1 1 , Hangyu Cao 2 2 , Jiayu Chen 1 1 , Sicheng Tian 3 3 Chenyue Li 2 2 , Maoliang Li 1 1 , Xinhao Sun 4 4 , Guojie Luo 1 1 , † Xiang Chen 1 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20711.txt.
Introduction
Zheng and co-authors present RoboECC, a way to split vision language action models between edge and cloud. These robot models cost a lot to run in real time. A poor split point can waste the edge device or the link. Their method picks split points with both model shape and hardware in mind. It then adjusts the split as network bandwidth shifts. Tests across models gave speedups up to 3.28 times. Extra cost stayed near 2.6 percent in their trials.
Catalog record
| CREATOR | Zihao Zheng 1 1 , Hangyu Cao 2 2 , Jiayu Chen 1 1 , Sicheng Tian 3 3 Chenyue Li 2 2 , Maoliang Li 1 1 , Xinhao Sun 4 4 , Guojie Luo 1 1 , † Xiang Chen 1 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28205 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20711
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RoboECC : Multi-Factor-Aware Edge-Cloud Collaborative Deployment for VLA Models Zihao Zheng 1 1 , Hangyu Cao 2 2 , Jiayu Chen 1 1 , Sicheng Tian 3 3 Chenyue Li 2 2 , Maoliang Li 1 1 , Xinhao Sun 4 4 , Guojie Luo 1 1 , † Xiang Chen 1 1 Abstract Vision-Language-Action (VLA) models are mainstream in embodied intelligence but face high inference costs. Edge-Cloud Collaborative (ECC) deployment offers an effective fix by easing edge-device computing pressure to meet real-time needs. However, existing ECC frameworks are suboptimal for VLA models due to two challenges: (1) Diverse model structures hinder optimal ECC segmentation point identification; (2) Even if the optimal split point is determined, changes in network bandwidth can cause performance drift. To address these issues, we propose a novel ECC deployment framework for various VLA models, termed RoboECC . Specifically, we propose a model-hardware co-aware segmentation strategy to help find the optimal segmentation point for various VLA models. Moreover, we propose a network-aware deployment adjustment approach to adapt to the network fluctuations for maintaining optimal performance. Experiments demonstrate that RoboECC achieves a speedup of up to 3.28 × \times with only 2.55% ∼ \sim 2.62% overhead. I Introduction Vision-Language-Action (VLA) models have emerged as the mainstream paradigm for Embodied Artificial Intelligence [ 9 ] . Via diverse encoders, they fuse multi-modal information, generate concrete actions, and exhibit high task success rates as well as robust generalization in robotic control scenarios [ 3 , 17 ] . Fig. 1: (a) VLA Inference on Edge Devices (b) Challenges of VLA ECC Deployment (c) Overview of the Proposed RoboECC Framework VLA models incur high inference costs, which severely impede their real-world deployment. Unoptimized VLAs only reach an action control frequency of 1 \sim 3 Hz on edge devices (Fig. 1 (a)), far below the \sim 30Hz real-time requirement [ 3 , 15 , 14 ] . Even with acceleration methods, this frequency only increases to 10 \sim 15Hz [ 8 , 13 ] (on consumer-grade GPUs) and drops further on resource-limited edge devices. Edge-Cloud Collaboration (ECC) is a highly effective deployment strategy for large-scale models [ 10 , 16 ] . Typically, it deploys a model’s backbone on the cloud (with abundant computing resources) and a lightweight segment on edge devices; via high-bandwidth networks, this setup enables collaborative inference [ 12 , 11 ] . This configuration not only eases edge devices’ computing burden but also boosts overall inference speed and service quality. Effective integration of ECC with VLA models can enable real-time action generation, yet this process is non-trivial. We summarize two key challenges (Fig. 1 (b)). Challenge 1: Due to the component heterogeneity inherent in VLA models, existing ECC frameworks are suboptimal in model segmentation. With technological progress, VLA models have developed diverse architectures. Early models relied solely on detokenizers for token-to-action conversion, while later iterations evolved into specialized Action Models (AM) for action generation—including MLPs, LSTMs, diffusion models, and Diffusion Transformers (DiTs). Owing to the distinct computing/bandwidth needs of VLA components and such architectural complexity, existing static ECC frameworks struggle to find the VLA models’ optimal segmentation point. Challenge 2: In end-cloud scenarios, internet bandwidth is subject to constant fluctuations. Even when an optimal segmentation point is set, these bandwidth variations can still lead to suboptimal latency. The data transfer volume at the model’s optimal split point reflects only ideal bandwidth conditions. Fluctuations in internet bandwidth can increase or decrease network transmission latency, which in turn alters overall latency. This shifts the optimal split point, requiring fine-grained adjustment. Existing ECC frameworks can not achieve these, leaving it a challenge. In this paper, we first develop some case studies to prove these two challenges and conclude design insights. Based on these, we propose an end-to-end multi-factor-aware ECC framework for optimal VLA deployment, which is named RoboECC (Fig. 1 (c)). Specifically, RoboECC consists of two parts. First, we introduce a model-hardware co-aware segmentation strategy to help find the optimal segmentation point for various VLA models. We establish an effective hardware model and VLA structure model, and utilize an automatic algorithm to find the segmentation point. Second, we introduce a network-aware adjustment method to adapt to the network bandwidth fluctuations and maintain optimal performance. We build up a parameter-sharing pool for fine-tuning the edge-cloud deployment and finish the corresponding adjustment methods. Overall, our contributions are threefold: \bullet We develop case studies to conclude the key problems of achieving ECC deployment for various VLA models and bring key insights for the ECC framework design. \bullet We propose RoboECC , a multi-factor-aware ECC deployment framework for VLA models, which contains a model-hardware co-aware segmentation strategy and a network-aware deployment adjustment method. \bullet We evaluate RoboECC through various VLA models and hardware settings, showing its advantages and evaluating its performance in both simulation and real-world scenarios. Experiments show that compared with pure edge-side deployment, RoboECC achieves a 3.16 \times \sim 3.28 \times speedup on the Orin+A100 platform and a 2.10 \times \sim 2.23 \times speedup on the Thor+A100 platform, with only 2.55% \sim 2.62% overhead. Our code is coming soon. II Background II-A VLA Models II-A 1 Various Model Structure Traditional VLA models [ 17 , 3 ] usually consist of three core components: a vision encoder (e.g., Vision Transformer, ViT), a large language model (LLM), and an action detokenizer. With technological progress, modern VLA frameworks have increasingly adopted dedicated action models [ 5 ] replace simple detokenizers, enabling more precise action generation. These models (covering diffusion models, Diffusion Transformer (DiT), LSTM, and MLP) also add complexity to VLA structures. II-A 2 Inference Cost and Real-Time Requirement The massive parameters and computations of VLA models result in prohibitive inference overhead, failing to meet real-time control demands [ 13 ] . Robotic real-time control requires an action generation frequency exceeding 30 Hz, yet unoptimized VLA models only yield 3 \sim 5 Hz, which is drastically below the real-time threshold [ 8 ] . Existing edge devices are barely capable of real-time VLA inference, making ECC deployment the primary solution for practical VLA applications. II-B Edge-Cloud Collaborative Deployment II-B 1 ECC-based Co-Inference Existing ECC deployment frameworks can be broadly categorized into two categories: (1) large-small model co-inference [ 4 , 2 ] and (2) computation offloading [ 12 , 11 ] . For large-small model co-inference, common techniques are early-exit mechanism and knowledge distillation. However, for VLAs, which are characterized by immense size and complexity, it is hard to construct a model supporting early-exit or distilling knowledge. II-B 2 Computing Offloading for Deployment For computation offloading, the two primary methods are parallelism design [ 11 ] and model partitioning [ 12 ] . Compared with large-small co-inference methods, computing offloading technologies are more suitable for VLA models. Therefore, the ECC framework discussed in this paper refers to the computing offloading category. However, existing ECC frameworks are suboptimal when integrating with VLA models due to the aforementioned reasons in Section I . III Observation and Analysis In this section, we will analyze in detail why existing ECC frameworks do not fit into the VLA model and provide insights on how to design novel ECC frameworks. III-A Optimal Segmentation Point under Various Structures Motivation ①: The variable