Leveraging OS-Level Primitives for Robotic Action Management
Wenxin Zheng, Boyang Li, Bin Xu, Erhu Feng, Jinyu Gu, Haibo Chen · 2025
Read Leveraging OS-Level Primitives for Robotic Action Management by Wenxin Zheng, Boyang Li, Bin Xu, Erhu Feng, Jinyu Gu, Haibo Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10259.txt.
Introduction
Wenxin Zheng and five co-authors borrow operating system tricks to manage robot actions in a 2025 paper. Modern robots learn tasks by imitation, copying human demos from sight to motion. Even the best such models generalize poorly and waste motion, partly because training data is limited.
The authors notice that a robot's stream of actions resembles the time slices an operating system hands to programs. Their system adds three classic tools. An exception tool halts a failing action at once, before errors compound. A context tool skips repeated computing when actions resemble earlier ones, speeding execution. A record-and-replay tool lets the robot redo a learned task without retraining. Together these raise both success rates and speed, the authors report. The point is that not every robot problem needs a bigger model; some yield to better systems design.
Catalog record
| CREATOR | Wenxin Zheng, Boyang Li, Bin Xu, Erhu Feng, Jinyu Gu, Haibo Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-10259
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Leveraging OS-Level Primitives for Robotic Action Management Wenxin Zheng, Boyang Li, Bin Xu, Erhu Feng, Jinyu Gu, Haibo Chen Abstract . End-to-end imitation learning frameworks (e.g., VLA) are increasingly prominent in robotics, as they enable rapid task transfer by learning directly from perception to control, eliminating the need for complex hand-crafted features. However, even when employing SOTA VLA-based models, they still exhibit limited generalization capabilities and suboptimal action efficiency, due to the constraints imposed by insufficient robotic training datasets. In addition to addressing this problem using model-based approaches, we observe that robotic action slices, which consist of contiguous action steps, exhibit strong analogies to the time slices of threads in traditional operating systems. This insight presents a novel opportunity to tackle the problem at the system level. In this paper, we propose AMS , a robot action management system enhanced with OS-level primitives like exception , context switch and record-and-replay , that improves both execution efficiency and success rates of robotic tasks. AMS first introduces action exception, which facilitates the immediate interruption of robotic actions to prevent error propagation. Secondly, AMS proposes action context, which eliminates redundant computations for VLA-based models, thereby accelerating execution efficiency in robotic actions. Finally, AMS leverages action replay to facilitate repetitive or similar robotic tasks without the need for re-training efforts. We implement AMS in both an emulated environment and on a real robot platform. The evaluation results demonstrate that AMS significantly enhances the model’s generalization ability and action efficiency, achieving task success rate improvements ranging from 7 × \times to 24 × \times and saving end-to-end execution time ranging from 29% to 74% compared to existing robotic system without AMS support. 1. Introduction End-to-end policy learning framework are gaining increasing attention in the field of robotics. Researchers believe that this robotic computing paradigm with imitation learning ( Brohan et al. 2022 ; Xi et al. 2025 ; Driess et al. 2023 ; Fu et al. 2024 ) is the future for rapid task transfer because these models can learn directly from perception to control, eliminating the complex hand-crafted feature extraction and modular design of traditional methods. Through training on large-scale datasets, end-to-end models are expected to autonomously learn to adapt in complex and changing environments, thereby exhibiting greater flexibility and efficiency in perception, decision-making, and action execution. However, current robotic models still exhibit limitations in their generalization capabilities ( Ze et al. 2024 ; Wang et al. 2024 ) and action performance. For instance, in a typical robotic task such as pick and place, as illustrated in Figure 1 , the success rate declines dramatically once the number of objects exceeds the maximum encountered in the training set, even when utilizing SOTA robotic models ( Chen et al. 2023 ; Goyal et al. 2023 ; Guhur et al. 2023 ; Riegler et al. 2017 ; Brohan et al. 2022 ) . This is primarily due to the limited availability of training data for real robotic platforms, which often leads to model overfitting and consequently results in insufficient generalization capabilities, even for tasks that share similar characteristics. Furthermore, considering the action efficiency, the robot’s actions are typically slower than those of human beings. This is primarily due to the limited actions per second (APS) during model inference, as well as the interference of generated actions across different objects, which results in non-optimal trajectory paths. To address this limitation, the robotics research community focuses on improving the model’s generalization ability from an algorithmic perspective. This includes introducing more environmental information ( Chen et al. 2023 ; Goyal et al. 2023 ; Guhur et al. 2023 ; Riegler et al. 2017 ) , using LLM ability ( Ha et al. 2023 ) , optimizing model parameters ( Park et al. 2024b ; Lin et al. 2025 ; Yue et al. 2024 ; Zhao et al. 2024 ; Zhang et al. 2024 ; James et al. 2022 ) , and designing entirely new network architectures to enhance the model’s adaptability in unseen situations ( Wang et al. 2024 ; Gervet et al. 2023 ; Chi et al. 2023 ; Riegler et al. 2017 ; Brohan et al. 2022 ) . Unfortunately, these methods still face limitations in practical applications, such as the scarcity of training data for real robotic platforms and the retraining overhead associated with different tasks and robotic systems. Figure 1. A failure case of the robot’s pick-and-place operation. When the number of objects to be picked is not represented in the training set, the action’s success rate results in a significant decrease. After a thorough analysis of the current robotic workflow, we identify a new opportunity to enhance robotic robustness and efficiency from the OS level. Although the tasks executed in robotic systems differ from those of traditional applications, we can still discern similarities between these two workloads and leverage the primitives offered by classical operating systems. For example, to ensure the coherence of robotic actions, the current robotic model outputs a fixed number of action steps during each inference. We refer to this sequence of action steps as an “action slice”. The action slice is similar to the time slice allocated for application threads in traditional operating systems, yet it lacks certain system capabilities. For example, in the current robotic workload, the action slice cannot be interrupted even when a fault situation arises, leading to a significant degradation in the success rate of robotic tasks. Furthermore, after executing one action slice, all context (e.g., intermediate result for robotic models) are discarded, and the robot generates the next action slice from an initialized state, which limits the performance of robotic actions. Inspired by traditional operating system primitives such as context switching, exception handling, and record-and-replay mechanisms, AMS introduces action context , action exception , and action replay for robotic fault detection, context saving and restoration across different action slices, and replaying robotic actions within similar environments. With these OS primitives, the efficiency and success rate of robotic actions are significantly enhanced without the necessity of retraining the model. Specifically, AMS proposes three key technical designs: Firstly, AMS stores and manages all action context within a context pool. The action context encompasses all intermediate inference states, such as KV caches, latent vectors, and output embeddings for robotic models. Unlike traditional robotic systems, where each action is generated from a clean initial state, AMS reuses the context generated from the previous round of inference. This approach significantly reduces redundant computations, accelerates model inference, and decreases the number of actions steps. To mitigate storage overhead, AMS employs hierarchical and differential storage strategies, retaining only the essential and distinctive components closer to the computing resources while evicting/offloading redundant or insignificant action context. Secondly, AMS implements GPU-Inference with CPU-Action-Fault-Detection to support action exception. It contains multiple rule-based functions that run on the CPU side to detect any hardware/software-defined robotic exceptions, and interrupt the execution of robotic action immediately. By preventing the propagation of faults, robots are more likely to fix erroneous actions with the dedicated exception handler. Thirdly, to enhance the generalization capability in a typical robotic scenario involving long-horizon tasks that include multiple repetitive jobs, AMS proposes action replay, which leverages previous successful contexts to replay robot actions in