RIO: Flexible Real-Time Robot I/O for Cross-Embodiment Robot Learning
Pablo Ortega-Kral ∗, Eliot Xing ∗, Arthur Fender Coelho Bucker, Vernon Luk, Junseo Kim, Owen Kwon, Angchen Xie, Nikhil Sobanbabu, Yifu Yuan, Megan Lee, Deepam Ameria, Bhaswanth Ayapilla, Jaycie Bussell, Guanya Shi, Jonathan Francis, Jean Oh † · 2026
Read RIO: Flexible Real-Time Robot I/O for Cross-Embodiment Robot Learning by Pablo Ortega-Kral ∗, Eliot Xing ∗, Arthur Fender Coelho Bucker, Vernon Luk, Junseo Kim, Owen Kwon, Angchen Xie, Nikhil Sobanbabu, Yifu Yuan, Megan Lee, Deepam Ameria, Bhaswanth Ayapilla, Jaycie Bussell, Guanya Shi, Jonathan Francis, Jean Oh † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11564.txt.
Introduction
Ortega-Kral and fifteen colleagues present RIO, an open-source Python framework for flexible, real-time robot input-output across body types. Generalist cross-body robot skill stays elusive, partly because robot code ties to exact setups. RIO offers light parts for robot control, teleoperation, data formatting, sensor setup and policy use across hardware and body types, letting users swap choices easily. Tested on single-arm, bimanual and humanoid bodies across four hardware platforms, RIO-gathered teleoperation data fine-tunes leading vision-language-action models on household tasks.
Catalog record
| CREATOR | Pablo Ortega-Kral ∗, Eliot Xing ∗, Arthur Fender Coelho Bucker, Vernon Luk, Junseo Kim, Owen Kwon, Angchen Xie, Nikhil Sobanbabu, Yifu Yuan, Megan Lee, Deepam Ameria, Bhaswanth Ayapilla, Jaycie Bussell, Guanya Shi, Jonathan Francis, Jean Oh † |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48988 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11564
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RIO: Flexible Real-Time Robot I/O for Cross-Embodiment Robot Learning Pablo Ortega-Kral ∗, Eliot Xing ∗, Arthur Fender Coelho Bucker, Vernon Luk, Junseo Kim, Owen Kwon, Angchen Xie, Nikhil Sobanbabu, Yifu Yuan, Megan Lee, Deepam Ameria, Bhaswanth Ayapilla, Jaycie Bussell, Guanya Shi, Jonathan Francis, Jean Oh † Abstract Despite recent efforts to collect multi-task, multi-embodiment datasets, to design recipes for training Vision-Language-Action models (VLAs), and to showcase these models on different robot platforms, generalist cross-embodiment robot capabilities remains a largely elusive ideal. Progress is limited by fragmented infrastructure: most robot code is highly specific to the exact setup the user decided on, which adds major overhead when attempting to reuse, recycle, or share artifacts between users. We present RIO (Robot I/O), an open source Python framework that provides flexible, lightweight components for robot control, teleoperation, data formatting, sensor configuration, and policy deployment across diverse hardware platforms and morphologies. RIO provides abstractions that enable users to make any choice and to switch between them, with minimal reconfiguration effort. We validate RIO on VLA deployment workflows across three morphologies (single-arm, bimanual, humanoid) and four hardware platforms with varying grippers and cameras. Using teleoperated data collected with RIO, we fine-tune state-of-the-art VLAs including π 0.5 \pi_{0.5} and GR00T on household tasks such as pick-and-place, folding, and bowl scrubbing. By open sourcing all our efforts, we hope the community can accelerate their pace of robot learning on real-world robot hardware. Additional details at: robot-i-o.github.io . † † ∗ Equal contribution, † Corresponding author: [email protected] I Introduction Vision-language-action models (VLAs) have recently emerged as a promising approach for training generalist robot policies, leveraging large-scale cross-embodiment datasets to learn broadly capable robot behaviors. Despite their potential, successfully deploying VLAs on new robot morphologies and platforms remains challenging in practice. VLAs are difficult to run out-of-the-box on new embodiments, and getting them to work still demands substantial engineering effort. This difficulty, however, extends well beyond VLAs. Robotics practitioners have long contended with the fragmentation inherent in the field. Varying morphologies, diverse sensor configurations, heterogeneous hardware platforms, and manufacturer-specific driver code collectively result in robot infrastructure that is highly specific to a user’s particular setup. This leads to significant overhead when attempting to reuse code, share datasets, or build on each other’s work. Existing cross-embodiment datasets like Open X-Embodiment [ 36 ] are, in practice, aggregations of many individual collection efforts conducted across disparate infrastructure. The cost of this fragmentation is growing. As robot hardware becomes increasingly affordable, more platforms are entering research labs and deployment settings. Yet, the specialized nature of most robotics infrastructure means that each new platform carries substantial integration overhead. Consider a common scenario: a research team wishes to reproduce real-world results released by another group. To use the original control code, they would need to replicate the exact hardware setup one-to-one, as in efforts like DROID [ 27 ] . If they instead have a different robot arm, then they face the burden of rewriting the entire control stack from scratch, before even trying to adapt any learned policies. This makes most robot learning hardware code difficult to reuse , and switching between platforms far harder than it should be. What is the most important infrastructure for robot learning to advance? Beyond large datasets, we believe that a lack of flexible, reusable, accessible, and performant full-stack robot infrastructure has been a critical barrier to cumulative progress and collaboration within the field. Robot learning is missing reusable building blocks for hardware with flexible abstractions that have become standard in other areas of machine learning. Just as specialized high-performance GPU kernels within high-level auto-differentiation frameworks have enabled the rapid development and iteration of neural networks, robotics requires analogous foundational components for hardware and control that can be reliably shared, extended, and built upon across the community. In this paper, we present the following contributions: i) We introduce RIO, a flexible real-time Robot I/O framework that provides reusable infrastructure for data collection and policy deployment across diverse robot embodiments. RIO is not intended as a comprehensive robot learning solution, but rather a lightweight set of reusable building blocks that can be quickly combined to deploy policies on real robots, tailored to each user’s desired configuration. RIO is designed to be flexible, reusable, accessible, performant, and consistent, with abstractions such that the user is free to make any choice at each layer of the stack and switch between them with minimal effort. ii) We validate RIO for the VLA deployment workflow spanning diverse embodiments across single arm, bimanual, and humanoid robots with different grippers and sensors. This includes different robots, cameras, teleoperation interfaces, middlewares, data formats, and policies. iii) We demonstrate real-world deployment by collecting teleoperated data to fine-tune state-of-the-art VLAs such as \pi_{0.5} and GR00T, on household tasks such as pick-and-place, folding, and bowl scrubbing, including a cross-embodiment policy trained on mixed data from two different robot morphologies and platforms. II Related Works TABLE I: Comparison of cross-embodiment robot stacks. We compare various cross-embodiment robot stacks on the basis of native platform support, at different layers of the robot learning pipeline, e.g., data-collection system support, robot hardware support, middleware, data formats, and policy architecture support. For example, some stacks combine robot arm and robot gripper drivers, making it difficult to use other end effectors on arms. Framework Humanoids Bimanual Single arm Robot grippers Teleop Cameras Middleware(s) Data format(s) Policies Ark [ 16 ] : LCM : Pickle LeRobot [ 9 ] : Threads/gRPC 1 : LeRobotDataset ManiUniCon [ 53 ] : Shm : Zarr PAPRLE [ 30 ] : ROS : Pickle n/a PyRobot [ 35 ] : ROS : Pickle n/a RCS [ 25 ] : RPC : Parquet RoBits [ 20 ] : ZMQ : NPZ/JSON n/a UMI, DP [ 12 , 13 ] : Shm : Zarr : DP RIO (ours) : any : any 1 LeRobot uses Threads for hardware drivers and gRPC for asynchronous policy inference. II-A Generalist Robot Policies Recent advances in vision-language-action models (VLAs) [ 7 , 19 , 5 , 24 , 40 , 4 ] aim to leverage the robust image-to-language alignment learned by internet-scale pre-trained vision-language models (VLMs) [ 50 , 18 , 3 , 2 , 15 ] to train generalist robot policies. VLAs adapt VLMs to predict actions through imitation learning on robot datasets collected via human teleoperation of robots, scaling foundational work on imitation learning for visuomotor policy learning, such as ALOHA [ 51 ] and Diffusion Policy [ 13 ] . Due to the computational resources and data scale required, state-of-the-art VLAs are predominantly trained by industry labs with substantial infrastructure and engineering personnel. Open source efforts have sought to reproduce and democratize these results [ 44 , 31 , 39 , 15 , 28 ] , providing fully open source implementations and model weights. However, a significant limitation remains: current VLAs must in practice be fine-tuned for each robot setup. Released VLA model checkpoints are typically fine-tuned for specific embodiments, such as the Franka arm from DROID [ 27 ] or the WidowX arm from BridgeData V2 [ 42 ] . Consequently, end-users must either reproduce the exact hardware setup used during training [ 43 ] , or undertake substantial engineering effort