RLinf-USER: A Unified and Extensible System for Real-World Online Policy Learning in Embodied AI
Hongzhi Zang, Shu’ang Yu, Hao Lin, Tianxing Zhou, Zefang Huang, Zhen Guo, Yufeng Yue, Quanlu Zhang, Xinlei Chen, Chao Yu, Yu Wang · 2026
Read RLinf-USER: A Unified and Extensible System for Real-World Online Policy Learning in Embodied AI by Hongzhi Zang, Shu’ang Yu, Hao Lin, Tianxing Zhou, Zefang Huang, Zhen Guo, Yufeng Yue, Quanlu Zhang, Xinlei Chen, Chao Yu, Yu Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07837.txt.
Description
Training robots in the real world cannot be sped up, reset cheaply, or copied at scale the way simulation can. So online policy learning is as much a systems problem as an algorithms problem. Hongzhi Zang and sixteen co-authors present USER, a unified and extensible system for real-world online policy learning in embodied AI.
On the systems side, USER abstracts diverse robot hardware and provides an adaptive cloud-edge communication plane. On the learning side, it runs fully asynchronous training with a persistent, cache-aware replay buffer and extensible reward, recipe, and policy interfaces. Tests show multi-robot coordination, varied manipulators, cloud-edge training with large models, and long asynchronous runs. Robot learning teams gain infrastructure for learning directly on physical hardware.
Catalog record
| CREATOR | Hongzhi Zang, Shu’ang Yu, Hao Lin, Tianxing Zhou, Zefang Huang, Zhen Guo, Yufeng Yue, Quanlu Zhang, Xinlei Chen, Chao Yu, Yu Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07837