RLinf-USER: A Unified and Extensible System for Real-World Online Policy Learning in Embodied AI

Hongzhi Zang, Shu’ang Yu, Hao Lin, Tianxing Zhou, Zefang Huang, Zhen Guo, Yufeng Yue, Quanlu Zhang, Xinlei Chen, Chao Yu, Yu Wang · 2026

Read RLinf-USER: A Unified and Extensible System for Real-World Online Policy Learning in Embodied AI by Hongzhi Zang, Shu’ang Yu, Hao Lin, Tianxing Zhou, Zefang Huang, Zhen Guo, Yufeng Yue, Quanlu Zhang, Xinlei Chen, Chao Yu, Yu Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07837.txt.

Description

Training robots in the real world cannot be sped up, reset cheaply, or copied at scale the way simulation can. So online policy learning is as much a systems problem as an algorithms problem. Hongzhi Zang and sixteen co-authors present USER, a unified and extensible system for real-world online policy learning in embodied AI.

On the systems side, USER abstracts diverse robot hardware and provides an adaptive cloud-edge communication plane. On the learning side, it runs fully asynchronous training with a persistent, cache-aware replay buffer and extensible reward, recipe, and policy interfaces. Tests show multi-robot coordination, varied manipulators, cloud-edge training with large models, and long asynchronous runs. Robot learning teams gain infrastructure for learning directly on physical hardware.

Catalog record

CREATORHongzhi Zang, Shu’ang Yu, Hao Lin, Tianxing Zhou, Zefang Huang, Zhen Guo, Yufeng Yue, Quanlu Zhang, Xinlei Chen, Chao Yu, Yu Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07837

Browse the full library · About the Tower of Babel