World-Gymnast: Training Robots with Reinforcement Learning in a World Model

Ansh Kumar Sharma, Yixiang Sun, Ninghao Lu, Yunzhe Zhang, Jiarao Liu, Sherry Yang · 2026

Read World-Gymnast: Training Robots with Reinforcement Learning in a World Model by Ansh Kumar Sharma, Yixiang Sun, Ninghao Lu, Yunzhe Zhang, Jiarao Liu, Sherry Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02454.txt.

Description

Ansh Kumar Sharma and 5 co-authors train robot policies inside a learned world model instead of the physical world, in a 2026 arXiv paper. Real robot interaction is expensive, expert demonstrations are limited, and software simulators differ enough from reality to hurt manipulation. World models learned from real video and action data offer a fourth option.

Their system, World-Gymnast, fine-tunes a vision-language-action policy with reinforcement learning inside an action-conditioned video world model. A vision-language model rewards the imagined rollouts. On the Bridge robot setup, the approach beat supervised fine-tuning by up to eighteen times and software simulation by up to two times. It also trained on new instructions and scenes generated by the world model itself. Test-time training in a novel scene and joint improvement of model and policy both worked.

Catalog record

CREATORAnsh Kumar Sharma, Yixiang Sun, Ninghao Lu, Yunzhe Zhang, Jiarao Liu, Sherry Yang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02454

Browse the full library · About the Tower of Babel