World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policy
Xiaokang Liu, Zechen Bai, Hai Ci, Kevin Yuchen Ma, Mike Zheng Shou · 2026
Read World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policy by Xiaokang Liu, Zechen Bai, Hai Ci, Kevin Yuchen Ma, Mike Zheng Shou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06508.txt.
Description
Training robot policies by reinforcement learning in the real world is costly and risky. Xiaokang Liu and 4 co-authors present World-VLA-Loop, a closed loop where a video world model and a vision-language-action policy improve each other. World models can stand in for reality, but they follow actions imprecisely, especially near success, and lack reward signals.
The team first curated a data set mixing successes with near-successes to sharpen action-outcome alignment. Their state-aware world model then predicts both future frames and binary rewards from shared latents, coupling reward to generation. As the policy improves, its fresh rollouts retrain the world model, keeping simulator and policy in step. Tests across simulation settings supported the loop.
Catalog record
| CREATOR | Xiaokang Liu, Zechen Bai, Hai Ci, Kevin Yuchen Ma, Mike Zheng Shou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-06508