Persistent Robot World Models: Stabilizing Multi-Step Rollouts via Reinforcement Learning

Jai Bardhan, Patrik Drozdik, Josef Sivic, Vladimir Petrik · 2026

Read Persistent Robot World Models: Stabilizing Multi-Step Rollouts via Reinforcement Learning by Jai Bardhan, Patrik Drozdik, Josef Sivic, Vladimir Petrik (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25685.txt.

Description

Bardhan and co-authors improve robot world models so their video rollouts stay stable for longer. Such models predict future frames from a robot's action sequence. When each clip feeds the next, errors pile up and quality drops fast. Their fix trains the model on its own rollouts with reinforcement learning. The training compares several candidate futures from one state and rewards the sharper ones. Rewards blend perceptual metrics from multiple camera views. On the DROID dataset, the authors report the best rollout scores to date.

Catalog record

CREATORJai Bardhan, Patrik Drozdik, Josef Sivic, Vladimir Petrik
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82262
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25685

Browse the full library · About the Tower of Babel