Scaling Sim-to-Real Reinforcement Learning for Robot VLAs with Generative 3D Worlds

Andrew Choi, Xinjie Wang, Zhizhong Su, Wei Xu {firstname.lastname}@horizon.auto · 2026

Read Scaling Sim-to-Real Reinforcement Learning for Robot VLAs with Generative 3D Worlds by Andrew Choi, Xinjie Wang, Zhizhong Su, Wei Xu {firstname.lastname}@horizon.auto (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18532.txt.

Description

Choi and co-authors fine-tune robot vision-language-action models inside worlds built by generative 3D models. A language-driven designer creates 100 varied scenes with new objects and backgrounds. Training across these scenes lifts simulation success from 9.7 percent to 79.8 percent. Tasks also finish faster. The trained policy then moves to a real robot, where success rises from 21.7 percent to 75 percent. Tests with more scenes show that scene variety drives better zero-shot generalization.

Catalog record

CREATORAndrew Choi, Xinjie Wang, Zhizhong Su, Wei Xu {firstname.lastname}@horizon.auto
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53927
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.18532

Browse the full library · About the Tower of Babel