Scaling Sim-to-Real Reinforcement Learning for Robot VLAs with Generative 3D Worlds
Andrew Choi, Xinjie Wang, Zhizhong Su, Wei Xu {firstname.lastname}@horizon.auto · 2026
Read Scaling Sim-to-Real Reinforcement Learning for Robot VLAs with Generative 3D Worlds by Andrew Choi, Xinjie Wang, Zhizhong Su, Wei Xu {firstname.lastname}@horizon.auto (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18532.txt.
Description
Choi and co-authors fine-tune robot vision-language-action models inside worlds built by generative 3D models. A language-driven designer creates 100 varied scenes with new objects and backgrounds. Training across these scenes lifts simulation success from 9.7 percent to 79.8 percent. Tasks also finish faster. The trained policy then moves to a real robot, where success rises from 21.7 percent to 75 percent. Tests with more scenes show that scene variety drives better zero-shot generalization.
Catalog record
| CREATOR | Andrew Choi, Xinjie Wang, Zhizhong Su, Wei Xu {firstname.lastname}@horizon.auto |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53927 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.18532