WorldCoder-Bench: Benchmarking Physically Grounded 3D World Synthesis

Shuo Lu, Yinuo Xu, Kecheng Yu, Siru Jiang, Yongcan Yu, Yubin Wang, Haitao Yang, Yuxiang Zhang, Bin Wang, Ran He, Jian Liang, [6pt] NLPR & MAIS, CASIA · 2026

Read WorldCoder-Bench: Benchmarking Physically Grounded 3D World Synthesis by Shuo Lu, Yinuo Xu, Kecheng Yu, Siru Jiang, Yongcan Yu, Yubin Wang, Haitao Yang, Yuxiang Zhang, Bin Wang, Ran He, Jian Liang, [6pt] NLPR & MAIS, CASIA (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01869.txt.

Description

Lu and co-authors build a test for code that creates 3D worlds. Chat models now write interactive worlds, not just static pages. Browser 3D worlds rest on tools like Three.js. Such worlds must obey space and physics rules. Controls must stay in sync with hidden state.

Past tests watch only pixels or page nodes. The canvas hides the world's true mechanics. Their WorldCoder-Bench holds 2,026 expert-made tasks. Tasks span simulation, rendering, and app scenarios. A probe tool runs each program in a sandbox. It checks hidden contracts on states and shifts. The checks are hardened against simple mutation tricks. Scores also track return on automation and time saved.

Catalog record

CREATORShuo Lu, Yinuo Xu, Kecheng Yu, Siru Jiang, Yongcan Yu, Yubin Wang, Haitao Yang, Yuxiang Zhang, Bin Wang, Ran He, Jian Liang, [6pt] NLPR & MAIS, CASIA
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01869

Browse the full library · About the Tower of Babel