WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Driving

Ziyue Zhu, Zhanqian Wu, Zhenxin Zhu, Lijun Zhou, Haiyang Sun, Bing Wang, Kun Ma, Guang Chen, Hangjun Ye, Jin Xie, Jian Yang · 2025

Read WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Driving by Ziyue Zhu, Zhanqian Wu, Zhenxin Zhu, Lijun Zhou, Haiyang Sun, Bing Wang, Kun Ma, Guang Chen, Hangjun Ye, Jin Xie, Jian Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-23402.txt.

Description

Driving videos from generators look good but often break 3D consistency across views. Ziyue Zhu and 10 co-authors built WorldSplat to generate 4D driving scenes instead. A latent diffusion model reads multi-modal inputs and emits pixel-aligned 4D Gaussians in one forward pass. Those Gaussians render novel view videos directly. An enhanced video diffusion model then refines the renders.

The result is multi-track video that stays consistent in space and time. Reconstruction methods give good novel views but cannot generate, and generators rarely reconstruct well. WorldSplat aims at both. Benchmark tests show high-fidelity, coherent output. Scalable, controllable training data for driving systems is the goal.

Catalog record

CREATORZiyue Zhu, Zhanqian Wu, Zhenxin Zhu, Lijun Zhou, Haiyang Sun, Bing Wang, Kun Ma, Guang Chen, Hangjun Ye, Jin Xie, Jian Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-23402

Browse the full library · About the Tower of Babel