3D and 4D World Modeling: A Survey

Lingdong Kong, ​ Wesley Yang, ​ Jianbiao Mei, ​ Youquan Liu, ​ Ao Liang, ​ Dekai Zhu, ​ Dongyue Lu, ​ Wei Yin, ​ Xiaotao Hu, Mingkai Jia, Junyuan Deng, Kaiwen Zhang, Yang Wu, Tianyi Yan, Shenyuan Gao, Song Wang, Linfeng Li, Liang Pan, Yong Liu, Jianke Zhu, Wei Tsang Ooi, Steven C. H. Hoi, Ziwei Liu · 2025

Read 3D and 4D World Modeling: A Survey by Lingdong Kong, ​ Wesley Yang, ​ Jianbiao Mei, ​ Youquan Liu, ​ Ao Liang, ​ Dekai Zhu, ​ Dongyue Lu, ​ Wei Yin, ​ Xiaotao Hu, Mingkai Jia, Junyuan Deng, Kaiwen Zhang, Yang Wu, Tianyi Yan, Shenyuan Gao, Song Wang, Linfeng Li, Liang Pan, Yong Liu, Jianke Zhu, Wei Tsang Ooi, Steven C. H. Hoi, Ziwei Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07996.txt.

Introduction

Lingdong Kong and 22 co-authors survey world models that represent scenes in three and four dimensions in a 2025 review paper. World models let agents understand, represent, and predict their environments. Earlier surveys stressed generative methods for flat images and video, overlooking fast-growing work on depth imagery, occupancy grids, and LiDAR point clouds for large-scale scenes.

Terminology in the field is fragmented, with inconsistent definitions of what counts as a world model. The survey offers a standardised definition and taxonomy while mapping the native 3D and 4D literature. Robots and self-driving systems live in physical space, so models built on real spatial data, evolving over time, are central to their planning and safety.

Catalog record

CREATORLingdong Kong, ​ Wesley Yang, ​ Jianbiao Mei, ​ Youquan Liu, ​ Ao Liang, ​ Dekai Zhu, ​ Dongyue Lu, ​ Wei Yin, ​ Xiaotao Hu, Mingkai Jia, Junyuan Deng, Kaiwen Zhang, Yang Wu, Tianyi Yan, Shenyuan Gao, Song Wang, Linfeng Li, Liang Pan, Yong Liu, Jianke Zhu, Wei Tsang Ooi, Steven C. H. Hoi, Ziwei Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE141 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-07996

Browse the full library · About the Tower of Babel