MaskGWM: A Generalizable Driving World Model with Video Mask Reconstruction
Jingcheng Ni, Yuxin Guo, Yichen Liu, Rui Chen, Lewei Lu, Zehuan Wu · 2025
Read MaskGWM: A Generalizable Driving World Model with Video Mask Reconstruction by Jingcheng Ni, Yuxin Guo, Yichen Liu, Rui Chen, Lewei Lu, Zehuan Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11663.txt.
Description
Ni and co-authors build MaskGWM, a driving world model that learns by rebuilding masked video. World models forecast how a scene changes with actions, a core skill for self-driving. Video diffusion models make sharp clips but often fail on longer horizons and new settings.
The design blends a generation loss with masked feature learning in the MAE style. A scalable diffusion transformer trains with an extra mask rebuilding task. Special mask tokens handle the fuzzy link between rebuilding and diffusion. Row-wise masks extend the task across space and time, with a cross-view module to match. Two model variants are offered.
Catalog record
| CREATOR | Jingcheng Ni, Yuxin Guo, Yichen Liu, Rui Chen, Lewei Lu, Zehuan Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-11663