MaskGWM: A Generalizable Driving World Model with Video Mask Reconstruction

Jingcheng Ni, Yuxin Guo, Yichen Liu, Rui Chen, Lewei Lu, Zehuan Wu · 2025

Read MaskGWM: A Generalizable Driving World Model with Video Mask Reconstruction by Jingcheng Ni, Yuxin Guo, Yichen Liu, Rui Chen, Lewei Lu, Zehuan Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11663.txt.

Description

Ni and co-authors build MaskGWM, a driving world model that learns by rebuilding masked video. World models forecast how a scene changes with actions, a core skill for self-driving. Video diffusion models make sharp clips but often fail on longer horizons and new settings.

The design blends a generation loss with masked feature learning in the MAE style. A scalable diffusion transformer trains with an extra mask rebuilding task. Special mask tokens handle the fuzzy link between rebuilding and diffusion. Row-wise masks extend the task across space and time, with a cross-view module to match. Two model variants are offered.

Catalog record

CREATORJingcheng Ni, Yuxin Guo, Yichen Liu, Rui Chen, Lewei Lu, Zehuan Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-11663

Browse the full library · About the Tower of Babel