ConsisDrive: Identity-Preserving Driving World Models for Video Generation by Instance Mask
Zhuoran Yang, Yanyong Zhang · 2026
Read ConsisDrive: Identity-Preserving Driving World Models for Video Generation by Instance Mask by Zhuoran Yang, Yanyong Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03213.txt.
Description
Objects that change identity between video frames undermine driving simulators, and Zhuoran Yang, together with 1 co-author, designs a world model to stop that drift. Autonomous driving needs large multi-view video datasets, and world models generate them cheaply. Without instance-level temporal constraints, though, the same object can change appearance or category across frames, corrupting the training signal for perception systems learning from synthetic data.
Their model, ConsisDrive, masks attention at the instance level. Identity and trajectory masks ensure visual tokens interact only with their own instance features across space and time. A masked loss emphasizes foreground regions with probabilistic instance masking, reducing background noise while preserving scene fidelity. Results on the nuScenes dataset set a new state of the art for driving video generation, with downstream gains.
Catalog record
| CREATOR | Zhuoran Yang, Yanyong Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-03213