ConsisDrive: Identity-Preserving Driving World Models for Video Generation by Instance Mask

Zhuoran Yang, Yanyong Zhang · 2026

Read ConsisDrive: Identity-Preserving Driving World Models for Video Generation by Instance Mask by Zhuoran Yang, Yanyong Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03213.txt.

Description

Objects that change identity between video frames undermine driving simulators, and Zhuoran Yang, together with 1 co-author, designs a world model to stop that drift. Autonomous driving needs large multi-view video datasets, and world models generate them cheaply. Without instance-level temporal constraints, though, the same object can change appearance or category across frames, corrupting the training signal for perception systems learning from synthetic data.

Their model, ConsisDrive, masks attention at the instance level. Identity and trajectory masks ensure visual tokens interact only with their own instance features across space and time. A masked loss emphasizes foreground regions with probabilistic instance masking, reducing background noise while preserving scene fidelity. Results on the nuScenes dataset set a new state of the art for driving video generation, with downstream gains.

Catalog record

CREATORZhuoran Yang, Yanyong Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03213

Browse the full library · About the Tower of Babel