MSVBench: Towards Human-Level Evaluation of Multi-Shot Video Generation

Haoyuan Shi, Yunxin Li, Nanhao Deng, Zhenran Xu, Xinyu Chen, Longyue Wang, Baotian Hu, Min Zhang · 2026

Read MSVBench: Towards Human-Level Evaluation of Multi-Shot Video Generation by Haoyuan Shi, Yunxin Li, Nanhao Deng, Zhenran Xu, Xinyu Chen, Longyue Wang, Baotian Hu, Min Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23969.txt.

Description

Haoyuan Shi and seven co-authors introduce MSVBench, the first comprehensive benchmark for evaluating multi-shot video generation at a human level. The 2026 paper argues that current benchmarks, anchored to single shots, lack the story assets and cross-shot metrics needed to judge long-form coherence and appeal in multi-shot narratives.

MSVBench supplies hierarchical scripts and reference images for multi-shot generation, plus a hybrid evaluation. That evaluation joins high-level semantic reasoning from large multimodal models with fine-grained perceptual checks from expert models. Evaluating many video generation methods, the authors find that current models, despite strong visual fidelity, behave more like visual interpolators than true world models. The benchmark correlates very strongly with human judgments, and fine-tuning on its reasoning traces yields human-aligned performance comparable to leading commercial models.

Catalog record

CREATORHaoyuan Shi, Yunxin Li, Nanhao Deng, Zhenran Xu, Xinyu Chen, Longyue Wang, Baotian Hu, Min Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-23969

Browse the full library · About the Tower of Babel