MSVBench: Towards Human-Level Evaluation of Multi-Shot Video Generation
Haoyuan Shi, Yunxin Li, Nanhao Deng, Zhenran Xu, Xinyu Chen, Longyue Wang, Baotian Hu, Min Zhang · 2026
Read MSVBench: Towards Human-Level Evaluation of Multi-Shot Video Generation by Haoyuan Shi, Yunxin Li, Nanhao Deng, Zhenran Xu, Xinyu Chen, Longyue Wang, Baotian Hu, Min Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23969.txt.
Description
Haoyuan Shi and seven co-authors introduce MSVBench, the first comprehensive benchmark for evaluating multi-shot video generation at a human level. The 2026 paper argues that current benchmarks, anchored to single shots, lack the story assets and cross-shot metrics needed to judge long-form coherence and appeal in multi-shot narratives.
MSVBench supplies hierarchical scripts and reference images for multi-shot generation, plus a hybrid evaluation. That evaluation joins high-level semantic reasoning from large multimodal models with fine-grained perceptual checks from expert models. Evaluating many video generation methods, the authors find that current models, despite strong visual fidelity, behave more like visual interpolators than true world models. The benchmark correlates very strongly with human judgments, and fine-tuning on its reasoning traces yields human-aligned performance comparable to leading commercial models.
Catalog record
| CREATOR | Haoyuan Shi, Yunxin Li, Nanhao Deng, Zhenran Xu, Xinyu Chen, Longyue Wang, Baotian Hu, Min Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-23969