VC-Bench: Pioneering the Video Connecting Benchmark with a Dataset and Evaluation Metrics

Zhiyu Yin, Zhipeng Liu, Kehai ChenLemao Liu, Jin Liu, Hong-Dong Li, Yang Xiang, Min Zhang · 2026

Read VC-Bench: Pioneering the Video Connecting Benchmark with a Dataset and Evaluation Metrics by Zhiyu Yin, Zhipeng Liu, Kehai ChenLemao Liu, Jin Liu, Hong-Dong Li, Yang Xiang, Min Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19236.txt.

Introduction

Zhiyu Yin and eight co-authors define a new video task: filling the gap between two clips. Most video generation starts from text or one image. Real uses like editing and vlogging often need smooth content that joins two clips. The join should look as if one camera shot ran through both.

Their bench, VC-Bench, supplies the data set and the scoring rules for this video connecting task. A shared bench lets rival methods be graded on the same joins. Smooth joins would save editors hours of reshoots and patch shots when two good clips refuse to meet.

Catalog record

CREATORZhiyu Yin, Zhipeng Liu, Kehai ChenLemao Liu, Jin Liu, Hong-Dong Li, Yang Xiang, Min Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-19236

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

VC-Bench: Pioneering the Video Connecting Benchmark with a Dataset and Evaluation Metrics Zhiyu Yin, Zhipeng Liu, Kehai ChenLemao Liu, Jin Liu, Hong-Dong Li, Yang Xiang, Min Zhang Abstract While current video generation focuses on text or image conditions, practical applications like video editing and vlogging often need to seamlessly connect separate clips. In our work, we introduce Video Connecting , an innovative task that aims to generate smooth intermediate video content between given start and end clips. However, the absence of standardized evaluation benchmarks has hindered the development of this task. To bridge this gap, we proposed VC-Bench , a novel benchmark specifically designed for video connecting. It includes 1,579 high-quality videos collected from public platforms, covering 15 main categories and 72 subcategories to ensure diversity and structure. VC-Bench focuses on three core aspects: Video Quality Score V ​ Q ​ S VQS , Start-End Consistency Score S ​ E ​ C ​ S SECS , and Transition Smoothness Score T ​ S ​ S TSS . Together, they form a comprehensive framework that moves beyond conventional quality-only metrics. We evaluated multiple state-of-the-art video generation models on VC-Bench. Experimental results reveal significant limitations in maintaining start-end consistency and transition smoothness, leading to lower overall coherence and fluidity. We expect that VC-Bench will serve as a pioneering benchmark to inspire and guide future research in video connecting. The evaluation metrics and dataset are publicly available at: https://anonymous.4open.science/r/VC-Bench-1B67/ . Figure 1: VC-Bench Overview. We introduce VC-Bench , a tailored benchmark for the novel Video Connecting task. We provide a precise definition of this task and adapt several open-source video generation models to support it. To establish a systematic and comprehensive evaluation framework, we curate a high-quality dataset spanning 15 categories. We develop 9 automated metrics to evaluate model performance across three critical dimensions: Video Quality , Start-End Consistency , and Transition Smoothness . Human subjective validation further confirms the framework’s alignment with human preferences. 1 Introduction Figure 2: Video Score on VC-Bench. Based on VC-Bench, we evaluate the performance of 6 open source models on the Video Connection task. The experimental results can be seen in Table 2 Recent advances in generative AI have transformed video creation, with models such as Sora ( 28 ) , Runway-Gen ( 31 ) , and Pika ( 30 ) demonstrating unprecedented progress in text-to-video and image-to-video generation ( 20 ; 34 ) . These systems greatly enhance creative efficiency, enabling filmmakers and creators to produce concept videos within hours. Yet, existing efforts largely focus on generating standalone clips, leaving continuity-aware generation underexplored. We introduce the task of Video Connecting (VC) : given two clips (a start and an end), the goal is to synthesize transitional content that is both spatio-temporally coherent and consistent with the originals. Unlike general video generation, VC requires strict semantic and visual alignment across discontinuous segments. This formulation captures practical needs—linking discrete shots in vlogs, filling surveillance gaps caused by device failures, or producing narrative transitions in film. More application of VC tasks are listed in Appendix C.2 . By framing VC as a distinct problem, we highlight its potential to bridge the gap between isolated generation and real-world continuity demands. Importantly, VC is not about arbitrarily linking any two unrelated clips. The task is meaningful when clips share a logical, semantic, or narrative relation, where continuity is expected but missing. To enable systematic study, we construct a benchmark covering diverse scenarios and propose multi-dimensional evaluation metrics along three axes: overall video quality, start–end consistency, and transition smoothness. We hope this work lays the foundation for advancing continuity-aware video generation. The main contributions are three-fold: • We are the first to systematically propose the novel task of Video Connecting (VC) , which expands the boundaries of video generation and lays a theoretical foundation for this emerging research direction. • We construct a comprehensive benchmark for video connection, termed VC-Bench , which includes: a test video dataset covering multiple categories and diverse scenarios, as well as a three-dimensional video evaluation paradigm. • Based on this benchmark, we conduct a comprehensive evaluation of multiple video generation models, perform an in-depth analysis of their performance, identify current technical limitations, and propose constructive research suggestions for future development. 2 Related Works 2.1 Video Generation Text-to-Video Generation. Text-to-video (T2V) generation is a technology that leverages AI models to transform natural language descriptions into video content. By understanding the semantics, scenes, and actions in text, it generates high-quality video sequences. In recent years, advancements in diffusion models and transformer architectures have significantly improved the fidelity and consistency of generated videos. 5 using Stable Diffusion to generate images. Sora ( 28 ) can produce high-definition videos, excelling in complex scenes and multi-character interactions, while Kling AI ( 19 ) offer motion control and style presets, suitable for creative generation. Vidu ( 32 ) and Haiper ( 6 ) focus on narrative coherence and story generation capabilities. Wan2.1 ( 37 ) and HunyuanVideo ( 17 ) further advance efficient and cinematic video production, meeting diverse creative demands. Image-to-Video Generation. Image-to-video(I2V) generation is capable of converting static images into dynamic videos. It is applicable to animation production and storytelling, often combined with text prompts to enhance flexibility. Runway Gen-3 Alpha ( 31 ) and Luma AI ( 25 ) support I2V generation with high fidelity, while Jimeng AI ( 15 ) focuses on visual effects for Chinese scenes, generating short videos. Ruyi ( 35 ) and CogVideoX ( 40 ) support video generation based on the first and last frames. LTX-Video ( 9 ) can generate smooth 10s short videos in real time. Open-Sora 2.0 ( 29 ) integrate image and text inputs to produce high-quality dynamic content, significantly enriching visual storytelling possibilities. 2.2 Evaluations on Video Generation In recent years, the rapid development of video generation technology has spawned a variety of metrics to evaluate the generated videos from different dimensions. The relevant evaluation metrics can be organized into the following dimensions: Movement dynamics evaluation: For movement dynamics, multiple benchmarks ( 23 ) analyze motion naturalness through long-duration video datasets. MiraBench ( 16 ) builds a high-quality dataset of long-duration, fine-grained captions to better evaluate temporal consistency and motion intensity in video generation. ( 21 ) proposed DEVIL method, which evaluates the generation ability of the T2V model by defining fine-grained temporal dynamic scores and text prompts at multiple dynamic levels. Text alignment evaluation: The generation model needs to strictly follow the semantic constraints of the text prompts. StoryBench ( 4 ) systematically evaluates the ability to transfer from basic instruction understanding to complex story construction by setting up three levels of progressive tasks. StoryEval ( 39 ) is specifically used to evaluate the model’s ability to handle event-level story presentation. It uses VLMs to perform event-level decomposition and verification of generated videos, and integrates voting mechanisms to improve reliability. 44 have meticulously constructed a benchmark specifically for large vision-language models, aimed at enhancing their visual comprehension and reasoning capabilities. Time coherence evaluation: Temporal coherence is a core challenge of video generation. ChronoMagic-Bench ( 41 ) evaluates the rationality of the gradual process of the T2V model when generating high-dynamic time-lapse videos by introducing MTScore and CHScore. T2VBench (

Read the complete text