SkyReels-V2 : Infinite-length Film Generative model
SkyReels Team · 2025
Read SkyReels-V2 : Infinite-length Film Generative model by SkyReels Team (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13074.txt.
Introduction
The SkyReels team and co-authors present a video model that can make film style clips of open ended length, in a paper from 2025. Short clips from past models often trade motion quality for sharp frames, and they rarely follow shot language well. The team built a new caption tool to label video with both plain descriptions and shot level detail.
Training ran in stages, with a step that used human feedback to fix motion flaws. A forcing method with a steady noise plan then allowed long videos to be made in a workable search space. A final pass on high quality data refined the look. All code and models were released in public.
Catalog record
| CREATOR | SkyReels Team |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-13074
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SkyReels-V2 : Infinite-length Film Generative model SkyReels Team Abstract Recent advances in video generation have been driven by diffusion models and autoregressive frameworks, yet critical challenges persist in harmonizing prompt adherence, visual quality, motion dynamics, and duration: compromises in motion dynamics to enhance temporal visual quality, constrained video duration (5-10 seconds) to prioritize resolution, and inadequate shot-aware generation stemming from general-purpose MLLMs’ inability to interpret cinematic grammar, such as shot composition, actor expressions, and camera motions. These intertwined limitations hinder realistic long-form synthesis and professional film-style generation. To address these limitations, we propose SkyReels-V2 , an Infinite-length Film Generative Model, that synergizes Multi-modal Large Language Model (MLLM), Multi-stage Pretraining, Reinforcement Learning, and Diffusion Forcing Framework. Firstly, we design a comprehensive structural representation of video that combines the general descriptions by the Multi-modal LLM and the detailed shot language by sub-expert models. Aided with human annotation, we then train a unified Video Captioner, named SkyCaptioner-V1 , to efficiently label the video data. Secondly, we establish progressive-resolution pretraining for the fundamental video generation, followed by a four-stage post-training enhancement: Initial concept-balanced Supervised Fine-Tuning (SFT) improves baseline quality; Motion-specific Reinforcement Learning (RL) training with human-annotated and synthetic distortion data addresses dynamic artifacts; Our diffusion forcing framework with non-decreasing noise schedules enables long-video synthesis in an efficient search space; Final high-quality SFT refines visual fidelity. Experiments demonstrate state-of-the-art performance in prompt adherence (especially the shot language), motion quality with sufficient dynamics, and film-style long-video generation capability, enabling several applications such as story generation, image-to-video synthesis, camera director and elements-to-video generation. All the code and models are available at https://github.com/SkyworkAI/SkyReels-V2 . Figure 1: SkyReels-V2 produces stunningly realistic and cinematic high-resolution videos of virtually unlimited length. The model excels at maintaining visual consistency of the main subject across all frames, ensuring no distortion and delivering exceptional quality throughout the extended video sequences. 1 Introduction Video generation has emerged as a pivotal domain in generative AI, enabling applications from creative content production to virtual simulation. While closed-source diffusion models have successful commercial applications, such as Sora [ 1 ] , Kling1.6 [ 2 ] , Hailuo [ 3 ] , and Veo2 [ 4 ] , open-source models struggles to reduce the performance gap with the closed-source models, among which Wan2.1 [ 5 ] shows a great improvement on the public benchmark and ranks, securing the No.1 position as of 2025-02-24 in V-bench1.0 [ 6 ] . However, the commercial application of these video generative models for film makers still faces great challenges, including a minor text alignment in shot-language prompt following, lack of high-quality motion dynamics, and limited duration (typically 5s-10s). Several factors account for these limitations. Firstly, most of existing methods leverage the general MLLM to caption the video data which has a minor text alignment when handling the movie or film scenario with detailed shot language, such that the generation results will lose the professional movie performance. Secondly, optimization objectives in these models remain underexplored, leading to a poor motion quality that is important for the film maker. Standard denoising losses prioritize the frame-wise appearance learning and struggles with the temporal coherence as analysed in [ 7 ] . Though recent methods try the preference alignment methods to improve all metrics simutanously, such as semantics, aesthetics and motion dynamics. The weighting for each metric will be ill-defined, leading to a sub-optimal result. Furthermore, two primary methods dominates the video generation framework, including the diffusion models and autoregressive (AR) models. While diffusion models have set new benchmarks for visual quality through iterative denoising, and autoregressive (AR) models excel in temporal coherence, existing approaches struggle to harmonize these strengths. For instance, pure diffusion models often produce visually stunning but temporally fragmented outputs, while AR models suffer from error accumulation and degraded resolution. Due to these limitations, both of the methods cannot produce a long-duration video. To combine the merits of both high-fidelity diffusion methods and casual auto-regressive methods, some researchers proposes the diffusion-forcing transformers (DFoT) to bridge this gap but face critical limitations: DFoT’s combinatorial noise schedules lead to unstable training. To overcome these limitations, we propose the SkyReels-V2 that synergizes Multi-modal Large Language model (MLLM), Multi-stage Pretraining, Reinforcement Learning, and Diffusion-forcing framework. Our approach begins with a careful ensemble design for video captioning. We propose a structural representations for a training video clip, which includes the subject type, subject appearance, expression, action, position, etc. Some of the fields can be well understood by the general MLLM models like Qwen2.5-VL [ 8 ] . These fields requires expert models, such as the shot type, shot angle, shot position, expression, and camera motions. To enhance the understanding of these fields, we train several expert models to achieve accurate descriptions. For efficiently labeling, we then distill the knowledge of both the general captioner and expert models into a unified MLLM model - SkyCaptioner-V1 . The final text prompt is refined by a LLM to form the diverse description of video captions following the same original structural information. With these careful text description, we then pretrain a base diffusion model in progressive resolutions. After that we perform a first high-quality SFT stage with concept-balanced data to set up a good initialization for further optimizations. Then, inspired by the success application of Reinforcement Learning in LLM reasoning models like GPT-o1 [ 9 ] and deepseek-R1 [ 10 ] , we enhance the motion quality of the pretrained model through preference optimizations. To tackle the high cost of data annotation in RL, we propose a semi-auto pipeline to produce preference pairs. Besides, to unlock long-video synthesis and reduce convergence uncertainty, instead of pretraining the diffusion-forcing model from scratch, we propose a diffusion-forcing post-training where the pretrained full diffusion model will be finetuned into a diffusion-forcing model. To reduce the search space of denoising schedule as in [ 11 ] ,we use the non-decreasing noise schedule in the consecutive frames, which significantly reduce the Composition Space Size from O(1e48) to O(1e32) . Finally, we train the model in the higher resolution and apply distill techniques to enable a high-quality commercial application. The proposed model also enables several applications including story generation, image-to-video synthesis, camera director and elements-to-video generation. Extensive experiments demonstrate the superior performance of SkyReels-V2 compared to current state-of-the-art methods. To the best of our knowledge, it represents the first open-source video generative model employing diffusion-forcing architecture that achieves the highest V-Bench score among publicly available models. Notably, our solution unlocks unprecedented infinite-length generation capabilities as depicted in Figure 1 . Human assessments conducted through the SkyReels-Bench benchmark further reveal that our model outperforms several closed-source alternatives and demonstrates comparable results with the leading video generative model in the field. Our main contributions are summarized as follow: • Comprehensive video captioner that understand the shot language while capturing the general description of the video, which dramatically improve the prompt adherence. • Motion-specific preference optimization enhances motion dynamics with a semi-automatic data collection pipeline. • Effective Diffusion-forcing adaptation enables the generation of ultra-long videos and story generation capabilities, providing a robust framework for extending temporal coherence and narrative depth. • SkyCaptioner-V1 and SkyReels-V2 series models including diffusion-forcing, text2video, image2video, camera director and elements2video models with various sizes (1.3B, 5B, 14B) are open-sourced.