FreeLong++: Training-Free Long Video Generation via Multi-band SpectralFusion

Yu Lu, Yi Yang · 2025

Read FreeLong++: Training-Free Long Video Generation via Multi-band SpectralFusion by Yu Lu, Yi Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00162.txt.

Introduction

Yu Lu and Yi Yang stretch short video generators to long videos with no extra training, in work from twenty twenty-five. Text-to-video models make fine short clips but degrade on long runs. Fine detail warps more and more as length grows in naive use. Their frame, FreeLong-plus-plus, blends frequency bands during the cleaning steps. Global low bands carry whole-scene meaning across the full video.

Local high bands from short windows preserve crisp fine detail. Many window sizes stack into branches from global to local views. Bands fuse from low to high across those branches in order. The plug-in fits existing generators with no retraining at all. Videos four and eight times native length beat prior methods clearly. Multi-prompt stories with smooth scene shifts also work in the frame. Long depth or pose guides can steer generation as well.

Catalog record

CREATORYu Lu, Yi Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-00162

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FreeLong++: Training-Free Long Video Generation via Multi-band SpectralFusion Yu Lu, Yi Yang Abstract Recent advances in video generation models have enabled high-quality short video generation from text prompts. However, extending these models to longer videos remains a significant challenge, primarily due to degraded temporal consistency and visual fidelity. Our preliminary observations show that naively applying short-video generation models to longer sequences leads to noticeable quality degradation. Further analysis identifies a systematic trend where high-frequency components become increasingly distorted as video length grows—an issue we term high-frequency distortion . To address this, we propose FreeLong , a training-free framework designed to balance the frequency distribution of long video features during the denoising process. FreeLong achieves this by blending global low-frequency features, which capture holistic semantics across the full video, with local high-frequency features extracted from short temporal windows to preserve fine details. Building on this, FreeLong++ extends FreeLong’s dual-branch design into a multi-branch architecture with multiple attention branches, each operating at a distinct temporal scale. By arranging multiple window sizes from global to local, FreeLong++ enables multi-band frequency fusion from low to high frequencies, ensuring both semantic continuity and fine-grained motion dynamics across longer video sequences. Without any additional training, FreeLong++ can be plugged into existing video generation models ( e.g. Wan2.1 and LTX-Video) to produce longer videos with substantially improved temporal consistency and visual fidelity. We demonstrate that our approach outperforms previous methods on longer video generation tasks ( e.g. 4 × \times and 8 × \times of native length). It also supports coherent multi-prompt video generation with smooth scene transitions and enables controllable video generation using long depth or pose sequences. Additional results and details are available on the project website: https://freelongvideo.github.io/ I Introduction Fig. 1 : Results of Short and Longer Videos. The first row of each case shows short videos generated using short video diffusion models (81 frames for Wan-2.1 [ 1 ] and 121 frames for LTX-Video [ 2 ] ). Directly extending these models to longer videos, like those with 4 \times (324 frames and 484 frames), preserves temporal consistency but lacks fine spatial-temporal details. In contrast, our proposed FreeLong and FreeLong++ adapts short video diffusion models to create consistent long videos with high fidelity. Fig. 2 : Ratio of short video SNR on high (0.25 \pi -1.0 \pi )/low (0.0 \pi -0.25 \pi ) frequency to longer videos. Our findings reveal that when direct extend short video diffusion model to generate longer videos, the SNR of high-frequency components in the space-time frequency domain degrades significantly as video length increases. Fig. 3 : Attention Visualization. We visualize the attention by average across all layers and time steps from Wan2.1 [ 1 ] . The attention maps for 81-frame videos exhibit a diagonal-like pattern, indicating a high correlation with adjacent frames, which helps preserve high-frequency details and motion patterns when generating new frames. In contrast, attention maps for longer videos are less structured, such as 648 frames (8 \times ), making the model struggle to identify and attend to the relevant information across distant frames. This lack of structure in the attention maps results in the distortion of high-frequency components of long videos, which results in the degradation of fine spatial-temporal details. Fig. 4 : Fine-grained frequency analysis on longer video generation. (a) As video length increases, both the range and severity of frequency distortion grow substantially. (b) We define available frequency bands as those with a relative SNR above 0.9. As shown, the number of available bands drops significantly when the video length increases from 2 \times to 4 \times , indicating that a fixed two-branch structure in FreeLong is insufficient for modeling motion dynamics in longer sequences. (c) High-frequency distortion correlates with attention window size: larger window sizes introduce more severe distortion in the high-frequency components. Recent advances in video generation models [ 3 , 4 , 5 , 6 , 7 , 8 , 1 , 2 , 9 , 10 , 11 , 12 , 13 , 14 ] , have enabled the generation of high-quality short videos from text prompts. These models are typically trained on large-scale video-text datasets [ 15 , 16 , 17 , 18 , 19 , 20 , 21 ] , and their ability to produce coherent short clips has inspired research into extending them to long-form video generation [ 22 , 23 , 24 , 17 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 ] . Yet, building long-video generation models requires extensive computational resources and access to large-scale long-video annotations, making them impractical for lightweight and general applications. A more efficient and practical alternative is to adapt pre-trained short video generation models to generate longer video sequences in a training-free manner. Recent studies [ 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 , 42 ] have explored attention mechanisms [ 34 , 40 , 37 ] , auto-regressive architectures [ 36 , 42 ] , and positional encoding [ 38 ] to improve long-range consistency in video clips. However, these approaches often focus on maintaining coherence at the boundaries of adjacent clips rather than enforcing a unified narrative or consistent visual identity across the entire video. As a result, artifacts such as identity drift, inconsistent lighting, and abrupt scene transitions can emerge, particularly in videos with prolonged durations or complex motion dynamics. In this study, we propose a straightforward, training-free method to adapt existing short video generation models for generating consistent longer videos. We first evaluate the direct application of short video generators, such as Wan2.1 [ 1 ] (native length 81 frames), to longer sequences ( e.g. , 4 \times video length, 324 frames). As shown in Figure 1 , this approach ensures global consistency but results in lower-quality outputs, including blurred textures, and motion jitter beyond the model’s native frame length (see the first and second row of Figure 1 ). To understand these issues, we performed frequency analysis on generated long videos. Frequency analysis of generated longer videos revealed stable low-frequency components but significant distortion in high-frequency components as video length increased (Figure 2 ). In a fine-grained frequency analysis, we also observe increasing distortion in high-frequency components as video length grows (see Figure 4 (a)). For example, with double-length sequences, only 30% of the low-frequency content available, leaving 70% of high-frequency components distorted; at 4\times length, distortion rises to 95% (Figure 4 (b)). This diminishes fine details in longer sequences, such as cat fur or tree leaves becoming blurred (Figure 1 , second row). In this paper, we introduce FreeLong , a novel framework that employs SpectralBlend Attention to balance the frequency distribution of long video features in the denoising process. FreeLong integrates global and local features via two parallel streams, enhancing the fidelity and consistency of long video generation. The global stream deals with the entire video sequence, capturing extensive dependencies and themes for narrative continuity. Meanwhile, the local stream focuses on shorter frame subsequences to retain fine details and smooth transitions, preserving high-frequency spatial and temporal information. FreeLong combines global and local video features in the frequency domain, improving both consistency and

Read the complete text