Ouroboros-Diffusion: Exploring Consistent Content Generation in Tuning-free Long Video Diffusion
Jingyuan Chen, Fuchen Long, Jie An, Zhaofan Qiu, Ting Yao, Jiebo Luo, Tao Mei · 2025
Read Ouroboros-Diffusion: Exploring Consistent Content Generation in Tuning-free Long Video Diffusion by Jingyuan Chen, Fuchen Long, Jie An, Zhaofan Qiu, Ting Yao, Jiebo Luo, Tao Mei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-09019.txt.
Introduction
Jingyuan Chen and co-authors present a method for making long videos that stay consistent from start to end, in work from 2025. A recent approach builds long videos from a text-to-video model by keeping a queue of frames at rising noise levels. Clean frames leave the front of the queue while noise joins the back. That approach often loses track of subjects over time.
The new method adds three fixes. A sampling trick at the queue tail smooths shifts between frames. An attention step aligns the same subject across frames in short segments. A guidance step lets early clean frames steer the noisy frames behind them. Tests on a standard video benchmark show gains in subject consistency, smooth motion, and timing. The method needs no extra training of the base model.
Catalog record
| CREATOR | Jingyuan Chen, Fuchen Long, Jie An, Zhaofan Qiu, Ting Yao, Jiebo Luo, Tao Mei |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-09019
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Ouroboros-Diffusion: Exploring Consistent Content Generation in Tuning-free Long Video Diffusion Thanks: This work was performed at HiDream.ai. Jingyuan Chen, Fuchen Long, Jie An, Zhaofan Qiu, Ting Yao, Jiebo Luo, Tao Mei Abstract The first-in-first-out (FIFO) video diffusion, built on a pre-trained text-to-video model, has recently emerged as an effective approach for tuning-free long video generation. This technique maintains a queue of video frames with progressively increasing noise, continuously producing clean frames at the queue’s head while Gaussian noise is enqueued at the tail. However, FIFO-Diffusion often struggles to keep long-range temporal consistency in the generated videos due to the lack of correspondence modeling across frames. In this paper, we propose Ouroboros-Diffusion, a novel video denoising framework designed to enhance structural and content (subject) consistency, enabling the generation of consistent videos of arbitrary length. Specifically, we introduce a new latent sampling technique at the queue tail to improve structural consistency, ensuring perceptually smooth transitions among frames. To enhance subject consistency, we devise a Subject-Aware Cross-Frame Attention (SACFA) mechanism, which aligns subjects across frames within short segments to achieve better visual coherence. Furthermore, we introduce self-recurrent guidance. This technique leverages information from all previous cleaner frames at the front of the queue to guide the denoising of noisier frames at the end, fostering rich and contextual global information interaction. Extensive experiments of long video generation on the VBench benchmark demonstrate the superiority of our Ouroboros-Diffusion, particularly in terms of subject consistency, motion smoothness, and temporal consistency. 1 Introduction With the rise of artificial visual content generation technologies, significant breakthroughs have been made in video diffusion ( Blattmann et al. 2023 ; Peng et al. 2024 ; Ma et al. 2024b ; Long et al. 2024 ) . However, most current video diffusion models are trained on short clips ( e . g ., 16 frames), a significant challenge when scaling to long video generation. Instead of relying on extensive training data to extend video length, our work focuses on leveraging a pre-trained video diffusion model to generate long videos without extensive training data or fine-tuning. Additionally, we place a strong emphasis on content consistency to enhance both the visual and motion quality of long videos in diffusion. Figure 1: Illustration of FIFO-Diffusion ( Kim et al. 2024 ) (top) and our Ouroboros-Diffusion (bottom) for tuning-free long video generation. The recent first-in-first-out diffusion ( Kim et al. 2024 ) has successfully employed the pre-trained video diffusion model for infinite frame generation. Compared to general video diffusion that all frames share the same noise level, the diagonal denoising approach proposed by Kim et al. 2024 maintains a queue of frames with progressively increasing noise levels, enabling frame-by-frame generation at each step. The upper part of Figure 1 conceptualizes the diagonal denoising process. In this process, a fully denoised frame at the queue head is popped out, while a random noisy latent is pushed to the tail. The latent enqueue-dequeue cycle allows for the incremental generation of video frames. However, the independently enqueued Gaussian noise can lead to content discrepancies between the frame latents near the tail of the queue. Moreover, FIFO-Diffusion fails to utilize visual information contained in the earlier denoised frames, which exacerbates temporal inconsistency in continuous video diffusion. For instance, the appearance of the cat changes significantly in the output video of Figure 1 . Our work addresses this issue with FIFO-Diffusion from two key perspectives: structural and subject consistency. To this end, we introduce a novel denoising framework termed Ouroboros-Diffusion, designed for tuning-free long video generation. Inspired by the ancient symbol of Ouroboros—a serpent or dragon eating its own tail, symbolizing wholeness and self-renewal—our framework embodies these concepts by seamlessly integrating information across time. The design of Ouroboros-Diffusion is guided by three core principles targeting distinct information flows to improve structural and subject consistency: present infers future, present influences present, and past informs present , as depicted in Figure 1 . To enhance structural consistency, we address the critical step of enqueueing new tail noise, which can lead to structural incoherence. From a video continuation perspective, this step involves sampling a future frame that should maintain visual structure continuity with previous frames. To achieve this, we propose inferring the future frame from the present frame in the denoising queue by exploiting the low-frequency component connection between them. Specifically, instead of initializing the tail latent with Gaussian noise, Ouroboros-Diffusion extracts the low-frequency component from the second-to-last frame latent using Fast Fourier Transform (FFT) and combines it with the high-frequency part of random noise to create the enqueued latent. The low-frequency component preserves layout information for overall video consistency, while the high-frequency component introduces necessary video dynamics. For subject consistency, we consider the semantic dependencies of long videos from two angles: within the current denoising queue and between previously generated clear frames and the current queue. To enhance subject temporal coherence within the present queue, we extend self-attention across frames through a Subject-Aware Cross-Frame Attention (SACFA) module. This module leverages segmented subject regions from the cross-attention map to extract subject tokens in each frame, which serve as auxiliary contexts for subject alignment. These tokens are then stored in a subject feature bank. To model longer-range subject dependencies, we introduce a long-term memory of past subjects to guide the appearance of the present subject. Specifically, Ouroboros-Diffusion utilizes the long-term memory derived from the frame at the head of the queue to guide the denoising of noisier frames near the tail, optimizing the latent through a subject-aware gradient during video denoising. The main contribution of this work is the proposal of Ouroboros-Diffusion to address content consistency in turning-free long video generation. Our solution elegantly explored how diagonal denoising could benefit from low-frequency content preservation, and how to preserve subject consistency through cross-frame attention and gradient-based latent optimization in diffusion. Extensive experiments on VBench verify the effectiveness of our proposal in terms of both visual and motion quality. 2 Related Work Text-to-Video Diffusion Models. The great success of text-to-video (T2V) diffusion models ( Ho et al. 2022a ; Voleti, Jolicoeur-Martineau, and Pal 2022 ; Villegas et al. 2023 ; Wang et al. 2023b ; Yin et al. 2023a ; Chen et al. 2023 ; Zhang et al. 2024 ; Guo et al. 2024 ) for video generation based on text prompts has been witnessed in recent years. VDM ( Ho et al. 2022b ) is one of the early works that combines spatial and temporal attention to construct space-time factorized UNet for video synthesis. Later in Make-A-Video ( Singer et al. 2023 ) , the prior knowledge of text-to-image diffusion models is explored in video diffusion and the 2D-UNet is extended with the temporal modules ( e . g ., temporal convolution and self-attention ( Long et al. 2022a ) ) for motion modeling ( Long et al. 2019 ; Long et al. 2022b ; Long et al. 2023 ) . The advances ( An et al. 2023 ; Blattmann et al. 2023 ; Wu et al. 2023a ; Chen et al. 2024b ) further execute the video synthesis on latent space and push the boundaries of high-resolution video generation. Inspired by the impressive performances of Diffusion Transformers (DiTs) ( Peebles and Xie 2023 ; Ma