FlowLong: Inference-time Long Video Generation via Manifold-constrained Tweedie Matching

Jangho Park, Geon Yeong Park, Gihyun Kwon, Jong Chul Ye · 2026

Read FlowLong: Inference-time Long Video Generation via Manifold-constrained Tweedie Matching by Jangho Park, Geon Yeong Park, Gihyun Kwon, Jong Chul Ye (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20910.txt.

Introduction

Jangho Park and three colleagues present FlowLong, an inference-time method for long video generation via manifold-constrained Tweedie matching. Stretching video diffusion models to long sequences stays a long-standing challenge. Training-free methods split into two kinds: bidirectional versions, tied to certain designs and degrading over long horizons, and autoregressive models, accumulating drift errors and repeated motion. FlowLong generates long videos via overlapping sliding windows, blending clean samples from adjacent windows via Tweedie matching.

Catalog record

CREATORJangho Park, Geon Yeong Park, Gihyun Kwon, Jong Chul Ye
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44943
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20910

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FlowLong: Inference-time Long Video Generation via Manifold-constrained Tweedie Matching Jangho Park, Geon Yeong Park, Gihyun Kwon, Jong Chul Ye Abstract Extending the generation horizon of video diffusion models to long sequences remains a long-standing and important challenge. Existing training-free approaches fall into two categories: extensions of bidirectional models, which are tightly coupled to specific architectures and suffer from quality degradation over long horizons, and autoregressive models, which accumulate drift errors due to exposure bias and tend to produce repetitive motion patterns. To address these issues, we propose a novel but simple inference-time approach for long video generation that is architecture-agnostic and requires no additional training. Our method generates long videos via overlapping sliding windows, where predicted clean samples from adjacent windows are blended via Tweedie matching to enforce both manifold constraint and temporal consistency across overlap regions. Stochastic early-phase sampling then synchronizes per-window trajectories by injecting fresh noise after each Tweedie matching correction in the high-noise phase, before transitioning to deterministic ODE sampling to preserve fine-grained visual fidelity. Applied to various video generation models, our method generates videos several times longer than the native window length while outperforming both training-free and autoregressive baselines in temporal consistency and visual quality, and further extends to audio-video joint generation and text-to-3DGS without any fine-tuning. † † footnotetext: ∗ Equal contribution. † Co-corresponding authors. 1 Introduction Video Diffusion Transformers (DiT) ( 21 ) has driven remarkable progress in video generation, enabling models to produce videos of unprecedented fidelity and motion quality. This rapid advancement has further extended its reach into a diverse range of generative tasks, including camera-controlled video generation ( 34 ; 1 ; 13 ; 10 ) and 3D/4D generation ( 25 ; 7 ; 28 ; 27 ; 20 ) . Among these growing demands, the need for longer video content is particularly pressing across a wide range of applications, from cinematic content creation and interactive storytelling to embodied world models ( 8 ; 3 ; 24 ; 23 ) and immersive AR/VR experiences, where short clips are insufficient. Despite these demands, generating videos significantly longer than the training length remains a fundamental challenge. Most video diffusion models are trained on short clips due to the scarcity of large-scale, high-quality long video data, and directly applying them beyond their training length leads to severe quality degradation. Figure 1: Qualitative results. FlowLong extends pretrained video diffusion models beyond their native context window without any additional training. Being model-agnostic and training-free, it readily applies across diverse tasks: text-to-video generation, joint audio-video generation, and text-to-3DGS. This points toward a versatile, plug-and-play framework for extrapolating the generative horizon of any flow-based model. Please refer to the supplementary video. This has motivated a growing body of work on long video generation, which falls into two categories. The first extends pre-trained bidirectional video diffusion models to longer sequences without additional training (e.g., FIFO-Diffusion ( 16 ) , RIFLEx ( 38 ) , UltraViCo ( 39 ) ). While these methods avoid additional training, they share limitations: consistency degrades as video length grows, visual artifacts accumulate over long horizons, and their reliance on architecture-specific modifications hinders applicability to new models. The second category formulates long video generation autoregressively. CausVid ( 33 ) demonstrates that distillation-based few-step generation can be applied to video, enabling autoregressive generation via KV-cache. Self-Forcing ( 11 ) further addresses the training-inference gap, inspiring follow-up works ( 5 ; 18 ; 31 ; 30 ) . However, these methods suffer from several limitations. Reusing KV-cache across segments causes errors to accumulate over time, leading to exposure bias and temporal drift. Motion diversity also degrades, as the model tends to produce repetitive motion patterns over long horizons. Furthermore, these approaches require distillation from a bidirectional teacher model, making them difficult to apply on the fly to recently introduced architectures such as joint audio-video models ( 9 ) . To overcome these limitations, we propose a novel inference-time framework for long video generation, grounded in the geometric view of flow-based video generative models. Inspired by recent advances in diffusion-based inverse problem solvers ( 4 ) , we reformulate long video generation as an inverse problem that aligns multiple chunk sampling trajectories toward a coherent sequence. Specifically, we regularize each chunk’s denoising path with a guidance loss enforcing smooth and manifold-constrained transitions across overlap frames of adjacent chunks. This eventually reduces to a one-step gradient correction on the denoised estimate during reverse sampling, which takes the closed-form of a simple per-frame interpolation on the overlap region—a procedure we call Tweedie matching . To sustain the effect of this correction and prevent trajectories from reverting to their divergent ODE paths, we further propose stochastic early-phase sampling : noise is injected during the initial stages to break ODE trajectory inertia and facilitate cross-chunk mixing, before transitioning to deterministic ODE sampling phase. Since our framework modulates only the sampling process, it is fully architecture-agnostic, training-free, and free from the exposure bias inherent in KV-cache reuse. It further extends seamlessly to audio-video joint generation and text-to-3D scene generation without any fine-tuning. Our contributions are as follows: • We propose FlowLong , a training-free, model-agnostic framework that extends pretrained flow-based diffusion models beyond their native generation horizon. Operating purely at inference time, FlowLong applies uniformly to text-to-video, audio-video joint, and text-to-3D scene generation without any architectural modification or fine-tuning. • We propose Tweedie matching , which enforces both manifold-constraint and temporal consistency by blending predicted clean samples across overlapping segments, and stochastic early-phase sampling , which breaks per-window trajectory inertia by injecting stochastic noise in the high-noise regime before transitioning to deterministic ODE sampling. • We validate FlowLong across text-to-video, audio-video joint generation, and text-to-3DGS, consistently outperforming both training-free and autoregressive baselines in qualitative and quantitative evaluations without any fine-tuning or backbone-specific modifications. 2 Related Work Bidirectional video diffusion. Recent video diffusion models ( 26 ; 17 ; 9 ) adopt a bidirectional architecture that generates a fixed-length window of frames through full spatio-temporal attention. Training-free approaches extend these models to longer sequences via backbone-specific interventions: FIFO-Diffusion ( 16 ) denoises along a first-in-first-out queue with monotonically increasing noise levels, RIFLEx ( 38 ) reduces the intrinsic frequency of rotary positional embeddings to suppress temporal repetition, and UltraViCo ( 39 ) concentrates attention by suppressing scores for tokens beyond the training window. All of these approaches depend on architecture-specific modifications, coupling them to particular backbones, and the quality still degrades as the target length grows beyond the training distribution. FlowLong instead leaves the backbone untouched and harmonizes multiple overlapping windows via Tweedie matching, decoupling video length from the native window size. Autoregressive video diffusion. The success of autoregressive approaches ( 33 ; 11 ; 5 ; 18 ; 31 ) has demonstrated that fast and robust video generation is achievable through an autoregressive process, with pioneer works ( 33 ; 11 ) extending distribution matching distillation (DMD) ( 32 ) to videos. Despite these advances, generating sequences beyond the trained length causes errors to accumulate, leading to drift and difficulty in maintaining global context coherence. Subsequent works address specific failure modes: Self-Forcing++ ( 5 ) aligns training and inference through a rolling KV cache with backward noise initialization for over four-minute generation, Rolling

Read the complete text