FlowC2S: Flowing from Current to Succeeding Frames for Fast and Memory-Efficient Video Continuation

Hovhannes Margaryan, Quentin Bammey, Christian Sandor, [0.7em] Team ARAI, Université Paris-Saclay, CNRS, LISN, France · 2026

Read FlowC2S: Flowing from Current to Succeeding Frames for Fast and Memory-Efficient Video Continuation by Hovhannes Margaryan, Quentin Bammey, Christian Sandor, [0.7em] Team ARAI, Université Paris-Saclay, CNRS, LISN, France (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17625.txt.

Introduction

Margaryan, Bammey, and Sandor introduce FlowC2S, a fast, lean method for video continuation. It fine-tunes a trained video flow model that learns a vector field between current and later video chunks. Two design choices drive it. First, optimal couplings from adjacent chunks in training give straighter flows. Second, target inversion injects the target chunk's inverted latent, strengthening links. Flowing from current to later frames halves input size versus mixing frames with noise. It tops FID and FVD scores with as few as five function evaluations.

Catalog record

CREATORHovhannes Margaryan, Quentin Bammey, Christian Sandor, [0.7em] Team ARAI, Université Paris-Saclay, CNRS, LISN, France
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60007
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17625

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FlowC2S: Flowing from Current to Succeeding Frames for Fast and Memory-Efficient Video Continuation Hovhannes Margaryan, Quentin Bammey, Christian Sandor, [0.7em] Team ARAI, Université Paris-Saclay, CNRS, LISN, France Abstract This paper introduces a novel methodology for generating fast and memory-efficient video continuations. Our method, dubbed FlowC2S, fine-tunes a pre-trained text-to-video flow model to learn a vector field between the current and succeeding video chunks. Two design choices are key. First, we introduce inherent optimal couplings, utilizing temporally adjacent video chunks during training as a practical proxy for true optimal couplings, resulting in straighter flows. Second, we incorporate target inversion, injecting the inverted latent of the target chunk into the input representation to strengthen correspondences and improve visual fidelity. By flowing directly from current to succeeding frames, instead of the common combination of current frames with noise to generate a video continuation, we reduce the dimensionality of the model input by a factor of two. The proposed method, fine-tuned from LTXV and Wan, surpasses the state-of-the-art scores across quantitative evaluations with FID and FVD, with as few as five neural function evaluations. The code of FlowC2S is available at https://github.com/marghovo/FlowC2S . Figure 1 : FlowC2S generates video continuations starting the generation directly from the given frames. We achieve this by training a flow matching model between current and succeeding frame distributions with inherent optimal couplings and target inversion. Our method successfully halves the model input dimensionality, generates high-quality video continuations with only five sampling steps, and generalizes to video durations beyond those seen at training. See the appendix for more examples. 1 Introduction Recent advances in image and video generation Rombach et al. 2022 ; Podell et al. 2023 ; Esser et al. 2024 ; Dai et al. 2023 ; Xie et al. 2024 ; Zheng et al. 2024 ; Peng et al. 2025 ; Chen et al. 2025b ; Seawead et al. 2025 have dramatically improved the quality of synthetic media, largely due to diffusion- and flow-based models Sohl-Dickstein et al. 2015 ; Song et al. 2021a ; Ho et al. 2020 ; Song et al. 2021b ; Dhariwal and Nichol 2021 ; Liu et al. 2022 ; Lipman et al. 2023 ; Karras et al. 2024 . Building on this progress, researchers have turned to video continuation : synthesizing a plausible sequence of frames given the current segment of a video. In essence, the goal of video continuation is to generate a temporally coherent and semantically consistent continuation of the input video segment. Success in video continuation would enable key applications in long-horizon video generation, world models, and immersive AR/VR environments. Indeed, AR/VR applications must circumvent the lag introduced by the use of generative models. For example, editing a future frame instead of the current one ensures that it is ready when its timestamp arrives, keeping AR/VR displays synchronized with the real world despite model latency. However, generating a video continuation remains difficult. Maintaining a plausible extension of a visual sequence requires balancing two sometimes-competing objectives: temporal coherence, to ensure realistic motion and smooth dynamics, and visual fidelity, to preserve sharp details and semantic consistency across frames. To tackle this, state-of-the-art methods condition on the given frames and use Gaussian noise to generate a continuation Gao et al. 2024 ; Hassan et al. 2024 ; HaCohen et al. 2024 ; Yin et al. 2025 . While effective, this design has key drawbacks: high memory cost since the model must process both the conditioning frames and noise of output dimensionality, and slow inference as multiple neural function evaluations (NFEs) are required. This is even more of a problem considering that applications such as AR/VR, which rely on video continuation as a building block, require the methods to operate on embedded devices in near-real time. In this work, we introduce FlowC2S , an alternative to the video continuation task. Our model receives a chunk of video frames as input and generates the subsequent video chunk as a plausible continuation of the given input chunk. It preserves semantic coherence with the input while propagating global contextual information. Figure 1 summarizes our results. FlowC2S fine-tunes a pre-trained flow-based text-to-video model (e.g. LTXV HaCohen et al. 2024 or Wan Wan et al. 2025 ) by modifying the initial distribution from the multivariate normal distribution to the distribution of current (or observed) frames. Then it learns a mapping between the input and succeeding frame distributions by flow matching Lipman et al. 2023 ; Liu et al. 2022 ; Albergo and Vanden-Eijnden 2023 . By flowing directly from current to succeeding frames , FlowC2S bypasses the conventional paradigm of conditioning the model on input frames and using Gaussian noise to generate a video continuation. This results in a twofold reduction of model input dimensionality. Additionally, our model is trained using inherent optimal couplings, where the input and the following video chunk from the same video serve as the source and target, respectively. This approach leads to straighter flow trajectories and hence reduces the number of neural function evaluations required at inference to outperform prior methods quantitatively. FlowC2S also uses inverted latents of the target video chunk, achieving improved visual quality. Our approach is capable of generating coherent video continuations without explicit temporal conditioning on the given input video chunk. Fig. 2 illustrates the key difference between the input design adopted by conventional methods and FlowC2S. The primary contributions of this paper are: • We propose a simple yet novel and efficient approach to video continuation by directly flowing from current to succeeding frames, leveraging 2\times more memory-efficient input design, which yields – on the LTXV backbone as an example – approximately 50\% lower peak GPU memory relative to LTXVCondition HaCohen et al. 2024 . • Our method leverages inherent optimal couplings of input and succeeding frames as a proxy for the true optimal couplings, reducing the required neural function evaluations for state-of-the-art quantitative results (e.g., 4× fewer NFEs on LTXV backbone). In addition, we leverage target inversion for enhanced visual fidelity. • Through extensive experiments on multiple datasets Nan et al. 2024 ; Caesar et al. 2020 and backbones HaCohen et al. 2024 ; Wan et al. 2025 , we show that FlowC2S achieves competitive visual quality while substantially improving both GPU memory usage and NFEs. (a) (b) Figure 2 : (a) In conventional approaches, both the given input frames and additional Gaussian noise of the same size as the chunk to be generated are provided to the model at inference. Zero timesteps are used for the conditioning frames. (b) FlowC2S removes the noise; the model directly learns a vector field from current to succeeding frames and thus enables sampling from solely an input video chunk. 2 Related Work Text-to-Video Models. Text-to-video (T2V) diffusion Wang et al. 2023a ; Wang et al. 2023b ; Henschel et al. 2025 ; Chen et al. 2023 ; Wu et al. 2023 ; Blattmann et al. 2023 ; Ma et al. 2025b ; Chen et al. 2024b ; Yang et al. 2025 ; Wu et al. 2023 ; Khachatryan et al. 2023 and flow models HaCohen et al. 2024 ; Wan et al. 2025 ; Zheng et al. 2024 ; Kong et al. 2025 ; Peng et al. 2025 ; Ma

Read the complete text