Generative View Stitching
Chonghyuk Song Michal Stary Boyuan Chen George Kopanas Vincent Sitzmann, [0.5ex] MIT CSAIL RunwayML · 2025
Read Generative View Stitching by Chonghyuk Song Michal Stary Boyuan Chen George Kopanas Vincent Sitzmann, [0.5ex] MIT CSAIL RunwayML (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24718.txt.
Introduction
Chonghyuk Song, Michal Stary, Boyuan Chen, George Kopanas, and Vincent Sitzmann fix a flaw in video models that build a film step by step. Such models can not use facts from the future of a set camera path. So the fake scene can block the path, and the film then falls apart.
Their method, called GVS, draws the whole film at once so each part fits the full camera path. It joins short chunks with a stitch rule first used for robot plans. No special training is needed for the base video model. A guide step that looks both ways in time helps keep the chunks in line.
Catalog record
| CREATOR | Chonghyuk Song Michal Stary Boyuan Chen George Kopanas Vincent Sitzmann, [0.5ex] MIT CSAIL RunwayML |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-24718
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Generative View Stitching Chonghyuk Song Michal Stary Boyuan Chen George Kopanas Vincent Sitzmann, [0.5ex] MIT CSAIL RunwayML Abstract Autoregressive video diffusion models are capable of long rollouts that are stable and consistent with history, but they are unable to guide the current generation with conditioning from the future . In camera-guided video generation with a predefined camera trajectory, this limitation leads to collisions with the generated scene, after which autoregression quickly collapses. To address this, we propose Generative View Stitching (GVS), which samples the entire sequence in parallel such that the generated scene is faithful to every part of the predefined camera trajectory. Our main contribution is a sampling algorithm that extends prior work on diffusion stitching for robot planning to video generation. While such stitching methods usually require a specially trained model, GVS is compatible with any off-the-shelf video model trained with Diffusion Forcing, a prevalent sequence diffusion framework that we show already provides the affordances necessary for stitching. We then introduce Omni Guidance , a technique that enhances the temporal consistency in stitching by conditioning on both the past and future , and that enables our proposed loop-closing mechanism for delivering long-range coherence. Overall, GVS achieves camera-guided video generation that is stable, collision-free, frame-to-frame consistent, and closes loops for a variety of predefined camera paths, including Oscar Reutersvärd’s Impossible Staircase . Results are best viewed as videos at https://andrewsonga.github.io/gvs . 1 Introduction Recent developments in diffusion models have significantly advanced video synthesis. However, current video diffusion models generate videos with limited context: most models ( Kong et al. 2024 ; Luma AI Team 2024 ; Google DeepMind 2025 ; Wan et al. 2025 ; Runway 2025 ) generate videos between 5 and 10 seconds. This is often less than what users want to generate. However, training models with longer context is costly, making methods that can extrapolate pretrained models to generate videos longer than the training context length an attractive prospect. Existing approaches typically involve “rolling out” a short-horizon model autoregressively; they demonstrate temporal coherence and stability over the course of hundreds of frames ( Chen et al. 2024 ; Song et al. 2025 ) . Autoregressive (AR) sampling can be extended with retrieval-based techniques to enable consistency with respect to the distant past ( Zhou et al. 2025 ; Xiao et al. 2025 ; Yu et al. 2025 ; Cai et al. 2025 ) . However, AR sampling does not enable consistency with respect to the future , i.e. , beyond the current context window: it is not possible to guide the generation to synthesize a future goal frame or for current generations to be consistent with future conditioning variables. This arises in applications such as one-shot cinematography ( Failes 2020 ; Yates 2023 ) and synthetic scenario generation for autonomous driving ( Hu et al. 2023 ; Russell et al. 2025 ) , which entail camera-guided video generation with a predefined camera trajectory. In this task setting, AR sampling may generate a wall that it is later forced to “step through” due to its inability to plan ahead. This often results in video frames that are out-of-distribution to the model, after which generation quickly collapses (see Fig. 1 ). To address this, we explore a non-autoregressive sampling approach to video length extrapolation, which respects future conditioning signals when generating current frames. We are inspired by previous work in diffusion stitching ( Liu et al. 2022 ; Bar-Tal et al. 2023 ; Mishra et al. 2023 ; Kim et al. 2024 ; Yeo et al. 2025 ; Goli et al. 2025 ; Luo et al. 2025 ) , which are sampling methods that generate the entire sequence in parallel , by dividing the sequence into overlapping segments and intertwining their generation processes for consistent connections. Despite their potential for video length extrapolation, existing stitching methods are not suitable for video generation. For example, StochSync ( Yeo et al. 2025 ) , originally designed for generating images such as 360-degree panoramas and 3D mesh textures, lacks the temporal consistency necessary for video generation, as we later show in Sec. 4.1 ; CompDiffuser ( Luo et al. 2025 ) requires a sequence diffusion model specially trained for stitching , but training such a custom model for video is costly. Based on these observations, we propose Generative View Stitching (GVS), the first stitching method for camera-guided video generation. GVS is a training-free stitching approach that is designed to be compatible with any off-the-shelf video model trained with Diffusion Forcing ( Chen et al. 2024 ) , a prevalent framework for training sequence diffusion models ( Decart et al. 2024 ; Yin et al. 2025 ; Song et al. 2025 ; Chen et al. 2025a ; Sand.ai et al. 2025 ) . We then introduce Omni Guidance , which enhances the temporal consistency in stitching by strengthening the conditioning on the past and future and, in turn, enables our proposed loop-closing mechanism for long-range consistency. Our stitching method achieves long-horizon camera-guided video generation that is stable, collision-free, and consistent across both short- and long-term time horizons for a variety of predefined camera paths, including Oscar Reutersvärd’s Impossible Staircase ( Penrose & Penrose 1958 ) (see Fig. 7 ). 2 Related Work and Preliminaries Figure 1: Generative View Stitching (GVS) enables stable camera-guided generation of long videos. Given a pretrained DFoT video model ( Song et al. 2025 ) with an 8-frame context window and predefined camera trajectory, GVS can generate a 120-frame navigation video that is stable, collision-free, faithful to the conditioning trajectory , consistent, and closes loops . On the other hand, Autoregressive sampling diverges due to collisions with the generated scene, is not faithful to the conditioning trajectory, and demonstrates poor loop closure even when augmented with RAG. Diffusion models Diffusion models ( Sohl-Dickstein et al. 2015 ; Ho et al. 2020 ; Song et al. 2021b ) are generative models defined by a forward process that iteratively corrupts a data sample from a target distribution into white noise through a series of noising steps \mathbf{x}^{k}=\sqrt{\alpha^{k}}\mathbf{x}^{0}+\sqrt{1-\alpha^{k}}\mathbf{\epsilon} , where k\in\{0,1,\dots,K-1\} are increasing noise levels, \{\alpha^{k}\}_{k=0}^{K-1} is a predefined schedule, and \epsilon\sim\mathcal{N}(\mathbf{0},\mathbf{I}) . The goal of diffusion modeling is to reverse the forward process by learning the score function \epsilon_{\theta}(\mathbf{x}^{k},k) , which enables iterative denoising of white noise into a sample from the target distribution via: \mathbf{x}^{k-1}=\sqrt{\alpha^{k-1}}\left(\dfrac{\mathbf{x}^{k}-\sqrt{1-\alpha^{k}}\epsilon_{\theta}(\mathbf{x}^{k},k)}{\sqrt{\alpha^{k}}}\right)+\sqrt{1-\alpha^{k-1}-(\sigma^{k})^{2}}\cdot\epsilon_{\theta}(\mathbf{x}^{k},k)+\sigma^{k}\epsilon (1) ( Song et al. 2021a ) , where \sigma^{k} controls the level of stochasticity i.e. , the amount of random noise \epsilon\sim\mathcal{N}(\mathbf{0},\mathbf{I}) injected into each denoising step, a concept that will become important later on. Long Video Generation Video diffusion models often fall short in terms of content resolution, especially temporal resolution, resulting in videos only 5 to 10 seconds long ( Kong et al. 2024 ; Luma AI Team 2024 ; Google DeepMind 2025 ; Wan et al. 2025 ; Runway 2025 ) . This is because the typical diffusion model architecture ( Peebles & Xie 2023 ) uses attention layers that scale quadratically with the number of tokens. One way to avoid this is to retrieve and attend only to a select number of tokens that are relevant for generating each frame ( Xiao et al. 2025 ; Yu et al.