PanFlow: Decoupled Motion Control for Panoramic Video Generation
Cheng Zhang, Hanwen Liang, Donny Y. Chen, Qianyi Wu, Konstantinos N. Plataniotis, Camilo Cruz Gambardella, Jianfei Cai · 2025
Read PanFlow: Decoupled Motion Control for Panoramic Video Generation by Cheng Zhang, Hanwen Liang, Donny Y. Chen, Qianyi Wu, Konstantinos N. Plataniotis, Camilo Cruz Gambardella, Jianfei Cai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-00832.txt.
Introduction
Cheng Zhang and six coauthors present PanFlow, a 2025 method for generating panoramic video. Panoramic video wraps a full scene around the viewer and feeds virtual reality and other immersive media. Making such video with AI has drawn growing interest, yet control over motion stays weak.
Existing methods often fail when scenes need large, complex movement. PanFlow decouples motion control, handling how things move separately from how they look. That split lets a creator steer movement more directly while the model fills in the scene. Better motion control could make generated panoramas feel less random and more directed.
Catalog record
| CREATOR | Cheng Zhang, Hanwen Liang, Donny Y. Chen, Qianyi Wu, Konstantinos N. Plataniotis, Camilo Cruz Gambardella, Jianfei Cai |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-00832
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PanFlow: Decoupled Motion Control for Panoramic Video Generation Cheng Zhang, Hanwen Liang, Donny Y. Chen, Qianyi Wu, Konstantinos N. Plataniotis, Camilo Cruz Gambardella, Jianfei Cai Abstract Panoramic video generation has attracted growing attention due to its applications in virtual reality and immersive media. However, existing methods lack explicit motion control and struggle to generate scenes with large and complex motions. We propose PanFlow , a novel approach that exploits the spherical nature of pan oramas to decouple the highly dynamic camera rotation from the input optical flow condition, enabling more precise control over large and dynamic motions. We further introduce a spherical noise warping strategy to promote loop consistency in motion across panorama boundaries. To support effective training, we curate a large-scale, motion-rich panoramic video dataset with frame-level pose and flow annotations. We also showcase the effectiveness of our method in various applications, including motion transfer and video editing. Extensive experiments demonstrate that PanFlow significantly outperforms prior methods in motion fidelity, visual quality, and temporal coherence. Our code, dataset, and models are available at https://github.com/chengzhag/PanFlow . Introduction Generating realistic and immersive videos depicting the world around us is among the most compelling challenges in content creation. Panoramic videos, in particular, provide a natural representation by offering continuous 360° views that fully capture the surrounding environment, making them ideal for applications in virtual reality, immersive storytelling, and cinematic content creation. Enabled by advancements in diffusion-based generative models and the availability of panoramic datasets ( 30 ) , recent works have shown promising results in synthesizing photorealistic panoramic scenes from simple text or image prompts ( 17 ; 43 ) . Figure 1: Spherical Camera Optical Flow. The optical flow from a panoramic video (left) can be interpreted as a spherical camera optical flow (right). For complex motion \vec{f} , the camera rotation yields an analytic rotation flow \vec{f}_{r} on the sphere. By decomposing \vec{f} into \vec{f}_{r} and its residual, we obtain a derotated flow \vec{f}_{d} that more clearly captures camera translation and object dynamics. Despite these advances, precise motion control in panoramic video generation remains an open challenge ( 30 ; 37 ) . Unlike traditional perspective videos, panoramic videos require loop consistency across boundaries, both in appearance and motion. Motion in panoramic videos involves complex interactions between two distinct yet intertwined components: object motion and camera motion . Accurate and coherent control of these motion components is crucial for an immersive viewing experience. Any inaccuracies can introduce noticeable artifacts, such as unnatural object trajectories, discontinuous motion across panorama seams, severely degrading the realism and practicality of generated content. In this paper, we address this critical challenge by proposing PanFlow, a novel motion-controllable panoramic video generation framework conditioned on optical flow. We exploit the spherical nature of panoramic imagery and analytically decompose the input optical flow into two fundamental components: a deterministic rotation flow induced by camera rotation on the sphere, and a residual derotated flow that captures camera translations and object dynamics ( Fig. 1 ). This decomposition is not only theoretically grounded, as camera-induced rotation flow is independent of scene content in panoramic view ( 4 ) , but also practically beneficial. It allows us to simplify the motion modeling by conditioning the diffusion model solely on the derotated flow, followed by an inverse derotation to recover the full motion. This decoupled motion control mechanism enhances synthesis stability, improves motion fidelity, and facilitates more coherent and realistic generation of dynamic panoramic scenes. To effectively condition the model on flow, we further introduce a spherical noise warping strategy. Instead of conditioning the model on optical flow embeddings, we warp the initial Gaussian noise across frames using optical flow fields. Importantly, in our design, noise pixels can be propagated across panorama boundaries to ensure seamless motion continuity under spherical geometry. Finally, to support high-quality training, we meticulously curate a large-scale dataset featuring dynamic content, diverse motion, and clean equirectangular projections, with frame-level pose and flow annotations. Leveraging proposed techniques and the curated dataset, PanFlow achieves state-of-the-art performance in panoramic video generation, exhibiting significantly improved motion fidelity, perceptual realism, and temporal coherence over existing approaches. Our contributions are summarized as follows: • We propose PanFlow , the first motion-controllable panoramic video generation framework capable of synthesizing temporally coherent 360° videos from a single image, precisely following user-defined motion flow. • We introduce a decoupled motion control mechanism that isolates rotation flow from translation and object motion, and develop a spherical noise warping strategy to enable flow-conditioned generation that preserves loop consistency across panorama boundaries. • We curate a large-scale, motion-rich panoramic video dataset with frame-level flow and pose annotations, to support training and evaluation in motion-controlled panoramic video synthesis. • Extensive experiments show that PanFlow significantly outperforms prior works in motion fidelity, magnitude, and overall visual quality across multiple benchmarks. Figure 2: Our proposed PanFlow pipeline. Given an input image and text prompt, PanFlow uses a decoupled motion from a video as reference to generate a panoramic video. We first estimate a decoupled optical flow from the reference video, of which the derotated flow is used to generate a latent noise with spherical noise warping. The latent noise then serves as a motion condition for a video diffusion transformer with LoRA fine-tuning to generate derotated videos. Finally, the decoupled rotation is accumulated and applied to the generated video frames to recover the full motion. Related Work Video Diffusion Models Diffusion-based generative models have significantly improved the realism and diversity of synthesized videos. Early efforts extended image diffusion models ( 22 ; 6 ) with temporal modules, while recent approaches ( 39 ; 28 ) embed videos with 3D-VAE and leverage diffusion transformers for denoising. For controllability, most models incorporate conditioning signals such as texts or reference images ( 9 ; 39 ) . Beyond semantic controls, some works employ structural guidance like depth maps or edge cues ( 32 ; 5 ) . Our method focus on motion control by leveraging synthetic optical flow as an explicit, scene-agnostic motion condition, enabling precise and temporally coherent control over dynamic content. Panoramic Image and Video Generation More efforts have adapted diffusion models to panoramic domains for immersive scene synthesis. PanoGen ( 15 ) employed latent diffusion to synthesize indoor panoramas from text, while StitchDiffusion ( 29 ) introduced structural priors to enforce boundary alignment. PanFusion ( 40 ) proposed a dual-branch design to handle global context and local detail. In video domains, DynamicScaler ( 17 ) designed training-free diffusion for panoramic and arbitrary aspect-ratio video generation, while HoloTime ( 43 ) employed 4DGS ( 12 ) to generate explorable 4D scenes. PanoDiT ( 41 ) and PanoWan ( 38 ) finetuned diffusion transformers for panoramic video generation. However, these works lack explicit motion control and often entangle camera and object motions with noticeable artifacts. The closest work to ours is 360DVD ( 30 ) , which extended perspective video diffusion models using 360-Adapter, allowing optional motion conditions. However, it exhibits limited motion control compared to our method, which enables fine-grained, user-customizable motion generation with superior visual quality and motion fidelity. Motion-conditioned Video Generation Precise motion control is essential for interactive and editable video synthesis. Prior works explored object-level control, scene-level control, and motion transfer.