AtlasVid : Efficient Ultra-High-Resolution Long Video Generation via Decoupled Global-Local Modeling
Ziyang Mai, Yuyao Zhang, Yu-Wing Tai · 2026
Read AtlasVid : Efficient Ultra-High-Resolution Long Video Generation via Decoupled Global-Local Modeling by Ziyang Mai, Yuyao Zhang, Yu-Wing Tai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16649.txt.
Introduction
Mai, Zhang and Tai propose AtlasVid, a framework for ultra-high-resolution long video generation that splits global and local modeling. A low-resolution, low-frame-rate proxy first sets the overall scene and timing, then a high-resolution branch adds fine detail with locality-preserving attention. Training only at 720p with light adaptation, it still generalizes directly to 4K and beyond for clips over ten seconds. Experiments report a 60.9-fold speedup over native 4K generation with better quality.
Catalog record
| CREATOR | Ziyang Mai, Yuyao Zhang, Yu-Wing Tai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41661 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16649
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AtlasVid : Efficient Ultra-High-Resolution Long Video Generation via Decoupled Global-Local Modeling Ziyang Mai, Yuyao Zhang, Yu-Wing Tai Abstract Recent diffusion-based video generators have achieved remarkable visual fidelity and prompt controllability, yet scaling them to ultra-high-resolution (UHR) long videos remains prohibitively expensive. The difficulty is especially pronounced for long single-shot generation where a continuous scene must preserve global temporal coherence, and fine-grained spatial details without relying on clip transitions or autoregressive shot stitching. In this work, we revisit this challenge from the perspective of decoupled modeling. We argue that existing video diffusion models already encode strong local visual priors, while the main bottleneck lies in efficiently extending global spatiotemporal modeling as resolution and duration increase. Based on this insight, we propose AtlasVid , a decoupled global-local framework for efficient UHR long video generation. AtlasVid first generates a low-resolution and low-FPS global semantic proxy via temporally scaled RoPE, thereby extending the temporal horizon without increasing the training token count. Guided by this proxy, a high-resolution detail branch performs joint denoising with hierarchical locality-preserving attention. Reordered spatiotemporal windows preserve geometric locality and asymmetric global-local attention injects aligned semantic guidance and preserves the model’s pretrained ability. This design enables resolution-agnostic training: the model is trained only at 720P with lightweight LoRA adaptation, yet generalizes directly to 4K and beyond for longer (>10s) video synthesis. Experiments show that AtlasVid substantially improves the efficiency of ultra-high-resolution long video generation, achieving high-quality UHR long video generation with 60.9 × 60.9\times speed up and significantly less training cost and even better performance than native 4K video generators. Figure 1: AtlasVid enables the generation of ultra-high-resolution and long-duration videos in different settings, including 8K 29 frames, 4K 161 frames and 2K 321 frames. Frame index indicated in the top-left corner and the output resolution in the top-right corner. Bottom: AtlasVid runs 60.9× faster than UltraWan at 4K × 81 frames (left) and reduces per-layer attention FLOPs by up to 1208.2× over FlashAttention from 720p to 8K (right). 1 Introduction The field of video generation has advanced rapidly, driven by Diffusion Models ( 15 ) and the Diffusion Transformer (DiT) architecture ( 31 ) . Recent text-to-video (T2V) systems ( 1 ; 4 ; 23 ; 22 ; 36 ; 25 ; 12 ; 11 ; 28 ; 39 ) have significantly improved realism and visual fidelity, enabling compelling video synthesis from text or image prompts. As these models mature, the focus is shifting from prompt following and visual quality toward high-resolution, long-duration generation, motivated by applications in filmmaking, television, and professional content creation, where fine-grained spatial detail and long-range temporal coherence are both critical. To meet this demand, industrial systems ( 30 ; 8 ; 33 ; 35 ) rely on massive data and computation to support generation up to 2K resolution, typically in a clip-by-clip autoregressive manner. However, each clip is usually limited to less than 5 seconds. Meanwhile, academic works have explored long-video streaming generation ( 46 ; 19 ; 6 ; 38 ) and planning-based methods for extended video creation ( 18 ; 56 ; 54 ; 10 ) , yet genuinely long single-shot generation remains out of reach. In real-world scenarios, however, high-resolution long single-shot videos are often required, such as cinematic long takes, music and dance performances, and documentary-style footage. A major challenge is the inherent complexity of the DiT architecture, whose full-attention mechanism scales quadratically with the spatiotemporal input size, i.e., O((HWT)^{2}) , where H , W , and T denote the height, width, and temporal length of the video. Consequently, doubling all three dimensions increases the computational cost by 64\times . Moreover, directly training models at ultra-high resolution can introduce additional and unpredictable difficulties such as severe memory pressure, training instability at extremely long token sequences, and the scarcity of native 4K long-video training data. Existing methods ( 13 ; 43 ; 57 ) alleviate this issue with a "generation-then-super-resolution" pipeline. However, this "pseudo high-resolution" paradigm mainly improves sharpness and often fails to recover sufficiently rich high-frequency details. Another line of work ( 5 ; 51 ; 40 ) improves efficiency through sparse or linearized attention mechanisms, although faster, they do not fundamentally resolve the substantial data bottleneck of high-resolution long-video generation. These limitations prompt a rethinking of what fundamentally restricts high-resolution long-video generation. We hypothesize that pretrained video generation models already possess much of the visual knowledge required to synthesize plausible fine-grained details at higher resolutions, since pretraining exposes them to similar objects, structures, and scenes across different visual scales. From this perspective, the main bottleneck is not an inherent lack of high-resolution generation capacity, but the difficulty of modeling long-range dependencies efficiently as the spatiotemporal resolution grows. Motivated by this view, we propose a hierarchical locality-preserving attention mechanism for efficient high-resolution long-video generation. Our design decouples the modeling of local neighborhood structure from global semantics, allowing the model to scale more effectively across resolutions. Furthermore, we introduce a temporal-scale RoPE strategy for long-video modeling, which enlarges the temporal modeling range without increasing the token count. By combining hierarchical locality-preserving attention with temporal-scale positional modeling, our framework enables efficient ultra-high-resolution video generation and reduces the data and resource demands of scaling. • Through the decoupled modeling of global semantic and local details, we significantly reduce the computing complexity of ultra-high-resolution generation leading to a speedup of 60.9\times compare to Wan2.1-1.3B baseline. • Enabled by our resolution-agnostic training paradigm, AtlasVid is the first method to jointly scale up both spatial resolution and temporal duration (i.e 4K, 321frames) without the data bottleneck to our knowledge. • The full pipeline can be trained via LoRA fine-tuning at 720P resolution on as few as 2 NVIDIA RTX Pro 6000 GPUs and inference on 1 GPU within 29 minutes, with the learned capability transferring directly to 4K inference without any additional high-resolution training stage. In comparison to other method which requires massive training on more than 32 GPUs clusters, AtlasVid substantially lowers the resource barrier ultra-high-resolution long video generation. 2 Related Work Table 1: Training resource comparison with state-of-the-art high-resolution video generation methods. Method GPUs Training Stage Max Frames Max Reso. Duration UltraWan-4K ( 44 ) 7.6K H20-hours LoRA on Wan-1.3B 29f 4K \sim 1.2s UltraGen ( 17 ) 32 \times H20 4K direct fine-tuning 29f 4K \sim 1.2s T3-Video ( 47 ) 64 720P \rightarrow 4K (two-stage) 81f 4K \sim 3.4s AtlasVid (Ours) 2 \times RTX Pro 6000 720P (+ optional 4K) 321f > 4K \sim 13.4s 2.1 High Resolution Video Generation Recent diffusion transformer based video generation models ( 39 ; 36 ; 16 ) have demonstrated impressive synthesis quality, yet they are still largely trained at resolutions up to 720P. Scaling these models to ultra-high resolution (UHD), such as 4K, remains challenging due to the quadratic complexity of full attention with respect to token count and the scarcity of high-quality 4K video data. Training-free methods ( 14 ; 53 ; 32 ; 42 ) adapt pretrained models to higher resolutions by modifying attention patterns, receptive fields, or positional encodings at inference time. While computationally convenient, they rely entirely on low-resolution priors and often suffer from semantic repetition, over-smoothed textures, and content inconsistency at 4K. Video super-resolution methods ( 13 ; 43 ; 57