Grounded Forcing: Bridging Time-Independent Semantics and Proximal Dynamics in Autoregressive Video Synthesis
Jintao Chen, Chengyu Bai, Junjun Hu ‡, Xinda Xue, Mu Xu · 2026
Read Grounded Forcing: Bridging Time-Independent Semantics and Proximal Dynamics in Autoregressive Video Synthesis by Jintao Chen, Chengyu Bai, Junjun Hu ‡, Xinda Xue, Mu Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06939.txt.
Introduction
Chen and four colleagues steady long-form video with Grounded Forcing. Step-by-step video tools promise endless video but suffer fading meaning, drifting visuals, and slipping control. Tools treat each flaw alone, capping coherence. Grounded Forcing ties video making to stable meaning cores. A dual memory cache splits local motion and global meaning anchors. A dual-anchor tweak keeps position codes in range and global meaning time-free. A one-sided recache smooths meaning handover across prompt changes. Tests show much better long-range hold and steady visuals.
Catalog record
| CREATOR | Jintao Chen, Chengyu Bai, Junjun Hu ‡, Xinda Xue, Mu Xu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40959 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.06939
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Grounded Forcing: Bridging Time-Independent Semantics and Proximal Dynamics in Autoregressive Video Synthesis Jintao Chen, Chengyu Bai, Junjun Hu ‡, Xinda Xue, Mu Xu Abstract Autoregressive video synthesis offers a promising pathway for infinite-horizon generation but is fundamentally hindered by three intertwined challenges: semantic forgetting from context limitations, visual drift due to positional extrapolation, and controllability loss during interactive instruction switching. Current methods often tackle these issues in isolation, limiting long-term coherence. We introduce Grounded Forcing, a novel framework that bridges time-independent semantics and proximal dynamics through three interlocking mechanisms. First, to address semantic forgetting, we propose a Dual Memory KV Cache that decouples local temporal dynamics from global semantic anchors, ensuring long-term semantic coherence and identity stability. Second, to suppress visual drift, we design Dual-Reference RoPE Injection, which confines positional embeddings within the training manifold while rendering global semantics time-invariant. Third, to resolve controllability issues, we develop Asymmetric Proximity Recache, which facilitates smooth semantic inheritance during prompt transitions via proximity-weighted cache updates. These components operate synergistically to tether the generative process to stable semantic cores while accommodating flexible local dynamics. Extensive experiments demonstrate that Grounded Forcing significantly enhances long-range consistency and visual stability, establishing a robust foundation for interactive long-form video synthesis. † † footnotetext: * Equal contribution. \ddagger Corresponding author. Figure 1 : Grounded Forcing for Long-Horizon Interactive Video Generation. Our method generates a coherent 1-minute video with multiple characters (Grandma, cat, and dog) across diverse scenes, maintaining long-term identity consistency while supporting dynamic prompt switching and multi-shot transitions. 1 Introduction The pursuit of interactive, infinite-length video generation represents a pivotal step toward immersive world simulators. While non-autoregressive video synthesis [ 8 , 26 , 23 , 12 , 19 , 20 ] has achieved remarkable fidelity via Diffusion Transformers [ 18 ] , their reliance on bidirectional attention precludes KV caching, resulting in redundant computation and prohibitive inference latency. Consequently, enabling real-time streaming necessitates a paradigm shift toward autoregressive architectures [ 30 , 10 , 22 , 3 , 31 , 2 ] . Such causal frameworks inherently align with temporal progression, facilitating low-latency synthesis and dynamic interaction. However, extending generation from short clips to continuous, long-horizon streams introduces fundamental instabilities that remain unresolved. Specifically, autoregressive video synthesis is hindered by three interconnected challenges: semantic forgetting due to context window limitations, visual drift caused by positional extrapolation, and controllability degradation during dynamic instruction switching. While recent advancements [ 31 , 10 , 6 , 14 , 27 , 25 , 5 , 16 , 7 ] have sought to mitigate instabilities in autoregressive video diffusion, these approaches typically address the aforementioned challenges in isolation. To combat semantic forgetting , prevailing methods [ 25 , 27 , 14 ] anchor attention to the first frame to preserve initial semantics throughout the generation process. However, this rigid reliance on the initial frame is inherently limited in dynamic scenarios. As illustrated in Figure 2 , the model remains fixated on the first frame (e.g., man) rather than adapting to emerging semantics (e.g., Hulk, Silver Wyvern), thereby failing to incorporate new semantic content . Consequently, the semantics of newly introduced content remain forgotten. Moreover, this static anchor unduly constrains semantically independent content, leading to abrupt visual jumps or semantic contamination from the initial frame, thus impeding semantic evolution . To mitigate controllability degradation, existing methods [ 25 , 27 ] propose refreshing the KV Cache with a new prompt to enable prompt switching. However, they strictly require independence between prompts and struggle to maintain consistency in scenarios with drastic contextual shifts. To bridge this gap, we present Grounded Forcing , a comprehensive framework designed to anchor time-independent semantics while accommodating proximal dynamics. The name reflects our core philosophy: Forcing denotes the autoregressive generation process, while Grounded signifies our mechanism to tether the generative trajectory to stable semantic anchors, preventing it from drifting into incoherence. Unlike purely inference-time adaptations, our approach introduces structural innovations that operate synergistically to address the forgetting-drifting-controllability triad. Figure 2 : Limitations of Existing Methods. (a) Infinity-RoPE in Multi-Shot Generation: The model remains fixated on the initial frame (man, red box) and fails to preserve newly introduced entities (Hulk in yellow, Silver Wyvern in purple), demonstrating semantic forgetting . (b) LongLive in Continuous Generation: Rigid anchoring to initial semantics causes visual inconsistencies during semantic transitions, hindering semantic evolution and controllability. First, to combat semantic forgetting, we propose a Dual Memory KV Cache that architecturally decouples memory storage into Local Temporal Memory (LTM) for high-frequency motion and Global Consistency Memory (GCM) for persistent semantic concepts. This ensures that global semantic integrity and identity features remain anchored regardless of temporal depth. Second, to suppress visual drift, we design Dual-Reference RoPE Injection , which confines positional embeddings [ 21 ] within the model’s training manifold by assigning time-invariant indices to global anchors and relative indices to local frames. This prevents the positional degradation that typically disrupts long-term semantic coherence. Third, to resolve controllability loss, we develop Asymmetric Proximity Recache (APR) , a fine-grained update strategy that facilitates smooth semantic inheritance during prompt transitions. By weighting cache updates based on temporal proximity, APR allows immediate adherence to new instructions while preserving long-term context, eliminating the “semantic shock” of uniform cache refreshing. These components form an interlocking system where the Dual Memory provides the structural foundation, Dual-Reference RoPE ensures positional stability, and APR enables flexible interaction. By combining these strategies, Grounded Forcing transforms standard autoregressive models into robust engines for interactive simulation. Our system operates efficiently, delivering long-term semantic coherence and identity stability suitable for real-time applications. The primary contributions of this work are: • We identify the entanglement of static semantics and dynamic motion as a key bottleneck in long-form autoregressive video generation and propose Grounded Forcing to systematically decouple these factors. • We design a Dual Memory KV Cache that anchors long-term semantic coherence via Global Consistency Memory while capturing motion through Local Temporal Memory, fundamentally mitigating semantic degradation. • We introduce Dual-Reference RoPE Injection to prevent positional drift and Asymmetric Proximity Recache for seamless prompt switching, ensuring both visual stability and interactive controllability. • We demonstrate through extensive experiments that our framework achieves state-of-the-art semantic coherence and identity stability in long-form video generation while maintaining real-time performance. 2 Related Work Bidirectional Video Diffusion Models. High-fidelity video generation is predominantly defined by bidirectional denoising diffusion models [ 18 , 9 , 13 ] , including Wan [ 23 ] , HunyuanVideo [ 12 ] , and Sora. These models leverage both past and future frames during denoising to achieve exceptional fidelity and have spawned numerous downstream tasks, including controllable generation [ 17 ] and personalized generation [ 4 , 1 ] . However, this reliance on full temporal context is incompatible with real-time streaming, where future frames are unavailable at inference. Such non-causal dependency precludes key-value (KV) caching and sequential inference, creating a fundamental barrier for low-latency applications. While training-free extensions [ 15 , 33 ] offer limited horizon expansion, they often suffer from pronounced consistency degradation. Autoregressive Video Generation for Long-Horizon Synthesis. To enable real-time streaming and long-horizon video generation, research has shifted toward autoregressive (AR) video diffusion models, which reformulate bidirectional diffusion into a causal framework that generates frames sequentially