Drift-Resistant Navigation World Model with Anchored Epipolar Guidance
Po-Chien Luan Zimin Xia Wuyang Li Yang Gao Alexandre Alahi [0.1cm] VITA@EPFL, [email protected] Corresponding Author Project Page: https://vita-epfl.github.io/DR-NWM.io/ · 2026
Read Drift-Resistant Navigation World Model with Anchored Epipolar Guidance by Po-Chien Luan Zimin Xia Wuyang Li Yang Gao Alexandre Alahi [0.1cm] VITA@EPFL, [email protected] Corresponding Author Project Page: https://vita-epfl.github.io/DR-NWM.io/ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24761.txt.
Introduction
Po-Chien Luan and others propose a drift-resistant world model. Existing methods feed generated frames back, accumulating noise, while predictions drift from motion. Prediction becomes an anchor-guided rollout: sparse future anchors are predicted first as stable targets. Intermediate frames generate within each chunk from past and future anchors. The anchors also supply geometric constraints through epipolar geometry, localizing where content should appear. Tests on four benchmarks improve looks, geometric consistency, and multi-view coherence, with gains carrying into downstream planning.
Catalog record
| CREATOR | Po-Chien Luan Zimin Xia Wuyang Li Yang Gao Alexandre Alahi [0.1cm] VITA@EPFL, [email protected] Corresponding Author Project Page: https://vita-epfl.github.io/DR-NWM.io/ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53600 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.24761
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Drift-Resistant Navigation World Model with Anchored Epipolar Guidance Po-Chien Luan Zimin Xia Wuyang Li Yang Gao Alexandre Alahi [0.1cm] VITA@EPFL, [email protected] Corresponding Author Project Page: https://vita-epfl.github.io/DR-NWM.io/ Abstract We propose Drift-Resistant Navigation World Model, a generative model that mitigates both perceptual drift and geometric drift in conventional rollout-based navigation world models. Existing methods recursively feed generated content into subsequent steps, causing noise accumulation and degraded predictions, i.e. , perceptual drift . Meanwhile, their predictions often deviate from the agent’s motion, resulting in geometry drift . We address both types of drift by redesigning world-model prediction as an anchor-guided rollout . Instead of rolling out every frame sequentially, we first predict sparse future anchors that serve as stable long-range targets, and then generate intermediate frames within each chunk conditioned on both past context and future anchors. Importantly, these sparse anchors also provide geometric constraints, supported by bidirectional epipolar geometry, to localize where corresponding content should appear in the intermediate frames. Experiments on four benchmarks demonstrate consistent improvements over strong baselines in long-horizon visual quality, geometric consistency, and multi-view coherence. These gains further translate into improved downstream planning performance under the same planners, highlighting the importance of drift-resistant, geometry-aware prediction for reliable navigation world models. 1 Introduction World models [ 9 ] learn the dynamics of the environment, enabling an agent to anticipate future observations before acting [ 19 , 10 , 1 ] . Navigation is a fitting setting for such prediction [ 29 , 4 ] . Because each action changes the robot’s viewpoint, navigation depends on predicting what it will observe after moving. Therefore, a world model provides a natural basis for navigation by forecasting future observations under candidate actions, which can then be used to compare possible trajectories. Despite their promise, current world models for navigation suffer from two drifts ( fig. 1 a). The first is perceptual drift [ 36 , 25 , 21 , 20 ] . Standard practice [ 4 ] involves forecasting future autoregressively, where previous predictions are recursively fed back as inputs for subsequent steps. Consequently, minor per-step errors propagate and compound over time, leading to perceptual drift over extended horizons [ 5 ] . While some methods attempt to mitigate this through inference-like rollout training [ 36 ] , exposing the model to its own errors in this manner introduces prohibitive computational overhead. The second is geometric drift [ 36 , 34 , 3 ] . There are two main reasons for this drift. First, predicted futures may fail to stay aligned with the changes of the agent’s actions, even when they remain perceptually plausible. Second, perceptual drift further corrupts geometric consistency, since degraded predictions provide unreliable visual cues for subsequent viewpoint changes. To enforce geometric fidelity, prior approaches typically rely on costly 3D supervision, such as depth maps or point clouds [ 17 , 35 , 7 , 37 ] . Such supervision is difficult to acquire at scale and often limits generalizability. Both failures are critical bottlenecks for navigation: effective planning requires future simulations that remain stable over long horizons and faithful to the geometry induced by the agent’s motion. Figure 1: (a) Our method improves perceptual and geometric drifts (left: visual quality in long horizons; right: MEt3R [ 2 ] (darker is better)). We use NWM [ 4 ] as an example of an autoregressive (AR) process. Red circles denote the drifts. (b) Anchor-guided rollout improves perceptual drift. Through two anchors, we can form bidirectional epipolar constraints to improve geometric drift. To address these challenges, we adopt a strategy mirrored in both classical robotics [ 18 ] and human behavior [ 23 ] : first planning a distant goal and then determining the steps to reach it. Following this intuition, we decompose future prediction into a two-level hierarchy. Our model first establishes a series of sparse temporal anchors that act as long-term goals for the trajectory. Once these stable anchors are fixed, the model tracks the path between them by generating intermediate frames for each chunk. This effectively partitions the full rollout into shorter, manageable chunks, preventing recursive error accumulation and fundamentally mitigating perceptual drift ( fig. 1 a left). Furthermore, the anchors provide not only temporal guidance but also a geometric benefit. Once both the past and future anchors are available, they define two views of the same rollout, while the action sequence between them provides a motion prior for the intermediate frames. Based on these two views, we use bidirectional epipolar geometry to localize where corresponding content should appear in the intermediate frames (proof in app. A ), as illustrated in fig. 1 (b). This gives the model stronger spatial grounding without requiring explicit 3D supervision ( fig. 1 a right). We propose Drift-Resistant Navigation World Model (DR-NWM) , a generative model that combines anchor-guided rollout and bidirectional epipolar geometry with a Anchor-conditioned Diffusion Transformer (AC-DiT). DR-NWM first predicts sparse anchors at fixed intervals, then generates intermediate frames within each chunk by jointly conditioning on past context and the future anchor. By leveraging bidirectional actions and views, we inject geometry awareness into AC-DiT through bidirectional epipolar masks. As a result, the generated sequences not only remain stable over time but also stay faithful to the geometry induced by the agent’s motion. This paper makes two main contributions. 1) We propose DR-NWM. It jointly mitigates perceptual drift and geometric drift, leading to consistent improvements in long-horizon future prediction and multi-view consistency. These improvements further translate into stronger downstream planning performance. 2) At the core of DR-NWM is anchor-guided rollout, our ingenious design that redefines the role of future anchors: they serve not only as stable long-horizon targets for mitigating recursive drift, but also as key geometric anchors for bidirectional epipolar grounding, enabling geometry-aware prediction without explicit 3D supervision. 2 Related Work Recent work has explored world models as predictive simulators for navigation, improving the paradigm along several directions. NWM establishes controllable future-view generation for navigation with a Conditional Diffusion Transformer backbone, following a conventional autoregressive rollout pipeline that predicts future observations sequentially from past observations and actions [ 4 ] . While effective, this design remains vulnerable to long-horizon error accumulation. MWM improves rollout consistency and deployment efficiency [ 36 ] , while RAE-NWM studies navigation modeling in dense visual representation space to improve long-horizon behavior and action accuracy [ 36 ] . UniWM moves toward a more integrated formulation by unifying visual foresight and planning within a memory-augmented autoregressive architecture [ 16 ] . In parallel, EgoWM leverages pretrained internet-scale video priors for controllable egocentric prediction [ 3 ] , CompACT reduces planning cost through compact latent tokenization [ 16 ] , and one-step world models improve efficiency by replacing iterative diffusion with one-step generation [ 30 ] . Despite these advances, prior work does not directly address the joint problem we consider: reducing long-horizon perceptual drift and improving geometric drift in a monocular and unified setting. Our method instead reformulates future prediction as anchor-guided rollout with bidirectional geometric grounding, which jointly mitigates recursive rollout error and strengthens geometry-aware conditioning without explicit 3D supervision. 3 Method Conventional world models for navigation typically rely on one-sided autoregressive rollout [ 4 ] , where previously generated outputs are recursively used