Efficient Feature-Free Initialization for Monocular Visual-Inertial Systems Using a Feed-Forward 3D Model

Yuantai Zhang, Jiaqi Yang, Huajian Zeng, Changhao Chen, Haoang Li, Liang Li, Dezhen Song, Xingxing Zuo, [6pt] MBZUAI · 2026

Read Efficient Feature-Free Initialization for Monocular Visual-Inertial Systems Using a Feed-Forward 3D Model by Yuantai Zhang, Jiaqi Yang, Huajian Zeng, Changhao Chen, Haoang Li, Liang Li, Dezhen Song, Xingxing Zuo, [6pt] MBZUAI (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17327.txt.

Introduction

Zhang and colleagues propose a feature-free way to start monocular visual-inertial navigation, using point clouds predicted directly by a feed-forward 3D model instead of tracked visual features. That cuts complexity and removes the usual three-to-four-second data wait. Tests on public sets give the highest success rate, past 90 percent, with startup data typically just over one second, and hold up in degraded visual settings.

Catalog record

CREATORYuantai Zhang, Jiaqi Yang, Huajian Zeng, Changhao Chen, Haoang Li, Liang Li, Dezhen Song, Xingxing Zuo, [6pt] MBZUAI
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69268
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17327

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Efficient Feature-Free Initialization for Monocular Visual-Inertial Systems Using a Feed-Forward 3D Model Yuantai Zhang, Jiaqi Yang, Huajian Zeng, Changhao Chen, Haoang Li, Liang Li, Dezhen Song, Xingxing Zuo, [6pt] MBZUAI Abstract Fast and reliable initialization is critical for monocular visual–inertial navigation systems (VINS), as it establishes the starting conditions for subsequent state estimation. Despite steady progress, most existing methods heavily rely on visual feature correspondences and require 3-4 seconds of sensory data for successful initialization, which limits their applicability and efficiency. With the advent of feed-forward 3D models that can directly predict point clouds from images, we revisit the visual–inertial initialization problem from a concise perspective. In this work, we propose a feature-free initialization framework that leverages up-to-scale point clouds predicted by a feed-forward 3D model, thereby obviating the need for visual feature tracking and estimation. This design substantially reduces system complexity and improves the reliability of initialization. Experiments on public datasets demonstrate that the proposed feature-free initialization method achieves the highest success rate, exceeding 90%, and significantly reduces the data duration required for successful initialization, typically to under 1.2 s. We further validate our method on a self-collected dataset covering various indoor and outdoor scenarios, demonstrating robust performance, particularly in visually degraded environments where existing methods often fail. The code and dataset are available at github.com/Yuantai-Z/FF-VIO-Init . I Introduction Monocular visual-inertial navigation systems (VINS), which combine a single camera with an inertial measurement unit (IMU), enable robust and accurate pose estimation by leveraging the complementary characteristics of visual and inertial sensing. With continued advances in estimation theory, optimization techniques, and sensor fusion algorithms [ 25 , 18 , 9 , 51 , 47 ] , VINS has become a fundamental component in a wide range of applications, including augmented and virtual reality (AR/VR) [ 44 , 16 ] , robotics perception and navigation [ 31 , 14 , 46 , 43 ] . A critical prerequisite for successful monocular VINS is reliable system initialization. Specifically, initialization aims to recover the initial linear velocity and gravity, as well as the metric scale that is inherently unobservable in visual-only pose estimation. Inaccurate initialization may introduce large estimation errors and may even lead to rapid divergence of the state estimator. At the same time, fast initialization is equally important, as it significantly expands the practical applicability of VINS in real-world scenarios such as on-device AR experiences, agile robotic deployment, and emergency navigation, where prolonged initialization periods are undesirable or infeasible. Motivated by these requirements, numerous methods have been proposed to achieve fast and accurate initialization for monocular VINS [ 6 , 50 , 2 ] . However, most existing approaches implicitly or explicitly rely on visual feature tracking across image views and accurate initialization of visual features (i.e., landmarks) from tracked 2D feature observations to establish geometric constraints between different camera frames. In practice, challenging conditions such as textureless environments, rapid camera motion, low-parallax trajectories, motion blur, poor illumination, and sensor noise frequently lead to poor feature tracking and unreliable landmark initialization. Under these conditions, existing monocular VINS initialization methods often become ill-conditioned, resulting in degraded accuracy, delayed convergence, or complete failure. Recent advances in deep learning have catalyzed a paradigm shift in 3D geometric estimation. Feed-forward 3D models have demonstrated remarkable spatial understanding capabilities, enabling end-to-end prediction of scene-level 3D point clouds directly from input images [ 41 , 38 , 40 ] . However, such models typically suffer from inherent scale ambiguity. In this work, we explore the potential of leveraging feed-forward 3D models for fast and reliable monocular VINS initialization, while recovering the metric scale of the underlying 3D scene. We propose a novel feature-free formulation for monocular VINS initialization that exploits geometric constraints from point clouds predicted by a feed-forward 3D model. Our approach bypasses nuisance visual feature extraction and initialization. The initialization pipeline consists of two stages: a closed-form linear system for an initial guess and a nonlinear visual-inertial bundle adjustment (VI-BA) for refinement. Our method not only simplifies the monocular VINS initialization problem into an extremely concise formulation, but also substantially improves its efficiency and robustness. The main contributions are: • We propose an efficient monocular VINS initialization paradigm that leverages point cloud predictions from a feed-forward 3D model. To the best of our knowledge, this is the first work to integrate feed-forward 3D foundation models into monocular VINS initialization. • We derive a feature-free, closed-form linear system that naturally eliminates visual feature association while reliably estimating metric scale, initial velocity, and gravity. • We formulate two variants of VI-BA leveraging constraints from the predicted point clouds: a feature-free formulation that achieves maximum efficiency and success rate, and a scale-constrained formulation that preserves feature correspondences for higher accuracy. • We conduct extensive experiments on both public benchmarks and a self-collected dataset, achieving over 90% success rate while reducing the required data duration across various challenging scenarios. Fig. 1: System overview. A feed-forward 3D model predicts up-to-scale point clouds (yellow) from input images, while IMU measurements are preintegrated (green). These are combined into a feature-free closed-form linear system \bar{\mathbf{A}}(\cdot)\mathbf{x}=\bar{\mathbf{b}}(\cdot) , where \bar{\mathbf{A}}(\cdot) incorporates up-to-scale point cloud geometry and \bar{\mathbf{b}}(\cdot) encodes metric-scale IMU information. The closed-form solution is refined by a compact feature-free bundle adjustment involving only scale and IMU states, finally bootstrapping VINS tracking. II Related Work II-A Monocular Visual-Inertial Initialization Early initialization approaches often relied on static-motion assumptions, but such conditions are frequently violated in practice. Consequently, most existing work focuses on dynamic initialization, which can be broadly categorized into loosely coupled and tightly coupled (closed-form) approaches. Loosely-coupled approaches rely on a successful visual odometry (VO) and align the up-to-scale camera trajectory with inertial constraints to recover metric scale. The initial states are recovered through different steps of linear least-squares [ 29 , 26 ] . In contrast, closed-form solutions, pioneered by [ 6 , 22 ] , tightly couple visual constraints and inertial measurements by jointly recovering feature positions together with the initial states. This approach is later extended by jointly estimating the gyroscope bias [ 13 ] , along with additional observability tests to improve robustness [ 3 ] . More recently, DRT [ 10 ] and sqrtVINS [ 28 ] exploited the coplanarity constraint of epipolar geometry to bypass the estimation for 3D features. However, all aforementioned methods fundamentally depend on reliable feature extraction and tracking, making them inherently sensitive to degeneracy and low-parallax scenarios. II-B Feed-Forward 3D Models Recent advances in 3D geometric perception have driven a paradigm shift from traditional iterative structure-from-motion (SfM) pipelines [ 32 ] to feed-forward models that directly infer scene geometry from images. DUSt3R [ 41 ] and MASt3R [ 17 ] introduce end-to-end formulations that predict point clouds from image pairs, while VGGT [ 38 ] further generalizes this paradigm to multi-view inputs with strong cross-view consistency. Follow-up efforts extend feed-forward 3D models toward longer sequence settings using recurrent network architecture [ 40 , 4 ] , spatial memory [ 36 ] , and SLAM pipeline [ 27 , 21 ] . Despite these advances, feed-forward 3D models typically recover geometry only up to an unknown similarity transformation [ 41 , 38 ] . Several efforts address this limitation by predicting metric depth [ 12 ]

Read the complete text