Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstruction
Wenyu Li, Sidun Liu, Peng Qiao, Yong Dou · 2025
Read Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstruction by Wenyu Li, Sidun Liu, Peng Qiao, Yong Dou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13419.txt.
Introduction
Wenyu Li and co-authors wrote this computer vision paper, published in two thousand twenty-five, on rebuilding 3D scenes from photos. New foundation models do this well by matching points across views, but they falter where matching cues run thin, like blank walls or dim rooms.
Their method, Mono3R, adds help from single-image depth reading, which stays steady in those weak spots. A refinement module blends those one-view clues into the multi-view rebuild. The result is a fast, feed-forward system that needs no slow per-scene tuning. Tests across several standard benchmarks show clear gains in camera position accuracy and in the quality of the rebuilt point clouds. The authors present the blend as a fix for a known blind spot. Matching alone, they argue, is not enough for hard scenes.
Catalog record
| CREATOR | Wenyu Li, Sidun Liu, Peng Qiao, Yong Dou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-13419
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstruction Wenyu Li, Sidun Liu, Peng Qiao, Yong Dou Abstract Recent advances in data-driven geometric multi-view 3D reconstruction foundation models (e.g., DUSt3R) have shown remarkable performance across various 3D vision tasks, facilitated by the release of large-scale, high-quality 3D datasets. However, as we observed, constrained by their matching-based principles, the reconstruction quality of existing models suffers significant degradation in challenging regions with limited matching cues, particularly in weakly textured areas and low-light conditions. To mitigate these limitations, we propose to harness the inherent robustness of monocular geometry estimation to compensate for the inherent shortcomings of matching-based methods. Specifically, we introduce a monocular-guided refinement module that integrates monocular geometric priors into multi-view reconstruction frameworks. This integration substantially enhances the robustness of multi-view reconstruction systems, leading to high-quality feed-forward reconstructions. Comprehensive experiments across multiple benchmarks demonstrate that our method achieves substantial improvements in both mutli-view camera pose estimation and point cloud accuracy. August 24, 2026 Figure 1: In this paper, we reveal the limitations of DUSt3R in reconstructing textureless regions and fine structures, as demonstrated in the 2nd row. This fundamentally stems from matching-based approaches, where matching consistency proves difficult to maintain in such challenging areas. To address these limitations, we propose Mono3R, which integrate the robustness of monocular geometry estimation into DUSt3R. Our method can both reconstruct accurate geometry in textureless regions and recover fine structural details, as shown in 3rd row. 1 Introduction The recovery of dense geometric structures from 2D imagery represents a cornerstone challenge in computer vision research, with a rich history spanning several decades [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] . This capability enables applications across diverse domains including robotic navigation [ 8 , 9 , 10 , 11 ] , augmented reality systems [ 12 , 13 ] , autonomous vehicle perception [ 14 , 15 , 16 , 17 ] , and medical diagnostics [ 18 , 19 ] . The intrinsic ill-posed nature of inferring 3D geometry from 2D projections has spawned multiple specialized research directions, each addressing distinct aspects of the reconstruction pipeline: photogrammetric techniques like Structure-from-Motion (SfM) [ 20 , 21 , 22 , 23 , 24 ] , optimization frameworks including Bundle Adjustment (BA) [ 25 , 26 , 27 , 28 ] , dense depth estimation methods such as Multi-View Stereo (MVS) [ 29 , 30 ] and real-time systems exemplified by SLAM implementations [ 31 , 32 , 33 ] . The traditional paradigm for 3D geometric reconstruction relies on elaborate, multi-stage processing pipelines, which demand significant effort for effective integration. The field has witnessed a paradigm shift toward an approach previously deemed infeasible — directly regressing the pointmap, from a pair of uncalibrated images without prior scene information. Trained on millions of image pairs with ground-truth annotations for depth and camera parameters, the representative method, DUSt3R [ 34 ] , shows remarkable performance and cross-domain generalization across various real-world scenarios. While demonstrating impressive results, DUSt3R and its variants [ 35 , 36 , 37 , 38 , 39 ] fundamentally derive pointmap from patchwise similarity matching. The underlying architecture of these methods implicitly assumes visible correspondences in both images. However, matching-based principle poses challenges in ill-posed regions with limited matching cues, e.g., occlusions, textureless areas and repetitive/thin structures, as shown in Fig. 1 . While multi-view reconstruction suffers from inherent matching limitations, monocular 3D estimation has evolved as a parallel approach that circumvents mismatching artifacts. The field has witnessed decades of advancement [ 40 , 41 , 42 , 43 ] . Recent breakthrough, MoGe [ 44 ] , has introduced a novel direct monocular 3D pointmap estimation method and demonstrates significant progress in terms of prediction quality and generalization to new scenes. Nevertheless, when applying to multi-view scenarios, monocular methods exhibit their own characteristic constraints: the predictions for multiple images typically lack consistency. This analysis motivates an intriguing research question: Can we marry the robust geometric priors of monocular geometry estimators with the multi-view consistency of multi-view matching systems? The complementary nature of these approaches - leveraging monocular robustness alongside multi-view precision and consistency - presents a promising avenue for overcoming current limitations in 3D reconstruction. Based on these insights, we propose Mono3R, a novel approach that fully combines the complementary strengths of monocular and stereo algorithms and overcomes the limitations from the lack of matching cues. Given training pair view images, we first separately infer geometry for each image with pre-trained monocular and pairwise geometry estimation models, then we register the monocular point clouds into a unified coordinate system with pairwise pointmap. Subsequently, we refine the pairwise pointmap through the refinement module guided by monocular pointmaps and features, which not only maintains the consistency of multi-view point maps but also leads to more robust results in situations that are hard to match (e.g., occlusions, texture-less regions and reflective surfaces). Thanks to the monocular-guided refinement module, the quality of dense geometry reconstruction is enhanced (See Fig. 1 ). We conduct comprehensive experiments across five benchmark datasets: object-level DTU [ 45 ] , indoor scenes (7Scenes [ 46 ] and Neural-RGBD [ 47 ] ), and unbounded environments (ETH3D [ 48 ] and Tanks & Temples [ 49 ] ) to evaluate both multi-view camera pose estimation and point cloud reconstruction accuracy. Under various evaluation settings, our Mono3R consistently outperforms DUSt3R [ 34 ] and its subsequent variants Spann3R [ 39 ] and Fast3R [ 35 ] . Most notably, for indoor scenarios, Mono3R achieves a 13% improvement in pose estimation accuracy ( \text{MAA}_{30} ) over DUSt3R, demonstrating the effectiveness of jointly optimizing multi-view reconstruction with monocular geometry estimation. Our main contributions can be summarized as follows: • We identify shortcomings of both monocular and multi-view methods and introduce Mono3R, an approach that fully leverages the monocular geometry and feature priors to help estimate multi-view geometry. Our monocular-guided refinement module demonstrates effectiveness, particularly in overcoming matching-based failures. • Through extensive experiments, Mono3R achieves promising results on several downstream tasks, including camera pose estimation and pointmap reconstruction. In particular, Mono3R offers key advantages and robustness over prior works in challenging areas; e.g., occlusions, textureless areas. Figure 2: Our framework consists of two complementary branches and a refinement module. The pairwise branch processes image pairs through feature matching to simultaneously extract cross-image feature correspondences and regress 3D point clouds The monocular branch processes individual images to extract view-specific geometric information. The mono-guided refinement module first performs global Sim(3) alignment to establish a unified coordinate system for the monocular outputs, then iteratively optimizes the pairwise reconstruction for improved accuracy. 2 Related Works Traditional Geometric 3D Reconstruction Geometric 3D Reconstruction is a core computer vision task that recovers the 3D structure of a scene from multiple 2D images. It involves estimating camera parameters (intrinsic and extrinsic) and reconstructing the scene as a point cloud or mesh. Traditional methods for geometric 3D reconstruction are broadly categorized into Structure from Motion (SfM) [ 50 ] and Multi-View Stereo (MVS) [ 51 ] . SfM starts by extracting and matching features [ 52 , 53 , 54 ] , triangulating them into 3D points, and refining the results via