Multiview Geometric Regularization of Gaussian Splatting for Accurate Radiance Fields Volume: 44 Issue: 4

Jungeon Kim, Geonsoo Park, and Seungyong Lee POSTECH, South Korea · 2025

Read Multiview Geometric Regularization of Gaussian Splatting for Accurate Radiance Fields Volume: 44 Issue: 4 by Jungeon Kim, Geonsoo Park, and Seungyong Lee POSTECH, South Korea (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13508.txt.

Introduction

Jungeon Kim and co-authors present a 2025 method that makes Gaussian splatting scenes geometrically truer. Splatting renders fast but its surfaces often warp. Rival fixes still leave bumpy, unreliable shapes. Their method leans on multiview stereo, which reads depth from many photos.

Stereo depth, color, and surface normals all constrain the splats. Each method covers the other weak spots. Stereo stays robust where colors shift between views. Splatting fills in the detail stereo misses. The payoff is accurate radiance fields for graphics, robotics, and vision use in real indoor and outdoor scenes today.

Catalog record

CREATORJungeon Kim, Geonsoo Park, and Seungyong Lee POSTECH, South Korea
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-13508

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multiview Geometric Regularization of Gaussian Splatting for Accurate Radiance Fields Volume: 44 Issue: 4 Jungeon Kim, Geonsoo Park, and Seungyong Lee POSTECH, South Korea Abstract Recent methods, such as 2D Gaussian Splatting and Gaussian Opacity Fields, have aimed to address the geometric inaccuracies of 3D Gaussian Splatting while retaining its superior rendering quality. However, these approaches still struggle to reconstruct smooth and reliable geometry, particularly in scenes with significant color variation across viewpoints, due to their per-point appearance modeling and single-view optimization constraints. In this paper, we propose an effective multiview geometric regularization strategy that integrates multiview stereo (MVS) depth, RGB, and normal constraints into Gaussian Splatting initialization and optimization. Our key insight is the complementary relationship between MVS-derived depth points and Gaussian Splatting-optimized positions: MVS robustly estimates geometry in regions of high color variation through local patch-based matching and epipolar constraints, whereas Gaussian Splatting provides more reliable and less noisy depth estimates near object boundaries and regions with lower color variation. To leverage this insight, we introduce a median depth-based multiview relative depth loss with uncertainty estimation, effectively integrating MVS depth information into Gaussian Splatting optimization. We also propose an MVS-guided Gaussian Splatting initialization to avoid Gaussians falling into suboptimal positions. Extensive experiments validate that our approach successfully combines these strengths, enhancing both geometric accuracy and rendering quality across diverse indoor and outdoor scenes. \SpecialIssuePaper \CGFStandardLicense ccs Computing methodologies Point-based models † † year: 2025 † † year: 2025 † † editors: B. Wang and A. Wilkie † † subject: Eurographics Symposium on Rendering CGF Vol No † † orcid: 0000-0003-4212-1970 † † orcid: 0009-0007-3839-3582 † † orcid: 0000-0002-8159-4271 † † teaser: Comparison of our and GOF [ YSG24 ] reconstructions from RGB images on the Tanks and Temple ‘Barn’ scene [ KPZK17 ] . Our method reconstructs high-fidelity and smooth surfaces, compared to the state-of-the-art Gaussian Splatting-based surface reconstruction approach [ YSG24 ] . The bottom row shows some of the input RGB images. 1 Introduction Recent advances in neural rendering have yielded impressive capabilities for novel-view synthesis from posed RGB images. Among these, 3D Gaussian Splatting (3DGS) [ KKLD23 ] has garnered significant attention due to its remarkable ability to reconstruct radiance fields rapidly and render high-quality novel views in real-time. Its computational efficiency and rendering quality have spurred numerous downstream research efforts aimed at further refining and extending its capabilities [ XHL∗24 , YCH∗24 , WWZX24 ] . 3DGS represents scenes using a collection of 3D Gaussians, optimizing their parameters (position, shape, opacity, and view-dependent color) through differentiable rendering. However, the 3DGS formulation lacks explicit mechanisms to enforce multiview geometric consistency. Consequently, 3D surfaces extracted from optimized Gaussian parameters using standard techniques like Poisson surface reconstruction [ KH13 ] or truncated signed distance function (TSDF) fusion [ CL96 ] often suffer from significant inaccuracies, noise, and a lack of detail [ GL24 , HYC∗24 ] . To mitigate these geometric shortcomings, several methods enhancing Gaussian splatting have recently emerged [ GL24 , HYC∗24 , YSG24 ] . SuGaR [ GL24 ] incorporates signed distance-induced regularization, encouraging Gaussians to align with an underlying surface. 2D Gaussian Splatting (2DGS) [ HYC∗24 ] introduces a 2D Gaussian representation in the form of disks, which naturally approximate local surface patches as planes and enable multiview consistent rendering. It also proposes single-view regularization terms for normal consistency and depth distortion to promote noise-free and smoother surfaces. Gaussian Opacity Fields (GOF) [ YSG24 ] formulate the contribution of a Gaussian to a ray with explicit ray-Gaussian intersection, enabling the construction of an opacity field, and also utilize the two regularization terms from 2DGS. Despite these advances, approaches relying primarily on such single-view-based geometric regularization methods or implicit surface constraints remain limited in their ability to capture robust and accurate multiview consistent geometry across diverse scenes. Parallel to these rendering-focused methods, multiview stereo (MVS) has long been a fundamental technique for accurate 3D geometry reconstruction from posed images [ SZPF16 , CZYM24 ] . Conventional MVS algorithms typically employ patch-based matching between corresponding image regions, enforcing epipolar constraints, to estimate dense depth maps. These methods excel at producing accurate geometry in well-textured areas and demonstrate resilience to moderate lighting variations. However, they frequently struggle near object boundaries and in texture-less regions, resulting in noisy or incomplete depth estimates [ CZYM24 ] . A key observation motivating our work is the complementary nature of MVS-derived geometry and Gaussian splatting reconstructions. MVS provides precise 3D points in regions rich with visual features but often yields noisy estimates near depth discontinuities or homogeneous areas. Conversely, 3DGS, with its per-point appearance modeling, adeptly captures complex view-dependent effects and can represent sharp object boundaries through the learned opacity and spatial distribution of its Gaussians. However, this very flexibility, particularly the per-point view-dependent appearance, can hinder the optimization process from converging to a geometrically consistent surface across all viewpoints. This challenge is especially pronounced in real-world scenes exhibiting significant appearance variations (e.g., due to lighting or specularity), where the optimization might prioritize fitting appearance over achieving geometric accuracy (Figure 1 ). Figure 1: Complementary relationship between depths estimated by Multiview Stereo (MVS) [ SZPF16 ] and depths rendered by GOF [ YSG24 ] . MVS estimates accurate depths in well-textured regions but often produces noisy depths near object boundaries (top). In contrast, GOF effectively represents sharp object boundaries but may yield geometrically inaccurate surfaces, particularly in regions with view-dependent appearance variations such as lighting and specularity. Leveraging this complementarity, we propose an effective multiview geometric regularization strategy for Gaussian Splatting that integrates the strengths of both MVS and 3DGS. Our goal is to achieve radiance fields that are accurate in both rendered appearance and underlying geometry. Crucially, our regularization is applied at both the initialization and optimization stages of the Gaussian splatting pipeline. During optimization, we utilize MVS depth priors to guide the Gaussians towards the underlying scene surface. To this end, we introduce a median-depth-based multiview relative depth loss incorporating uncertainty from the rendering process itself. For each pixel ray, we compute the rendered median depth via accumulated transmittance thresholding, representing the current estimated surface location, and crucially, we also estimate the uncertainty of this rendered median depth based on the total accumulated transmittance of the ray. Our loss then encourages the positions of Gaussians contributing significantly near this rendered location to align with corresponding MVS depth estimates across relevant views. The strength of this alignment guidance is modulated by the certainty of the rendered median depth. Importantly, relying solely on geometric loss terms during optimization often struggles with suboptimal local minima when starting from sparse or inaccurate Gaussian positions. To mitigate this, we propose a robust MVS-guided initialization procedure. By utilizing geometric information derived from MVS [ SZPF16 ] , we establish a strong, geometrically-aware initial state for the Gaussians, significantly improving the final reconstruction quality (Figure 3 (f)). Furthermore, to promote multiview consistent appearance, we incorporate multiview RGB photometric losses. We also extend the normal consistency and depth distortion regularizers, previously used in single-view contexts [ HYC∗24 ] , into multiview formulations that explicitly enforce geometric smoothness and agreement across multiple viewpoints. These geometric regularizers play a crucial role especially in homogeneous areas where the MVS

Read the complete text