UGOD: Uncertainty-Guided Differentiable Opacity and Soft Dropout for Enhanced Sparse-View 3DGS

Zhihao Guo, Peng Wang, Zidong Chen, Xiangyu Kong, Yan Lyu, Guanyu Gao, Liangxiu Han · 2025

Read UGOD: Uncertainty-Guided Differentiable Opacity and Soft Dropout for Enhanced Sparse-View 3DGS by Zhihao Guo, Peng Wang, Zidong Chen, Xiangyu Kong, Yan Lyu, Guanyu Gao, Liangxiu Han (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04968.txt.

Introduction

Zhihao Guo and co-authors improve, in 2025, a fast three-dimensional rendering method when only a few photos are available. The method builds scenes from soft blobs, but treating every blob equally invites overfitting on sparse views. Their idea lets each blob carry a learned uncertainty score.

That score steers how transparent each blob becomes, and a soft dropout step turns the scores into drop chances during rendering, discouraging blobs that add noise. Across standard test scenes, the method produced cleaner reconstructions with fewer blobs than rival sparse-view approaches. On one benchmark it lifted image quality scores by over three percent against a close competitor.

Catalog record

CREATORZhihao Guo, Peng Wang, Zidong Chen, Xiangyu Kong, Yan Lyu, Guanyu Gao, Liangxiu Han
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-04968

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

UGOD: Uncertainty-Guided Differentiable Opacity and Soft Dropout for Enhanced Sparse-View 3DGS Zhihao Guo, Peng Wang, Zidong Chen, Xiangyu Kong, Yan Lyu, Guanyu Gao, Liangxiu Han Abstract 3D Gaussian Splatting (3DGS) has become a competitive approach for novel view synthesis (NVS) due to its advanced rendering efficiency through 3D Gaussian projection and blending. However, Gaussians are treated equally weighted for rendering in most 3DGS methods, making them prone to overfitting, which is particularly the case in sparse-view scenarios. To address this, we investigate how adaptive weighting of Gaussians affects rendering quality, which is characterised by learned uncertainties proposed. This learned uncertainty serves two key purposes: first, it guides the differentiable update of Gaussian opacity while preserving the 3DGS pipeline integrity; second, the uncertainty undergoes soft differentiable dropout regularisation, which strategically transforms the original uncertainty into continuous drop probabilities that govern the final Gaussian projection and blending process for rendering. Extensive experimental results over widely adopted datasets demonstrate that our method outperforms rivals in sparse-view 3D synthesis, achieving higher quality reconstruction with fewer Gaussians in most datasets compared to existing sparse-view approaches, e.g., compared to DropGaussian, our method achieves 3.27% PSNR improvements on the MipNeRF 360 dataset. Introduction Figure 1: Peak Signal-to-Noise Ratio (PSNR) over iterations on the Mip-NeRF 360 Bicycle scene (24,970 initial Gaussians) and Tanks and Temples Truck scene (66,674 initial Gaussians). (a) Sparse initialisation leads to rapid overfitting and stagnant testing PSNR in baseline 3DGS*, while denser initialisation enables continued improvement. (b) The proposed work effectively suppress overfitting and improve generalisation, even under sparse initialisation. The bottom qualitative comparisons show that our approach yields better visual quality and higher PSNR than rivals. From 2D images as input to generate continuous high fidelity 3D reconstructed environments, which we also call it Novel View Synthetic (NVS), can contribute greatly to techniques like Digital Twinning, AR/VR and robotic embodiment ( Wang et al. 2024c ; Fei et al. 2024 ; Xiong et al. 2024 ; Wang et al. 2024a ) . 3D Gaussian Splatting (3DGS) ( Kerbl et al. 2023a ) has emerged as a competitive approach for achieving real-time yet high-fidelity 3D scene synthesis. This is mostly attributed to its creative idea of representing scenes using a set of 3D Gaussians (ellipsoids) with learnable attributes like positions and colours. Once trained, these Gaussians are fed to the rasterisation-based forward rendering pipeline to be blended to yield the reconstructed scenes. Compared to classical rivals like Neural Radiance Fields (NeRF) and its variants ( Mildenhall et al. 2021 ; Guo and Wang 2024 ) that rely on inefficient ray sampling, 3DGS enables efficient parallel rendering, making it a compelling choice for modern NVS applications. However, despite its advantages, 3DGS faces challenges in handling sparse-view scenarios, where the initialisation of Gaussians from Structure-from-Motion (SfM) point clouds is often incomplete or noisy. This leads to overfitting during optimisation, where the model fits training views excessively while failing to generalise to novel (testing) views. SfM-free methods such as DUSt3R ( Wang et al. 2024b ) and MASt3R ( Duisterhof et al. 2024 ) regress 3D points directly from images using pretrained models for Gaussian initialisation, which also suffer from overfitting, etc. As shown in Figure 1 , the baseline 3DGS* quickly stagnates and even declines in test PSNR due to overfitting, especially when initialised with sparse point clouds. Another under-explored question in existing 3DGS methods is: whether all Gaussians should be treated equally during rendering once training is complete ( Han and Dumery 2025 ; Li and Cheung 2024 ) . In practice, Gaussians exhibit strong view-dependence: a Gaussian may appear certain from one direction but highly uncertain from another. This issue is further exacerbated in sparse-view scenarios, where the initialisation of Gaussians is often incomplete or noisy. These observations motivate a systematic investigation into how adaptive, view-dependent treatment of Gaussians impacts rendering quality. This paper aims to address these challenges by primarily investigating how reliable each Gaussian is for rendering, which is learned and characterised by their ‘uncertainty’ using a neural network module that is integrated to the 3DGS pipeline. The uncertainty refers to a per-Gaussian, view-dependent parameter, learned by the neural network conditioned on spatial features (position, rotation, scale) and the current viewing direction: a higher uncertainty indicates that the Gaussian is less reliable and thus should be handled with propotional caution, while a lower uncertainty suggests greater confidence and indicates potential of further exploitation. Our approach ensures that uncertainty is learned in a fully differentiable manner, enabling two key functionalities: (1) adaptive modulation of opacity without disrupting the integrity of the 3DGS pipeline, making our method easily reusable by the research community; (2) application of soft, differentiable dropout regularisation, which transforms the predicted uncertainty into continuous drop probabilities that govern the final Gaussian projection and blending process. In summary, our contributions are as follows: • Gaussians Uncertainty Learning: We propose to learn an uncertainty for each Gaussian based on its spatial properties (position, scale, rotation) and the current viewing direction. This uncertainty captures per-Gaussian ambiguity within a view-dependent context, aligning with the fact that perceptions are view-dependent. • Uncertainty-Guided Opacity Modulation: We utilise the learned uncertainty to modulate the opacity, which plays a critical role in rendering quality. In comparison, the opacity in literature has been treated as fixed when learned, which overlooks view-dependent unceratainty of Gaussians undermine the rendering quality. • Uncertainty-Guided Differentiable Soft Dropout: We introduce an uncertainty-guided soft dropout module guided by the learned uncertainty, which drops Gaussians with high uncertainty softly to further improve rendering quality. Together our work suppresses overfitting and improves rendering quality in sparse-view 3D reconstruction. Related works 3D Gaussian Splatting 3DGS has rapidly become a leading approach for NVS due to the tradeoff between rendering efficiency and quality. By representing scenes as collections of 3D Gaussians, rendering can be achieved by simply projects them onto the 2D image plane. This process, combined with depth sorting and \alpha -blending, enables efficient and high-fidelity scene reconstruction in real time. Recent works have further improved 3DGS by addressing camera pose sensitivity ( Yu et al. 2024 ) and refining point management for enhanced rendering quality ( Yang et al. 2024 ; Zhang et al. 2024b ; Bulò, Porzi, and Kontschieder 2024 ) . However, opacity modeling in 3DGS remains relatively underexplored, despite its critical role in accurate scene reconstruction and generalisation. Most existing methods treat opacity as a fixed or independently optimised parameter, overlooking its geometric and view-dependent nature. Only a handful of studies have investigated opacity optimization for 3DGS: Celarek ( Celarek et al. 2025 ) provides a mathematical analysis of opacity-based versus extinction-based formulations in 3DGS and volumetric rendering. Talegaonkar ( Talegaonkar et al. 2024 ) proposes volumetrically consistent 3D Gaussian rasterisation, which improves opacity computation by integrating 1D Gaussian densities along the ray. OMG ( Yong et al. 2025 ) introduces material-aware opacity modeling, linking opacity to material properties such as albedo and roughness. Nevertheless, these approaches do not explicitly model the geometric or view-dependent factors that influence opacity, leaving a gap in fully leveraging opacity for robust and generalisable 3DGS rendering. Sparse 3DGS Reconstruction While 3DGS has achieved remarkable rendering quality, its performance is highly dependent on dense input views for reliable Gaussian initialisation.

Read the complete text