DeGauss: Dynamic-Static Decomposition with Gaussian Splatting for Distractor-free 3D Reconstruction

Rui Wang, Quentin Lohmeyer, Mirko Meboldt, Siyu Tang, [email protected], https://batfacewayne.github.io/DeGauss.io/ · 2025

Read DeGauss: Dynamic-Static Decomposition with Gaussian Splatting for Distractor-free 3D Reconstruction by Rui Wang, Quentin Lohmeyer, Mirko Meboldt, Siyu Tang, [email protected], https://batfacewayne.github.io/DeGauss.io/ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-13176.txt.

Introduction

Rui Wang, Quentin Lohmeyer, Mirko Meboldt, and Siyu Tang rebuild clean three-dimensional scenes from messy real captures in a 2025 computer vision study. People walking through a scan, objects that move, and other clutter end up baked into ordinary reconstructions, ruining them for design or measurement. Their framework separates the scene into a static part and a dynamic part inside a Gaussian splatting representation, the current fast standard for photo-real scenes.

The split is learned self-supervised, without hand labels for what moves. Distractor-free models from ordinary walkthrough videos suit product design review and robot mapping.

Catalog record

CREATORRui Wang, Quentin Lohmeyer, Mirko Meboldt, Siyu Tang, [email protected], https://batfacewayne.github.io/DeGauss.io/
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-13176

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DeGauss: Dynamic-Static Decomposition with Gaussian Splatting for Distractor-free 3D Reconstruction Rui Wang, Quentin Lohmeyer, Mirko Meboldt, Siyu Tang, [email protected], https://batfacewayne.github.io/DeGauss.io/ Abstract Reconstructing clean, distractor-free 3D scenes from real-world captures remains a significant challenge, particularly in highly dynamic and cluttered settings such as egocentric videos. To tackle this problem, we introduce DeGauss, a simple and robust self-supervised framework for dynamic scene reconstruction based on a decoupled dynamic-static Gaussian Splatting design. DeGauss models dynamic elements with foreground Gaussians and static content with background Gaussians, using a probabilistic mask to coordinate their composition and enable independent yet complementary optimization. DeGauss generalizes robustly across a wide range of real-world scenarios, from casual image collections to long, dynamic egocentric videos, without relying on complex heuristics or extensive supervision. Experiments on benchmarks including NeRF-on-the-go, ADT, AEA, Hot3D, and EPIC-Fields demonstrate that DeGauss consistently outperforms existing methods, establishing a strong baseline for generalizable, distractor-free 3D reconstruction in highly dynamic, interaction-rich environments. Figure 1 : With self-supervised foreground-background gaussian splats modeling and accurate decomposition, DeGauss simultaneously enables (a) : SOTA distractor-free static scene reconstruction for casual captures (no dynamic modeling in the static background) and (b) : efficient, high-quality dynamic-static representation for dynamic scenes (no static modeling in dynamic foreground). 1 Introduction Recent advances in Neural Radiance Fields (NeRF) [ 21 ] and 3D Gaussian Splatting [ 13 ] have enabled scalable 3D scene reconstruction and high-quality novel view synthesis from image collections. However, these methods perform well primarily on datasets captured under controlled conditions, where scenes remain mostly static and consistent across views. They struggle to generalize to casual captures containing dynamic elements, such as moving objects and humans. In such cases, dynamic content is often modeled as view-dependent artifacts, resulting in numerous ”floaters” in the reconstructed scene. This limitation is further amplified in egocentric videos, a rapidly growing data source that introduces unique challenges for 3D scene reconstruction [ 19 , 34 , 38 , 9 , 49 ] . Egocentric videos, typically recorded with head-mounted, forward-facing cameras, are characterized by rapid, embodied motion. Besides substantial camera movement and motion blur, these videos frequently capture dynamic objects that the camera wearer interacts with, as well as the wearer’s own body. These factors introduce significant challenges for standard scene reconstruction methods. The key question we aim to address in this work is how to reconstruct clean, distractor-free 3D scenes from real-world, in-the-wild videos. We focus on developing a robust and generalizable framework capable of handling a wide range of everyday capture scenarios, from casual, uncontrolled image collections to long-duration, highly dynamic egocentric recordings. By explicitly tackling the presence of dynamic elements, we aim to push 3D scene reconstruction beyond static environments toward realistic, interaction-rich settings. To model dynamics in 3D reconstruction, recent methods such as NeRF-on-the-go, WildGaussians, and SpotlessSplats [ 26 , 15 , 28 ] propose to suppress transient regions during training, achieving state-of-the-art distractor-free scene reconstruction on casual image collections. These approaches leverage reconstruction loss residuals and semantic features [ 22 , 36 ] to identify and mask dynamic content, as transient regions often exhibit higher reconstruction errors. However, these methods typically rely on careful initialization and stable optimization, which limits their ability to handle the complex dynamics of egocentric videos, where continuous human-scene interactions, severe motion blur, and rapid illumination changes make static-dynamic separation particularly challenging. Meanwhile, several self-supervised NeRF-based methods aim to jointly model dynamic and static elements through explicit dynamic branches and masking strategies [ 20 , 37 , 45 ] . While these methods improve generalization across diverse inputs, they suffer from long training times and struggle to balance dynamic and static representations. For 3D scenes captured with temporally sparse image inputs, the dynamic branch may fail to fully segment dynamic elements, leaving floaters in the static reconstruction [ 27 ] . In contrast, for highly dynamic egocentric videos, the dynamic branch often over-segments dynamic regions, dominating the reconstruction and leaving the static scene under-represented [ 24 ] . In this work, we propose DeGauss : Dynamic-Static Decomposition with Gaussian Splatting for Distractor-free 3D Reconstruction. It is a simple and robust self-supervised framework that leverages dynamic-static Gaussian Splatting to effectively model and separate dynamic elements from input scenes. DeGauss generalizes across a wide range of scenarios, from casual image collections such as the NeRF-on-the-go dataset [ 26 ] to highly dynamic egocentric video sequences like ADT [ 24 ] , AEA [ 19 ] , Hot3D [ 24 ] , and EPIC-Fields [ 38 ] , consistently delivering superior performance without complex heuristics or elaborate designs. Our key insight is to leverage the complementary strengths of dynamic and static Gaussians for coordinated optimization for dynamic scene reconstruction. Specifically, dynamic Gaussian methods [ 47 , 43 ] learn deformation fields for temporal modeling but tend to overfit to training views and generalize poorly to novel viewpoints [ 33 , 8 ] . In contrast, static Gaussians, while limited in handling motion, offer more stable representations across views, modeling dynamic elements as view-dependent artifacts (e.g., floaters). To combine their advantages, we propose a decoupled foreground-background Gaussian representation, where dynamic elements are modeled with foreground Gaussians and static content with background Gaussians. A probabilistic mask, rasterized from the foreground Gaussians, controls the composition of the two branches and enables coordinated yet independent optimization. During training, ambiguous regions are updated jointly, while floaters in the static branch are progressively suppressed through partial opacity resets and pruning. To further improve robustness under varying illumination, we introduce a brightness control mask to enhance non-Lambertian effects modeling capability of the background branch during training and mitigate dynamic-static ambiguities in those regions. Beyond producing clean, distractor-free 3D reconstructions, our formulation offers an efficient, hybrid representation of dynamic scenes through this decoupled dynamic-static design. We show that our method achieves superior results compared to baseline dynamic scene modeling approaches, with notable advantages across diverse datasets [ 16 , 25 ] . In summary, our contributions are: • We propose DeGauss , a decoupled foreground-background design which leverages dynamic-static Gaussian splatting for robust and generalizable dynamic-static decomposition. • Our proposed method achieves state of the art distractor-free reconstruction results for both highly challenging egocentric videos and image collections. • We demonstrate that DeGauss enables high-quality and efficient dynamic scene modeling through the decoupled dynamic-static representation. 2 Related Work Distractor-Free Neural Reconstruction based on loss residual of input images and renders during reconstruction was investigated in [ 27 , 4 ] . In [ 9 ] , it is additionally combined with open-world 3D segmentation task with Segment Anything masks [ 14 ] . NeRF-on-the-Go [ 26 ] leverages DINOV2 features [ 22 ] , color residuals, and an MLP predictor for dynamic elements mask. This approach was later extended to gaussian splatting [ 13 ] in WildGaussians [ 15 ] . SpotlessSplats [ 28 ] utilizes clustered diffusion-based features [ 36 ] and SOTA distractor-free scene modeling for image collections. However, these methods are sensitive to initialization and fail to leverage semantic information when within-class dynamic-static ambiguities or scene deformations arise, which limits their generalizability in more challenging settings. Self-Supervised Scene Decomposition for neural fields was first introduced in Nerf-W [ 20 ] , which decomposes and models the whole scene

Read the complete text