Rectifying Mask via Entropy for Distractor-Free 3DGS in Ambiguous Scenarios
Wongi Park, Jiyeon Lim, Minjae Lee, Myeongseok Nam, Seongjun Choi, Jungwoo Kim, Soomok Lee, William J. Beksi, SangHyun Lee · 2026
Read Rectifying Mask via Entropy for Distractor-Free 3DGS in Ambiguous Scenarios by Wongi Park, Jiyeon Lim, Minjae Lee, Myeongseok Nam, Seongjun Choi, Jungwoo Kim, Soomok Lee, William J. Beksi, SangHyun Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29496.txt.
Introduction
Park and colleagues present RefineSplat, a framework that cleans distractors out of 3D Gaussian Splatting reconstructions. Real scenes contain transient elements, such as passing people or moving objects, that should not appear in the final model. Existing methods struggle when distractors share colours or meanings with the static scene, so simple masks misfire.
RefineSplat builds transient masks using entropy, a measure of uncertainty, combined with instance masks that outline individual objects. An entropy-aware density control step then aligns the Gaussians, the soft blobs forming the scene, in ambiguous areas by using entropy-aware positional gradients. To test such cases rigorously, the team created the Ambiguous wild dataset. It holds eighteen scenes where distractors and static content are hard to tell apart. Experiments across datasets show state-of-the-art performance, producing distractor-free novel view synthesis, meaning clean renderings from new camera angles.
Catalog record
| CREATOR | Wongi Park, Jiyeon Lim, Minjae Lee, Myeongseok Nam, Seongjun Choi, Jungwoo Kim, Soomok Lee, William J. Beksi, SangHyun Lee |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29496
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Rectifying Mask via Entropy for Distractor-Free 3DGS in Ambiguous Scenarios Wongi Park, Jiyeon Lim, Minjae Lee, Myeongseok Nam, Seongjun Choi, Jungwoo Kim, Soomok Lee, William J. Beksi, SangHyun Lee Abstract We present RefineSplat, a systematic framework that effectively constructs transient masks to identify diverse ambiguous distractors. To do this, we qualitatively and quantitatively analyze issues and propose a novel entropy-aware adaptive masking method. Unlike existing approaches that struggle to distinguish transient elements from static scenes due to color or semantic ambiguity, RefineSplat captures ambiguous distractors leveraging entropy and instance masks. Furthermore, we propose a simple yet effective entropy-aware density control to align Gaussians in ambiguous scenarios considering Entropy-aware positional gradients. Additionally, to rigorously validate our method, we first create and release the Ambiguous wild dataset, including 18 scenes where distractors and static scenes are hard to distinguish due to color or semantic resemblances. Experimental results on various datasets demonstrate that RefineSplat shows state-of-the-art performance, showing distractor-free novel view synthesis. Figure 1 : Given real-world environments, RefineSplat effectively renders 3D novel view synthesis without ambiguous distractors. Our method effectively handles several challenging distractors (e.g., appearance variations, varying occlusions, dynamic objects, ambiguous distractors). To the best of our knowledge, this is the first work to pave the way for novel view synthesis in ambiguous real-world scenarios. † † footnotetext: † Corresponding authors 1 Introduction Realistically rendering 3D scenes with 3D Gaussian Splatting (3DGS) [ 17 ] and Neural radiance field (NeRF) [ 34 ] from diverse real-world scenarios is a challenging and fundamental problem [ 32 , 59 , 20 , 36 , 11 ] . Unlike conventional methods [ 57 , 14 , 8 ] that primarily focus on constrained images which do not include distractors, this problem is characterized by the highly unstructured nature of the inputs ( e.g . , appearance variations, diverse distractors, dynamic objects, etc). To address these issues, existing methods [ 39 , 37 , 46 ] have tried to tackle unconstrained images, broadly falling into three paradigms. (1) Residual-based masking [ 25 , 32 , 59 , 40 ] relies on photometric error to generate transient masks. (2) Semantic-based masking [ 63 , 20 , 11 ] exploits extracted features from DINOv2 [ 35 ] to identify distractors at the semantic level. (3) Heuristic-based masking [ 46 , 4 , 31 ] leverages extracted masks from SAM [ 19 ] using photometric error as a condition. Figure 2 : Motivation. We color the normalized values, ranging from o n e t o z e r o . Ambiguous transient elements are difficult to distinguish due to color or semantic similarity. Challenges. Although prior methods [ 49 , 28 , 20 , 46 ] show impressive results across real-world scenarios, these methods are still impeded by three limitations. (1) Leveraging photometric error makes it difficult to produce precise transient masks due to ambiguities, especially in cases where the background and distractors share similar colors. (2) Positional gradients based on photometric error for density control also degrade rendering quality by misaligning Gaussians in ambiguous scenarios. (3) Semantic-based masking [ 20 , 11 , 37 ] , only leveraging extracted features from DINO [ 35 ] , struggles with the challenge of semantic level similarity (e.g., moving vs stationary vehicles, a person vs a human-like statue). Motivations and analysis. To understand how this issue emerges, we visualize our motivation in Fig. 2 and Fig. 7 -(a) . Through this observation, we indicate that transient masks fail to capture distractors due to the color or semantic ambiguity between transient and static elements. Furthermore, we quantitatively and qualitatively confirm that the density control based on photometric error often misaligns Gaussians, as shown in Eq. 9 and Fig. 5 . These limitations misalign Gaussians, degrading rendering quality. Proposed solution. To address these limitations, we introduce RefineSplat, a novel framework that leverages entropy and boundary segments to capture ambiguous distractors. Specifically, we propose the entropy-aware adaptive masking, which utilizes entropy and instance masks. Furthermore, we propose the simple and yet novel entropy-aware density control strategy to mitigate misaligned Gaussians and align Gaussians, reducing artifact issues. To rigorously validate our method, we create and release the Ambiguous wild dataset, including 18 scenes where distractors and static scenes are difficult to identify due to color or semantic ambiguity. Through extensive experiments, we demonstrate that RefineSplat outperforms existing methods. Key distinctions. To the best of our knowledge, RefineSplat is the first approach to capture ambiguous distractors leveraging entropy in real-world scenarios. This is not a trivial extension of prior works, as it (1) formulates entropy-aware methods to capture ambiguous distractors; (2) utilize entropy magnitude to align Gaussians; and (3) constructs the Ambiguous wild dataset and consistently show impressive results in diverse real-world scenarios, whereas prior works are limited to two scenarios. Our major contributions can be summarized as follows: • We introduce RefineSplat that leverages Entropy-aware adaptive masking, which integrates entropy and instance masks to capture ambiguous distractors. • We propose the Entropy-aware density control that effectively aligns Gaussians, mitigating artifact issues. • We create and release the Ambiguous wild dataset, comprising 18 challenging indoor and outdoor scenes where distinguishing distractors from static elements is particularly difficult due to color or semantic similarities. • Extensive results demonstrate that RefineSplat achieves superior results over the state-of-the-art methods across diverse real-world scenarios. 2 Related Work Novel view synthesis for unconstrained scenes. Most of the primary novel view synthesis methods [ 34 , 17 , 44 , 26 , 12 ] rely on the assumption of transient-free environments with consistent scenes. However, diverse real-world scenarios often violate these assumptions due to distractors. Numerous existing methods [ 32 , 34 , 55 , 25 ] try to tackle these issues by constructing transient masks. NeRF-W [ 32 ] exploits an uncertainty embedding per view and a transient field which represent distractors to construct transient masks. CR-NeRF [ 55 ] propose a cross-ray paradigm and a grid sampling strategy for efficient appearance modeling. NeRF-MS [ 25 ] also utilizes transient embeddings and multi-sequence images captured with triplet loss. While NeRF-based methods [ 32 , 34 , 55 ] make effective transient masks, they still limit real-time rendering. 3DGS-based methods [ 17 , 54 , 53 , 20 ] , which is primarily advent, explicitly represent the 3D scene with differentiable rasterization, showing real-time rendering. Wild-GS [ 53 ] utilizes extracted depth maps from frozen Depth anything [ 54 ] to capture transient elements and preserve geometric consistency. WildGaussians [ 20 ] also utilizes extracted semantic features from frozen DINOv2 [ 35 ] to tackle transient elements. SpotlessSplats [ 39 ] leverage the power of diffusion model with clustering process to identify transient elements using photometric errors. Several methods [ 50 , 28 , 36 ] represent both static and transient elements by constructing transient fields. Specifically, ForestSplats [ 36 ] shows efficient memory usage to capture transient elements by adapting deformable MLPs. However, existing approaches [ 25 , 37 , 46 , 20 ] primarily focus on either semantic features or residual maps, which makes it difficult to capture ambiguous distractors. In contrast, our method identifies ambiguous distractors by leveraging entropy and instance levels in real-world scenarios. Adaptive density control.