S2Gaussian: Sparse-View Super-Resolution 3D Gaussian Splatting

Yecong Wan, Mingwen Shao, Yuanshuo Cheng, Wangmeng Zuo · 2025

Read S2Gaussian: Sparse-View Super-Resolution 3D Gaussian Splatting by Yecong Wan, Mingwen Shao, Yuanshuo Cheng, Wangmeng Zuo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04314.txt.

Introduction

Yecong Wan, Mingwen Shao, Yuanshuo Cheng, and Wangmeng Zuo rebuild sharp 3D scenes from a few blurry views in a 2025 paper. Gaussian splatting renders scenes fast, but sparse low-resolution inputs starve it of both angles and detail. Earlier fixes handled one shortage or the other, never both together.

Their framework works in two stages. A low-resolution model with depth guidance is densified by a custom split operation to seed the detailed version. Super-resolved images, from the real views and from rendered pseudo-views, then refine it. A blur-free inconsistency model and a robust optimizer guard against bad supervision. Tests show geometry and detail beating prior methods.

Catalog record

CREATORYecong Wan, Mingwen Shao, Yuanshuo Cheng, Wangmeng Zuo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04314

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

S2Gaussian: Sparse-View Super-Resolution 3D Gaussian Splatting Yecong Wan, Mingwen Shao, Yuanshuo Cheng, Wangmeng Zuo Abstract In this paper, we aim ambitiously for a realistic yet challenging problem, namely, how to reconstruct high-quality 3D scenes from sparse low-resolution views that simultaneously suffer from deficient perspectives and clarity. Whereas existing methods only deal with either sparse views or low-resolution observations, they fail to handle such hybrid and complicated scenarios. To this end, we propose a novel Sparse-view Super-resolution 3D Gaussian Splatting framework, dubbed S2Gaussian, that can reconstruct structure-accurate and detail-faithful 3D scenes with only sparse and low-resolution views. The S2Gaussian operates in a two-stage fashion. In the first stage, we initially optimize a low-resolution Gaussian representation with depth regularization and densify it to initialize the high-resolution Gaussians through a tailored Gaussian Shuffle Split operation. In the second stage, we refine the high-resolution Gaussians with the super-resolved images generated from both original sparse views and pseudo-views rendered by the low-resolution Gaussians. In which a customized blur-free inconsistency modeling scheme and a 3D robust optimization strategy are elaborately designed to mitigate multi-view inconsistency and eliminate erroneous updates caused by imperfect supervision. Extensive experiments demonstrate superior results and in particular establishing new state-of-the-art performances with more consistent geometry and finer details. Project Page https://jeasco.github.io/S2Gaussian/ . Figure 1 : We present S2Gaussian , a novel framework capable of reconstructing high-quality 3D scenes for immersive rendering with only sparse and low-resolution input views. S2Gaussian demonstrates superior performance and yields high-fidelity and high-resolution scene reconstruction with sharp geometric and detailed textures, thus enjoying better functionality and practicality in realistic applications. 1 Introduction The rapid advancement of virtual reality and metaverse technologies has significantly heightened the demand for realistic 3D scene reconstruction, which holds vast potential across various application domains, including medicine, education, entertainment, etc. Among the recent notable developments, Neural Radiance Fields (NeRF) Mildenhall et al. 2021 have demonstrated remarkable capability in synthesizing photorealistic images; however, they still face considerable rendering and training costs, despite ongoing improvements Chen et al. 2022 ; Fridovich-Keil et al. 2022 ; Garbin et al. 2021 ; Müller et al. 2022 . More recently, 3D Gaussian Splatting (3DGS) Kerbl et al. 2023 has emerged as a prominent approach, characterized by its high quality, rapid reconstruction speed, and support for real-time rendering. Subsequent research efforts Yu et al. 2024b ; Cheng et al. 2024 ; Wu et al. 2024 ; Lu et al. 2024 ; Tang et al. 2023 ; Chen and Wang 2024 have focused on extending the applicability of 3DGS across various scenarios. Unfortunately, these methods typically rely heavily on well-captured dense and high-resolution images for impressive novel view synthesis, which is cumbersome and sometimes impractical in real-world applications. To address this challenge, a variety of approaches have emerged that focus on reconstructing 3D scenes from sparse Deng et al. 2022 ; Niemeyer et al. 2022 ; Yang et al. 2023 ; Wang et al. 2023 ; Chung et al. 2024 ; Zhu et al. 2025 ; Li et al. 2024 ; Xiong et al. 2023 and low-resolution views Han et al. 2023 ; Lee et al. 2024 ; Yoon and Yoon 2023 ; Feng et al. 2024 ; Yu et al. 2024a ; Shen et al. 2024 , yielding worth-celebrating successes. However, these two obstacles, i.e., sparsity and low resolution, have long been treated as isolated problems and tackled separately, whereas input views in practical applications often suffer from both deficient perspectives and clarity. Particularly in contexts such as robotics and internet-collected imagery, where the available views are usually sparse and compounded by low resolutions due to environmental constraints and hardware transfer limitations. This interplay of sparsity and low-resolution poses significant challenges for existing reconstruction frameworks. Furthermore, merely incorporating existing methods remains subject to inherent incompatibility, as super-resolution necessitates dense supervision to recover fine details while sparse-view regularization not only fails to introduce details but tends to lead smoothing. To tackle the aforementioned problems, in this paper, we propose a novel 3D reconstruction framework S2Gaussian, capable of reconstructing geometrically precise and richly detailed 3D scenes with only sparse and low-resolution views. Specifically, S2Gaussian consists of two main phases: the high-resolution Gaussians (HR GS) initialization stage and the HR GS optimization stage. In the HR GS initialization stage, we first optimize a low-resolution Gaussian representation using the sparse views as well as the estimated depth information. The optimized low-resolution Gaussians are then utilized to initialize the high-resolution Gaussians through a tailored Gaussian Shuffle Split operation which can provide more compact Gaussian primitives to facilitate fine-grained details reconstruction in high-resolution scenes. In the HR GS optimization stage, we use super-resolved images generated by pre-trained super-resolution model to refine the high-resolution Gaussians, leveraging both the original sparse views and the pseudo-views rendered from the low-resolution Gaussians. Notably, a customized blur-free inconsistency modeling scheme and a 3D robust optimization strategy are introduced to mitigate the impacts of multi-view inconsistency and imperfect supervision, ultimately leading to more detailed and higher-quality scene reconstruction. Comprehensive experiments substantiate the superiority of our S2Gaussian beyond alternatives on a variety of benchmarks. In conclusion, the main contributions are as follows: • We propose an innovative two-stage framework, termed S2Gaussian, designed to reconstruct 3D scenes that are both structurally accurate and rich in detail using only sparse and low-resolution input views. • A dedicated Gaussian Shuffle Split operation is designed to initialize more compact Gaussian primitives for representing fine-grained details and textures in high-resolution scenes. • We introduce a tailored blur-free inconsistency modeling scheme alongside a 3D robust optimization strategy to address multi-view inconsistencies and rectify erroneous updates arising from imperfect supervision. • Our S2Gaussian reconstructs more fine-grained and high-quality Gaussian representations significantly outperforming existing methods across multiple benchmarks. 2 Related Work 2.1 Novel View Synthesis using Radiance Fields Techniques for novel view synthesis typically involve learning a 3D representation using a limited number of input views and generating images from arbitrary novel perspectives. Recent advancements in Neural Radiance Fields (NeRF) Mildenhall et al. 2021 has demonstrated encouraging progress in this field, which learns an implicit neural scene representation for novel view synthesis via coordinate-based neural networks and volume rendering function. Subsequent research has focused extensively on enhancing NeRF’s rendering quality Barron et al. 2021 ; Barron et al. 2022 ; Barron et al. 2023 ; Verbin et al. 2022 , improving efficiency Chen et al. 2022 ; Fridovich-Keil et al. 2022 ; Garbin et al. 2021 ; Müller et al. 2022 , advancing scene understanding Kerr et al. 2023 ; Zheng et al. 2024 ; Zhi et al. 2021 , and facilitating 3D content generation Höllein et al. 2023 ; Poole et al. 2022 ; Seo et al. 2023 . Unfortunately, while NeRF significantly improves the quality of novel view rendering, its expensive training time as well as slow rendering speed hinder broader practical applications. Recently, Kerbl et al. Kerbl et al. 2023 introduced a groundbreaking approach with their 3D Gaussian Splatting (3DGS) method, boosting rendering efficiency by utilizing explicit Gaussian representations combined with differentiable rasterization techniques. Building upon 3D Gaussian Splatting representation, tremendous following efforts Yu et al. 2024b ; Cheng et al. 2024 ; Wu et al. 2024 ; Lu et al. 2024 ; Tang et al. 2023 concentrate

Read the complete text