Underwater360: Reconstructing Underwater Scenes from Panoramic Images with Omnidirectional Gaussian Splatting

Jiangbei Hu, Weichao Song, Shibo Yu, Mohan Wang, Zihan Yi, Rui Wu, Mingkang Xiang, Na Lei, Shengfa Wang, Zhongxuan Luo, Ying He · 2026

Read Underwater360: Reconstructing Underwater Scenes from Panoramic Images with Omnidirectional Gaussian Splatting by Jiangbei Hu, Weichao Song, Shibo Yu, Mohan Wang, Zihan Yi, Rui Wu, Mingkang Xiang, Na Lei, Shengfa Wang, Zhongxuan Luo, Ying He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26447.txt.

Introduction

Jiangbei Hu and ten colleagues rebuild underwater scenes from wraparound photos via Underwater360, a physics-aware splatting system for all directions. Plain splatting stumbles on sphere warp and on water's absorption and scattering. The team casts rays straight in spherical camera space and splits true scene light from depth-linked backscatter and dimming with pose-tuned embeddings. They also release a new underwater benchmark of synthetic and real wraparound scenes. Experiments report stronger novel-view synthesis and scene restoration than rivals, with cleaner rendering and steadier agreement.

Catalog record

CREATORJiangbei Hu, Weichao Song, Shibo Yu, Mohan Wang, Zihan Yi, Rui Wu, Mingkang Xiang, Na Lei, Shengfa Wang, Zhongxuan Luo, Ying He
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38000
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.26447

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Underwater360: Reconstructing Underwater Scenes from Panoramic Images with Omnidirectional Gaussian Splatting Jiangbei Hu, Weichao Song, Shibo Yu, Mohan Wang, Zihan Yi, Rui Wu, Mingkang Xiang, Na Lei, Shengfa Wang, Zhongxuan Luo, Ying He Abstract Underwater scene reconstruction is essential for immersive exploration of aquatic environments, yet remains challenging due to complex participating-media effects such as absorption and scattering, as well as the limited field of view (FoV) of conventional cameras. Although combining panoramic imaging with 3D Gaussian Splatting (3DGS) offers a promising direction for photorealistic underwater rendering, traditional 3DGS struggles with both spherical projection distortion and underwater medium degradation. In this paper, we propose Underwater360 , a physics-informed omnidirectional 3DGS framework for underwater panoramic scene reconstruction. First, we introduce an Omnidirectional Gaussian Splatting module that performs ray casting directly in spherical camera space instead of relying on 2D projection approximations, thereby reducing geometric distortions under 360 ∘ FoV. Second, we design a physics-based appearance-medium modeling architecture with pose-conditioned appearance embeddings to explicitly decouple intrinsic scene radiance from depth-dependent backscatter and attenuation, enabling physically grounded scene appearance restoration. Finally, we establish a new panoramic underwater benchmark dataset containing both synthetic and real-world scenes. Extensive experiments demonstrate that Underwater360 achieves superior performance in underwater novel view synthesis and scene appearance restoration, delivering improved rendering quality and cross-view consistency in complex underwater environments. The code and datasets are released at https://github.com/SwcK423/Underwater360 Figure 1 : Underwater reconstruction from perspective views is particularly challenging due to limited field of view, severe scattering, and view-dependent degradation, which often lead to incomplete geometry and inconsistent appearance estimation. In contrast, our method leverages omnidirectional observations together with an explicit underwater image formation model to provide stronger global constraints for reconstruction. This enables more consistent 360 ∘ scene recovery and higher-quality rendering under challenging underwater conditions. 1 Introduction High-fidelity reconstruction of underwater 3D scenes is essential for immersive multimedia applications. In terrestrial settings, traditional reconstruction is achieved by capturing dense multi-view images with standard perspective cameras. However, replicating this paradigm underwater is considerably more challenging. The aquatic environment is often highly unstable, with currents, suspended particles, and dynamic illumination variations, while underwater imaging further suffers from severe optical degradation caused by scattering and absorption Akkaynak et al. 2017 . These factors substantially weaken cross-view correspondence and often make conventional Structure-from-Motion (SfM) pipelines Schönberger and Frahm 2016 less reliable, leading to unstable camera pose estimation and visible reconstruction artifacts. As shown in Fig. 2 , conventional acquisition using standard narrow-field cameras requires a large number of overlapping views to cover a scene, yet reliable reconstruction is still difficult in practice. Sparse views are easier to register, but provide incomplete coverage, whereas dense views improve coverage at the cost of less reliable registration under underwater scattering and attenuation. In this context, omnidirectional imaging offers a promising alternative for underwater 3D scene reconstruction. By capturing a 360 ∘ field of view in a single observation, panoramic cameras provide substantially richer scene coverage and reduce the dependence on densely sampled narrow-field views and carefully designed camera trajectories. Such omnidirectional observations can also alleviate temporal inconsistencies across diverse captures, while offering broader contextual cues for geometry-aware reconstruction and immersive rendering. However, directly applying existing reconstruction and rendering methods to underwater panoramic imagery remains nontrivial, as spherical imaging geometry and participating-media degradation jointly introduce challenges that are not addressed by standard perspective-based pipelines. Recent advances in differentiable rendering like neural radiance fields (NeRF) Mildenhall et al. 2021 , and especially 3D Gaussian Splatting (3DGS) Kerbl et al. 2023 , have enabled efficient scene representation and high-quality novel view synthesis. In underwater settings, several methods Levy et al. 2023 ; Yang et al. 2025 ; Wang et al. 2025 ; Li et al. 2025a ; Mualem et al. 2025 ; Yuan et al. 2025 have incorporated underwater image formation models Akkaynak and Treibitz 2018 into NeRF- or Gaussian-based frameworks to account for attenuation and backscatter, improving reconstruction fidelity under participating-media degradation. Meanwhile, omnidirectional rendering methods have extended neural scene representations to 360 ∘ imagery by adapting projection and sampling strategies to spherical imaging geometry Choi et al. 2023 ; Bai et al. 2025 ; Lee et al. 2024 ; Li et al. 2025c ; Li et al. 2025b . However, these two lines of work have evolved separately. Existing underwater reconstruction methods are primarily designed for perspective imagery and often rely on implicit neural components or computationally expensive volumetric rendering, which limit efficiency and scalability. In contrast, existing omnidirectional rendering methods mainly target scenes with clear air and do not explicitly model underwater light transport. Overall, current approaches do not adequately address the coupled challenges of spherical projection distortion, medium-induced appearance degradation, and stable geometry recovery in underwater panoramic scenes. Sparse Input Dense Input Panorama Input Figure 2 : Challenges of conventional underwater capture with narrow-field cameras. Sparse views are easier to register but provide incomplete scene coverage, whereas dense views improve coverage at the cost of less reliable registration under scattering and attenuation. In contrast, omnidirectional panorama capture offers more complete visual coverage and provides a more suitable basis for robust underwater scene reconstruction. To overcome these limitations, we propose Underwater360 , a physically geometry-informed omnidirectional 3DGS framework tailored for complex underwater scenes. To the best of our knowledge, this is the first work to utilize panoramic images for underwater 3D scene reconstruction, accompanied by the first benchmark dataset comprising both synthetic and real-world underwater 360 ∘ scenes. Rather than adapting existing 2D rasterizers, we introduce an Omnidirectional Gaussian Splatting module that perform spherical ray casting directly in the camera space, thereby effectively mitigating the distortions introduced by 2D projection approximations. To tackle underwater medium degradation, we further design a physics-driven appearance-medium modeling architecture, which disentangles intrinsic scene radiance from distance-dependent attenuation and backscatter through a lightweight network guided by depth priors. In summary, our main contributions are as follows: • We study underwater omnidirectional scene reconstruction and novel view synthesis from panoramic images, and establish a unified formulation that couples omnidirectional Gaussian rendering with underwater image formation. • We propose a physics-aware omnidirectional Gaussian framework that extends panoramic Gaussian splatting with underwater appearance modeling and explicit participating-medium estimation, enabling joint reconstruction of geometry, view-dependent appearance, and medium degradation. • We offer a new underwater panoramic benchmark with both synthesized and real-world data to support training and evaluation for this community. Figure 3 : Overview of Underwater360 . Our framework combines omnidirectional Gaussian Splatting with underwater image formation modeling for panoramic underwater scene reconstruction. Starting from multi-view panoramas, we estimate camera parameters and initialize 3D Gaussians. A pose-conditioned appearance module adjusts the Gaussians base color using view-dependent embeddings, producing corrected intrinsic appearance for rendering. We then perform omnidirectional Gaussian splatting directly in spherical camera space to obtain the clean scene radiance J and depth D . Based on the predicted depth and view embedding \mathbf{e}_{\text{view}} , two lightweight convolutional networks estimate the attenuation map A and backscatter component B , respectively. Finally, the degraded underwater observation is synthesized according to the image formation model I(\mathbf{p})=J(\mathbf{p})\odot A(\mathbf{p})+B(\mathbf{p}) and optimized against the GT panorama using the reconstruction loss \mathcal{L} . 2 Related Work 2.1 Underwater 3D Scene Reconstruction Underwater 3D reconstruction is challenging because scene geometry must

Read the complete text