Sphere-Depth: A Benchmark for Depth Estimation Methods with Varying Spherical Camera Orientations

Soulayma Gazzeh, Giuseppe Mazzola, Liliana Lo Presti, Marco La Cascia · 2026

Read Sphere-Depth: A Benchmark for Depth Estimation Methods with Varying Spherical Camera Orientations by Soulayma Gazzeh, Giuseppe Mazzola, Liliana Lo Presti, Marco La Cascia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23432.txt.

Introduction

Gazzeh and colleagues introduce Sphere-Depth, a benchmark that tests depth estimation from 360-degree images when the camera tilts away from its usual pose. They simulate pose shifts and compare a popular flat-image model against spherical-aware rivals, converting all outputs to real metric depth with a shared calibration protocol. Even purpose-built spherical models degrade sharply under pose change, the experiments show.

Catalog record

CREATORSoulayma Gazzeh, Giuseppe Mazzola, Liliana Lo Presti, Marco La Cascia
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19670
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23432

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sphere-Depth: A Benchmark for Depth Estimation Methods with Varying Spherical Camera Orientations Soulayma Gazzeh, Giuseppe Mazzola, Liliana Lo Presti, Marco La Cascia Abstract Reliable depth estimation from spherical images is crucial for 360° vision in robotic navigation and immersive scene understanding. However, the onboard spherical camera can experience unintentional pose variations in real-world robotic platforms that, along with the geometric distortions inherent in equirectangular projections, significantly impact the effectiveness of depth estimation. To study this issue, a novel public benchmark, called Sphere-Depth, is introduced to systematically evaluate the robustness of monocular depth estimation models from equirectangular images in a reproducible way. Camera pose perturbations are simulated and used to assess the performance of a popular perspective-based model, Depth Anything, and of spherical-aware models such as Depth Anywhere, ACDNet, Bifuse++, and SliceNet. Furthermore, to ensure meaningful evaluation across models, a depth calibration-based error protocol is proposed to convert predicted relative depth values into metric depth values using supervised learned scaling factors for each model. Experiments show that even models explicitly designed to process spherical images exhibit substantial performance degradation when variations in the camera pose are observed with respect to the canonical pose. The full benchmark, evaluation protocol, and dataset splits are made publicly available at: https://github.com/sgazzeh/Sphere_depth . 1 Introduction (a) Planar Image (b) Canonical Pose (c) Changing Pose Figure 1 : (a) planar image obtained by cubic projection; (b) gravity-aligned image obtained with a canonical camera pose; (c) Equirectangular image with variations in camera pose. Depth estimation from spherical images has emerged as a key component to achieve immersive 360° scene understanding and autonomous navigation [ 21 , 2 , 14 ] . Unlike conventional pinhole cameras, which provide a limited field of view and require multiple frames to capture the complete scene, spherical cameras provide continuous and full scene coverage. This capability is particularly valuable for robotic platforms operating in dynamic, unconstrained environments, such as autonomous vehicles [ 24 ] , drones [ 10 ] , and mobile robots. The ability to accurately estimate depth values from spherical images is useful in tasks such as scene understanding, object detection [ 15 ] , and motion planning [ 6 ] , all of which are foundational to successful autonomous operation. Current depth estimation models [ 22 , 20 , 16 , 1 , 19 , 25 ] operate under distinct assumptions about the camera geometry. Perspective-based models [ 9 , 12 ] are typically trained on planar images. Techniques such as cubemap projection [ 5 ] or planar conversion [ 18 ] are employed to flatten the spherical view into planar images (Fig. 1 .a) that can be processed by these models. This is needed because the equirectangular projection introduces geometric distortions in images that significantly alter spatial relationships in the scene and affect depth prediction accuracy, especially near the poles. Recent Spherical-aware models extend perspective-based models to handle equirectangular images by adopting distortion-aware sampling [ 4 ] or tailored data augmentation techniques [ 21 ] , by projecting features onto tangent planes to locally approximate perspective projection [ 8 ] , by dividing the equirectangular image into vertical slices [ 17 ] or adopting specific padding techniques [ 25 ] , by modifying the convolutional operation to consider the spherical geometry [ 7 ] or by using latitude-dependent [ 23 ] or rectangular-shaped kernels [ 26 ] . Additionally, methods [ 19 , 11 ] merge features extracted from cubemap and equirectangular projections, while models [ 13 , 1 ] process image patches, and use geometric priors to merge the patch-based depth maps into a final depth map. The previous approaches mostly assume that spherical cameras acquire equirectangular images in a canonical pose, i.e., with the equatorial plane parallel to the floor plane. Images acquired under this assumption are called gravity-aligned images (Fig. 1 .b). However, this assumption may not hold in practice. For instance, spherical cameras mounted on mobile platforms can be subjected to uncontrollable pose perturbations (namely, camera orientation variations) due to the platform’s motion. These perturbations significantly change the appearance of the acquired equirectangular images (Fig. 1 .c), and compromise the accuracy of the predicted depth values. The issue has received little attention in the literature, and prevents a full understanding of how well depth estimation models perform in practice. In this paper, we introduce a novel benchmark designed to systematically evaluate the robustness of popular depth estimation models (especially spherical-aware models) under a range of camera pose variations in real settings. In contrast to existing benchmarks for 360° depth estimation, such as [ 3 ] , our framework introduces structured pitch and roll rotations to simulate different levels of camera pose variations and measure errors in realistic settings by using known 3D point coordinates of landmarks displaced in the scene. In this paper, our main contributions are: • A pose-aware benchmark for monocular depth estimation from equirectangular images, designed to evaluate model generalization under camera pose variation with a focus on sensitivity to pitch and roll changes. • A depth calibration-based evaluation protocol that introduces a learnable scaling factor \lambda to align predicted depths to the ground truth values, allowing fair comparison between models with different output scales. • A comparative study of models trained on either perspective or spherical images concluding that even the performance of models designed to process spherical images degrades significantly in the presence of camera pose perturbations. Our results highlight that despite recent advances, current 360° depth estimation models still implicitly rely on cameras in a canonical pose and are not robust to spatial distortions caused by pose variations. This public benchmark provides a reproducible basis for future research on pose- and geometry-invariant depth estimation in omnidirectional settings. 2 Depth Estimation Models selected for benchmarking To assess the state-of-the-art in depth estimation from equirectangular images, we selected a representative set of spherical-aware models based on their architectural diversity, input modalities, and strategies to handle spherical distortions, as summarized in Table 1 . We also consider a popular perspective-based model, Depth Anything v2 [ 22 ] , to evaluate its generalization capabilities to 360° imagery via cubemap projections. All selected methods have an encoder-decoder architecture. In Depth Anything v2, the encoder is a Vision Transformer (ViT) and the decoder is a Dense Prediction Transformer (DPT) devoted to the regression of depth values. The model does not explicitly handle equirectangular projection (ERP). BiFuse++ [ 19 ] is a two-branch encoder-decoder that geometrically aligns features extracted from the equirectangular image and features from the cube face images, while DepthAnywhere [ 21 ] exploits a transformer-based model within a teacher-student framework. The model processes equirectangular images. At training time, it uses Depth Anything as a teacher to independently process each of the cube faces and generate pseudo-labels. It also adopts data augmentation by randomly rotating the spherical images. Other methods that process only equirectangular images are ACDNet [ 25 ] and SliceNet [ 17 ] . They both adopt a ResNet-based encoder. In ACDNet, the decoder exploits Adaptively Combined Dilated Convolutional layers (ACDConv) to obtain adaptive receptive fields. Furthermore, circular padding of the images is used to deal with the image circularity introduced by ERP. SliceNet includes multi-scale vertical feature slicing and a ConvLSTM-based

Read the complete text