ClaraVid: A Holistic Scene Reconstruction Benchmark From Aerial Perspective With Delentropy-Based Complexity Profiling

Radu Beche, Sergiu Nedevschi · 2025

Read ClaraVid: A Holistic Scene Reconstruction Benchmark From Aerial Perspective With Delentropy-Based Complexity Profiling by Radu Beche, Sergiu Nedevschi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17856.txt.

Introduction

Radu Beche and Sergiu Nedevschi release a synthetic aerial data set for rebuilding scenes in three dimensions, in a 2025 paper. Algorithms that map landscapes from the air lack rich training data, and existing fake data sets carry fake-looking scenes and rendering flaws.

Their ClaraVid set holds nearly seventeen thousand high-resolution images from many viewpoints across varied terrain. Each image comes with depth, object masks, and point clouds, cleaned of common artifacts. The authors also coin a complexity score based on information entropy, letting users grade scene difficulty before testing. Across reconstruction methods, higher complexity tracked higher error closely. The score, they argue, can guide fairer benchmarks and harder training mixes.

Catalog record

CREATORRadu Beche, Sergiu Nedevschi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-17856

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ClaraVid: A Holistic Scene Reconstruction Benchmark From Aerial Perspective With Delentropy-Based Complexity Profiling Radu Beche, Sergiu Nedevschi Abstract The development of aerial holistic scene understanding algorithms is hindered by the scarcity of comprehensive datasets that enable both semantic and geometric reconstruction. While synthetic datasets offer an alternative, existing options exhibit task-specific limitations, unrealistic scene compositions, and rendering artifacts that compromise real-world applicability. We introduce ClaraVid, a synthetic aerial dataset specifically designed to overcome these limitations. Comprising 16,917 high-resolution images captured at 4032×3024 from multiple viewpoints across diverse landscapes, ClaraVid provides dense depth maps, panoptic segmentation, sparse point clouds, and dynamic object masks, while mitigating common rendering artifacts. To further advance neural reconstruction, we introduce the Delentropic Scene Profile (DSP), a novel complexity metric derived from differential entropy analysis, designed to quantitatively assess scene difficulty and inform reconstruction tasks. Utilizing DSP, we systematically benchmark neural reconstruction methods, uncovering a consistent, measurable correlation between scene complexity and reconstruction accuracy. Empirical results indicate that higher delentropy strongly correlates with increased reconstruction errors, validating DSP as a reliable complexity prior. The data and code are available on the project page: rdbch.github.com/claravid . 1 Introduction Semantic and geometric scene understanding derived from low-altitude uncrewed aerial vehicle (UAV) imagery has become increasingly essential for applications such as disaster response [ 1 ] , urban mapping [ 2 ] , and infrastructure inspection [ 3 ] , where accurate and high-fidelity environmental perception directly informs critical decision-making processes. Recent advancements in neural reconstruction techniques, notably Neural Radiance Fields (NeRFs) [ 4 , 5 , 6 ] and Gaussian Splatting (GSplat) approaches [ 7 , 8 , 9 ] , have demonstrated significant potential in enabling scene-level querying and novel-view synthesis, offering a transformative approach to reconstructing complex 3D environments from sparse 2D observations. However, evaluating such holistic reconstruction of urban environments—encompassing both semantic and geometric aspects—remains constrained by the limitations of existing datasets. Real-world benchmarks providing comprehensive multi-modal ground truth for the joint tasks are inexistent for urban scenarios, and synthetic alternatives suffer from critical shortcomings: they often lack key sensing modalities such as dense semantic or instance segmentation [ 10 , 11 ] , are not collected for scene mapping applications [ 12 , 13 ] , or are captured from restricted viewpoints that hinder a full assessment of reconstruction quality and generalization [ 14 ] . In this work, we introduce ClaraVid, a synthetic aerial dataset crafted to support the training and evaluation of holistic scene reconstruction while also enabling lower-level perception tasks. ClaraVid employs a mapping-centric approach, emulating UAV mapping missions to reflect real-world aerial survey workflows. Spanning 5 distinct environments across 8 missions, the dataset provides high-resolution imagery, collected simultaneously from 3 different viewpoints, accompanied by multimodal annotations: dense depth maps, panoptic segmentation and dynamic object masks to delineate moving entities–a distinctive enhancement over prior synthetic datasets. Furthermore, it includes multi-resolution multi-modal scene-level point clouds approximating LiDAR scans, broadening its utility for geometric analysis. Data quality is ensured through an optimized rendering pipeline that addresses challenges such as foliage culling and level-of-detail inconsistencies, resulting in enhanced fidelity for scene reconstruction and semantic segmentation. Notably, Claravid systematically spans structural complexities–from homogeneous areas to highly detailed urban environments–quantified via scene complexity profile. The dataset is complemented by a benchmarking framework designed to assess semantic and geometric reconstruction accuracy at various viewpoints, while also supporting frame-level tasks (depth estimation, panoptic segmentation, etc). An overview is presented in . A major challenge in UAV-based neural scene reconstruction is quantifying scene complexity in a way that correlates with the difficulty of downstream reconstruction tasks (e.g., novel view synthesis) only from 2D measurements. Currently, the base solution relies on heuristic assessments rather than formalized metrics, making it difficult to systematically predict the impact of scene structure on the reconstruction. Delentropy [ 15 ] , an entropy measure derived from gradient field analysis, has previously been employed to analyze information content in pixel-level tasks [ 16 , 17 , 18 ] . In this work, we adapt delentropy to quantify scene complexity in neural reconstruction and introduce the Delentropic Scene Profile as a descriptor of scene-level complexity. We empirically demonstrate a strong correlation between the proposed metric and the final error across multiple reconstruction approaches. To summarize, our paper introduces the following contributions to advance UAV-based holistic scene understanding: (1) We present ClaraVid, a novel synthetic aerial dataset specifically designed for holistic neural scene reconstruction, comprising high-resolution imagery, multi-modal annotations, and realistic rendering tailored for neural scene reconstruction tasks from an aerial perspective. (2) We introduce the Delentropic Scene Profile, a delentropy-based metric for quantitatively assessing scene complexity only from 2D measurements. (3) We empirically demonstrate the utility of both the dataset and DSP through extensive experiments. Table 1 : Related Aerial Datasets –Comparison of datasets from aerial and automotive domains relevant for holistic scene representation. Dataset Year Type* Camera Calib. Seg. Depth Scene PCL Dynamic Mask For Mapping Viewpoints Render Issues Image Size Samples Automotive Datasets A2D2 [ 19 ] 2020 R ✓ Panoptic ✓ - - - 6 - 1440x960 41.2k Waymo [ 20 ] 2020 R ✓ Panoptic ✓ - - - 5 - 1920x1280 390k Urban Syn [ 21 ] 2023 S ✗ Panoptic ✓ - - - 1 Low 2048x1024 7.5k Aerial Datasets UDD [ 22 ] 2018 R ✗ Semantic ✗ ✗ ✗ ✗ 1 - 4096x2160 0.3k Aeroscapes [ 23 ] 2019 R ✗ Semantic ✗ ✗ ✗ ✗ 1 - 1280x720 3.2k SkyScapes [ 24 ] 2018 R ✗ Semantic ✗ ✗ ✗ ✗ 1 - 5616x3744 16 UAVid [ 25 ] 2020 R ✗ Semantic ✗ ✗ ✗ ✗ 1 - 4096x2160 0.4k UrbanScene3D [ 11 ] 2022 S/R ✓ Instance ✓ RGB/Ins ✗ ✓ 1 - 8192x5460 128k Dronescapes [ 26 ] 2023 R ✓ Semantic ✓ ✗ ✗ ✗ 1 - 3840x2160 16.9k Matrix City [ 10 ] 2023 S ✓ ✗ ✓ RGB ✗ ✓ 1 Low 1920x1080 410k Syndrone [ 12 ] 2023 S ✓ Semantic ✓ ✗ ✗ ✗ 3 Medium 1920x1080 72k DDos [ 14 ] 2024 S ✓ Semantic ✓ ✗ ✗ ✗ 1 Medium 1280x720 34k ClaraVid (ours) S ✓ Panoptic ✓ RGB/Sem/Ins ✓ ✓ 3 Low 4032x3024 16.9k *S/R - Synthetic / Real 2 Related work Aerial datasets The progress in semantic and geometric scene understanding of urban scenes has been largely driven by multi-modal automotive datasets, real [ 27 , 19 , 20 ] and synthetic [ 28 , 29 , 21 ] . These datasets provide strong benchmarks that integrate LiDAR, multi-view imagery, and detailed annotations for tasks enabling autonomous navigation. In contrast, real-world aerial datasets, are often small in scale and fragmented in scope: semantic segmentation [ 22 , 24 , 25 , 30 , 31 ] , depth estimation [ 32 , 33 ] , object tracking [ 34 , 35 ] , LiDAR segmentation [ 36 ] , etc. While some works [ 26 ] exist that integrate both semantic and geometric information, none of them are targeted towards mapping applications. Synthetic aerial datasets, created using graphics engines, offer a scalable alternative with rich semantic content. However, they come with significant limitations. Their resolution is typically limited

Read the complete text