3D SEMANTIC SEGMENTATION FOR POST-DISASTER ASSESSMENT
Nhut Le, Maryam Rahnemoonfar · 2025
Read 3D SEMANTIC SEGMENTATION FOR POST-DISASTER ASSESSMENT by Nhut Le, Maryam Rahnemoonfar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-24593.txt.
Introduction
Nhut Le and Maryam Rahnemoonfar build a three-dimensional dataset for disaster assessment. Natural disasters grow more frequent and costly. Semantic segmentation of 3D scenes could speed damage assessment. Existing models lack data from real post-disaster environments, though. The team fills that gap with drone footage of Hurricane Ian.
Aerial video from affected areas in 2022 feeds the reconstruction. Structure-from-motion and multi-view stereo turn it into 3D point clouds. Three leading segmentation models are then evaluated on the data. A fast point transformer, a point transformer variant, and a convolutional model all struggle. Their limits in disaster-stricken regions stand exposed. The findings argue for specialized 3D benchmarks and better techniques. Post-disaster scene understanding needs both before response teams can rely on it.
Catalog record
| CREATOR | Nhut Le, Maryam Rahnemoonfar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-24593
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
3D SEMANTIC SEGMENTATION FOR POST-DISASTER ASSESSMENT Nhut Le, Maryam Rahnemoonfar Abstract The increasing frequency of natural disasters poses severe threats to human lives and leads to substantial economic losses. While 3D semantic segmentation is crucial for post-disaster assessment, existing deep learning models lack datasets specifically designed for post-disaster environments. To address this gap, we constructed a specialized 3D dataset using unmanned aerial vehicles (UAVs)-captured aerial footage of Hurricane Ian (2022) over affected areas, employing Structure-from-Motion (SfM) and Multi-View Stereo (MVS) techniques to reconstruct 3D point clouds. We evaluated the state-of-the-art (SOTA) 3D semantic segmentation models, Fast Point Transformer (FPT), Point Transformer v3 (PTv3), and OA-CNNs on this dataset, exposing significant limitations in existing methods for disaster-stricken regions. These findings underscore the urgent need for advancements in 3D segmentation techniques and the development of specialized 3D benchmark datasets to improve post-disaster scene understanding and response. I Introduction Fig. 1 : Point clouds in our dataset with semantic labels: Cyan – Building (no damage), Red – Building (damaged), Yellow – Road, Green – Tree, Black – Background In recent years, the frequency and severity of natural disasters have escalated, posing significant risks to human lives and causing substantial economic losses [ 6 ] . To mitigate these challenges, emerging technologies such as autonomous vehicles, robotics, and virtual/augmented reality offer promising solutions for enhancing rescue operations, reducing operational hazards, and improving post-disaster assessment. A key component in these advancements is the accurate interpretation of 3D point clouds, where 3D semantic segmentation plays a crucial role. Recent deep learning-based approaches [ 16 , 17 , 11 , 24 , 10 , 30 , 27 , 15 , 26 ] have demonstrated state-of-the-art (SOTA) performance on high-quality indoor [ 1 , 5 , 20 , 29 ] and outdoor [ 2 , 25 , 23 , 3 , 12 , 7 ] 3D benchmark datasets. However, to the best of our knowledge, no existing 3D benchmark datasets or deep learning-based 3D semantic segmentation methods have been specifically developed for post-disaster scenarios. To address this gap, we reconstructed a specialized 3D dataset tailored for disaster-stricken environments and evaluated the performance of the SOTA 3D deep learning-based semantic segmentation methods, Fast Point Transformer (FPT) [ 14 ] , Point Transformer v3 (PTv3) [ 26 ] , and OA-CNNs [ 15 ] , on this dataset. Inspired by RescueNet [ 18 ] , we collected aerial footage of areas affected by Hurricane Ian (2022) in Florida using unmanned aerial vehicles (UAVs). Using Structure-from-Motion (SfM) [ 21 ] and Multi-View Stereo (MVS) [ 22 ] techniques, we reconstructed 3D point clouds from the captured footage. Ground-truth 3D semantic segmentation labels were generated through manual annotation of 2D images. To assess the capabilities of FPT [ 14 ] , PTv3 [ 26 ] , and OA-CNNs [ 15 ] in post-disaster scenarios, we conducted experiments on our reconstructed 3D dataset. The evaluation revealed significant limitations in existing methods when applied to post-disaster environments, highlighting the urgent need for advancements in 3D semantic segmentation techniques and the creation of specialized benchmark datasets to better address the unique complexities of post-disaster scenarios. II Related Work II-A Datasets and Benchmarks for Damage Assessment The xBD dataset [ 8 ] is a large-scale collection of pre- and post-disaster satellite imagery designed for building damage assessment. It categorizes buildings based on damage levels, such as no damage, minor, major, and destroyed, while also tagging environmental factors like floodwater and fire in specific scenes. Similarly, SpaceNet [ 9 ] serves as a satellite benchmark focused on flood scenarios, combining tasks such as building footprint detection, road network extraction, and flood segmentation. In addition to satellite imagery, aerial and UAV (drone) imagery datasets have been developed for higher-resolution analysis. One such dataset, FloodNet [ 19 ] , contains UAV images from Hurricane Harvey, with pixel-level annotations for nine classes, including flooded vs. non-flooded roads, buildings, water, and debris. FloodNet was among the first to offer multi-class semantic annotations in a post-hurricane context, extending beyond just buildings. More recently, RescueNet [ 18 ] gathered 4,494 UAV images after Hurricane Michael, providing comprehensive annotations across 10 classes. RescueNet includes semantic segmentation masks for buildings, roads (clear or blocked), trees, vehicles, pools, and water, along with a four-tier damage level scale for each building (superficial, minor, major, total destruction). II-B 3D Benchmark Datasets 3D semantic segmentation datasets are created using RGB-D cameras, LiDAR scanners, or synthetic 3D data from rendering engines like Unreal Engine. They are categorized into indoor and outdoor datasets. II-B 1 3D Indoor Benchmark Datasets S3DIS [ 1 ] , built with an RGB-D scanner, captures point clouds of various indoor spaces. The ScanNet family (ScanNet [ 5 ] , ScanNet200 [ 20 ] , ScanNet++ [ 28 ] ) reconstructs 3D point clouds from RGB-D video sequences using fusion algorithms, with semantic annotations via Amazon Mechanical Turk. II-B 2 3D Outdoor Benchmark Datasets SemanticKITTI [ 2 ] , from the KITTI Vision Odometry Benchmark, features 22 urban driving sequences collected with a Velodyne HDL-64E LiDAR. Waymo Open Dataset [ 23 ] covers multiple cities using autonomous vehicles (AVs) equipped with LiDAR and high-resolution cameras. nuScenes [ 3 ] provides 1,000 urban scenes from Boston and Singapore with multi-sensor AV data, including 3D bounding boxes for 23 object classes and attributes like moving and parked states. III Methodology III-A 3D Semantic Segmentation Methods Fig. 2 : The reconstruction pipeline. Frames extracted from UAV aerial footage are processed using Structure-from-Motion (SfM) and Multi-View Stereo (MVS) to generate 3D point clouds. Outliers are manually removed to obtain clean and accurate reconstructions. We evaluate the performance of three state-of-the-art (SOTA) models for 3D semantic segmentation: Fast Point Transformer (FPT) [ 14 ] , Point Transformer V3 (PTv3) [ 26 ] , and OA-CNNs [ 15 ] . Transformer-based architectures have demonstrated outstanding performance in natural language processing and 2D vision tasks such as image classification and object detection. However, their application to 3D point clouds is nontrivial due to the unordered and irregular structure of point cloud data, which contrasts with the grid-like structure expected by standard self-attention mechanisms. FPT [ 14 ] addresses these computational challenges by leveraging voxelization to structure point clouds. It introduces centroid-aware voxelization and devoxelization techniques that preserve continuous coordinate embeddings, reduce quantization artifacts, and enhance coherence in dense predictions. These innovations significantly improve both the efficiency and accuracy of point cloud processing, especially for large-scale 3D scenes. PTv3 [ 26 ] mitigates the limitations of conventional transformers in point cloud analysis by introducing a serialization strategy. It divides the 3D space into a uniform voxel grid and applies space-filling curves, such as Z-order, Hilbert, Trans Z-order, and Trans Hilbert curves, to convert unordered point sets into structured sequences while preserving spatial locality. This serialization enables attention mechanisms to operate effectively without relying on expensive neighbor search operations (e.g., k-nearest neighbors), as required in earlier models like PTv1 and PTv2 [ 30 , 27 ] . Moreover, PTv3 replaces complex relative positional encodings with a lightweight pre-positive sparse convolutional layer (xCPE), which captures spatial relationships efficiently with minimal computational cost. OA-CNNs [ 15 ] tackle the adaptability limitations of traditional sparse convolutional networks, which often