DamageCAT: A Deep Learning Transformer Framework for Typology-Based Post-Disaster Building Damage Categorization

Yiming Xiao, Ali Mostafavi · 2025

Read DamageCAT: A Deep Learning Transformer Framework for Typology-Based Post-Disaster Building Damage Categorization by Yiming Xiao, Ali Mostafavi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11637.txt.

Introduction

Yiming Xiao and Ali Mostafavi present a system that sorts disaster damaged buildings into detailed types rather than a simple damage scale, in a paper from 2025. Knowing whether a roof partly failed or a structure fully collapsed guides rescue and rebuilding aid. Their data set holds satellite image triplets from one hurricane, labeled in four such categories.

The model compares images from before and after the storm with a layered transformer design. It scored well on overlap and accuracy measures overall. Tested on three other hurricanes, it carried over to new events. Rare categories scored lower because examples were scarce. The authors argue type based labels give responders more usable information than severity grades.

Catalog record

CREATORYiming Xiao, Ali Mostafavi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-11637

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DamageCAT: A Deep Learning Transformer Framework for Typology-Based Post-Disaster Building Damage Categorization Yiming Xiao, Ali Mostafavi Abstract Rapid, accurate, and descriptive building damage assessment is critical for directing post-disaster resources, yet current automated methods typically provide only binary (damaged/undamaged) or ordinal severity scales. This paper introduces DamageCAT, a framework that advances damage assessment through typology-based categorical classifications. We contribute: (1) the BD-TypoSAT dataset containing satellite image triplets from Hurricane Ida with four damage categories—partial roof damage, total roof damage, partial structural collapse, and total structural collapse—and (2) a hierarchical U-Net-based transformer architecture for processing pre- and post-disaster image pairs. Our model achieves 0.737 IoU and 0.846 F1-score overall, with cross-event evaluation demonstrating transferability across Hurricane Harvey, Florence, and Michael data. While performance varies across damage categories due to class imbalance, the framework shows that typology-based classification can provide more actionable damage assessments than traditional severity-based approaches, enabling targeted emergency response and resource allocation. keywords Damage assessment, Satellite imagery, Transformers, Damage description 1 Introduction 1.1 Motivation & problem statement The increasing frequency and severity of natural disasters pose significant challenges to emergency response systems worldwide. According to Gholami et al. (2022) , natural disasters affect approximately 350 million people annually, causing billions of dollars in damages. Climate change is expected to further exacerbate these trends, leading to more frequent and intense disasters ( Pizzorni et al., 2024 ) . In this context, rapid and accurate building damage assessment becomes crucial for effective disaster response and recovery. Building damage assessment serves multiple critical purposes in disaster response. As Adriano et al. (2023) emphasizes, timely damage assessment is essential for both emergency response and prompt recovery efforts. Similarly, Dias et al. (2024) highlights that building damage assessment is vital for guiding disaster response missions and estimating recovery needs across impacted areas. The information gathered through damage assessment enables humanitarian organizations to be prompt, effective, and efficient in supporting affected populations ( Bouchard et al., 2022 ) . Traditional damage assessment methods rely heavily on manual visual interpretation of post-disaster imagery. However, this approach presents significant limitations. Alisjahbana et al. (2024) point out that manual interpretation is not only time-consuming but often results in very low accuracy. The labor-intensive and tedious nature of manual annotation further hampers rapid response efforts ( Bouchard et al., 2022 ) . In addition, field-based assessments may be dangerous or impossible in severely affected areas, creating information gaps in critical locations. Satellite imagery offers a promising alternative for building damage assessment. In recent years, the use of remote sensing data and machine learning has significantly enhanced damage assessment in disasters. Kahl and Chen (2024) note that satellites provide a unique, comprehensive viewpoint for information retrieval from disaster-affected zones. Commercial satellite providers now enable near-daily monitoring of Earth’s surface, facilitating timely post-disaster assessments ( Dias et al., 2024 ) . Moreover, remote sensing technologies provide rich and reliable information to support expert decision-making ( Bouchard et al., 2022 ) . Despite these advantages, satellite-based damage assessment faces several challenges. Chen et al. (2024) observed that the task is complicated by diverse building structures and complex environments. Liu et al. (2022) highlight that building damage classification is challenging due to limited publicly available imagery data of damaged buildings and the difficulty in judging damage levels from images. Furthermore, most existing deep learning models are designed for non-damaged building segmentation and may not be suitable for damaged building classification ( Liu et al., 2022 ) . The integration of deep learning with satellite imagery has shown promising results in automating building damage assessment. Neto and Dantas (2024) demonstrated the potential of combining mathematical morphology and convolutional neural networks for building damage segmentation. Similarly, May et al. (2022) utilized advanced networks such as EfficientNet and Siamese models to detect buildings and evaluate damage levels using pre- and post-event images. However, several limitations persist in current deep-learning approaches for remote sensing-based disaster-damaged assessment. Melamed et al. (2024) identified bias in commonly used datasets, noting that deep learning models struggle to accurately identify isolated damaged buildings, potentially causing oversights in critical disaster scenarios and delaying humanitarian aid. In addition, Wang et al. (2022) point out challenges related to extremely imbalanced datasets, where damaged buildings are significantly underrepresented compared to undamaged ones. Another significant limitation of current deep learning-based models for building damage assessment is their reliance on subjective severity scales (e.g., “low,” “moderate,” “high”), which offer limited insight into the specific nature and type of damage. These severity labels often arise from coarse-grained assessments that can vary between datasets or annotators, leading to inconsistencies and ambiguity. Moreover, a single severity score cannot distinguish whether damage is confined to a roof or extends into load-bearing structures, nor can it differentiate between partial and total collapse. As a result, key nuances—such as the potential for secondary hazards or the requisite expertise for repairs—are frequently overlooked. This lack of descriptive granularity ultimately hampers targeted resource allocation, informed decision-making, and effective prioritization of rescue and recovery efforts in post-disaster scenarios. Despite the growing amount of literature leveraging deep learning for post-disaster damage assessments, current severity-based classification approaches often provide only coarse estimates. While previous studies have made important strides in damage classification, subjective rating scales can neglect the underlying mechanisms or precise nature of the damage, potentially limiting model applicability for decision-making in real disaster scenarios. Knowing whether a structure exhibits partial roof damage or total structural collapse is not just a matter of granularity; it directly influences emergency response strategies, resource allocation, and subsequent recovery efforts. For instance, responding to a partially damaged roof may call for specialized roofing repair teams and temporary protective measures, whereas a structural collapse demands immediate search-and-rescue operations and comprehensive rebuilding plans. Building upon foundational work in remote sensing-based damage assessment, this study explores a typology-based classification approach that aims to capture distinct modes of structural failure, complementing existing automated assessment systems. This research context emphasizes opportunities to enhance damage evaluation across various disaster conditions, construction types, and geographic regions, while acknowledging the inherent challenges of satellite-based assessment. 1.2 Research objectives This study aims to contribute to building damage assessment by exploring typology-based classification framework that captures distinct modes of structural failure. We present a deep learning architecture that processes pre- and post-disaster satellite imagery to identify and categorize building damage with greater detail. To support this exploration, we introduce BD-TypoSAT (Building Damage Typology Satellite Dataset), containing four specific damage categories—partial roof damage, total roof damage, partial structural collapse, and total structural collapse—offering potentially richer representation than standard severity-based labels. We then deploy a transformer-driven, hierarchical U-Net that integrates semantic segmentation and change detection to segment building footprints and classify them by damage type. This approach aims to yield actionable information for emergency managers and stakeholders. Finally, we rigorously evaluate the model’s performance using multiple metrics (e.g., IoU, F1) to demonstrate its utility under real-world conditions, and we discuss both the operational implications and limitations for disaster response, such as more informed resource allocation and prioritization of recovery efforts. 1.3 Contributions This study makes several key contributions to automated building damage assessment. We introduce the BD-TypoSAT dataset, derived from high-resolution satellite imagery captured after Hurricane Ida (2021), which categorizes building damage into four

Read the complete text