Efficient Building Roof Type Classification: A Domain-Specific Self-Supervised Approach

Guneet Mutreja 1, Ksenia Bittner 1 · 2025

Read Efficient Building Roof Type Classification: A Domain-Specific Self-Supervised Approach by Guneet Mutreja 1, Ksenia Bittner 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22251.txt.

Introduction

Guneet Mutreja and Ksenia Bittner sort building roofs into types from aerial photos without needing many labeled examples, in a paper published in two thousand twenty-five. Roof type matters for city planning, disaster response, and tracking infrastructure, but labeled training data is scarce.

Their approach lets the model teach itself from unlabeled images first. They build on EfficientNet, a family of networks known for doing much with little computing power. An added attention block sharpens the features the network pulls from each photo. They also test whether warming up on an aerial photo dataset beats the usual warm-up on general photos. Their results favor the domain-specific route and the attention boost. The findings point to cheaper, faster roof mapping for remote sensing work.

Catalog record

CREATORGuneet Mutreja 1, Ksenia Bittner 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-22251

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Efficient Building Roof Type Classification: A Domain-Specific Self-Supervised Approach Guneet Mutreja 1, Ksenia Bittner 1 Abstract Accurate classification of building roof types from aerial imagery is crucial for various remote sensing applications, including urban planning, disaster management, and infrastructure monitoring. However, this task is often hindered by the limited availability of labeled data for supervised learning approaches. To address this challenge, this paper investigates the effectiveness of self-supervised learning with EfficientNet architectures, known for their computational efficiency, for building roof type classification. We propose a novel framework that incorporates a Convolutional Block Attention Module (CBAM) to enhance the feature extraction capabilities of EfficientNet. Furthermore, we explore the benefits of pretraining on a domain-specific dataset, the Aerial Image Dataset (AID) , compared to ImageNet pretraining. Our experimental results demonstrate the superiority of our approach. Employing Simple Framework for Contrastive Learning of Visual Representations (SimCLR) with EfficientNet-B3 and CBAM achieves a 95.5 95.5 % accuracy on our validation set, matching the performance of state-of-the-art transformer-based models while utilizing significantly fewer parameters. We also provide a comprehensive evaluation on two challenging test sets, demonstrating the generalization capability of our method. Notably, our findings highlight the effectiveness of domain-specific pretraining, consistently leading to higher accuracy compared to models pretrained on the generic ImageNet dataset. Our work establishes EfficientNet-based self-supervised learning as a computationally efficient and highly effective approach for building roof type classification, particularly beneficial in scenarios with limited labeled data. keywords Building Roof Type Classification, Self-Supervised Learning, EfficientNet, Domain-Specific Pretraining, Aerial Imagery, Remote Sensing. 1 Introduction 1.1 Background The proliferation of remote sensing technologies has made aerial imagery readily available, opening up a wide range of applications for understanding and managing our built environment. Accurate and up-to-date information about buildings, including their roof structures, is crucial for urban planning, disaster response, infrastructure management, and the creation of detailed digital twins. For instance, precise 3D building models, which rely on accurate roof type classification, are essential for simulating urban environments, analyzing shadows, and generating realistic visualizations. Furthermore, knowing the distribution of different roof types is valuable for damage assessment after natural disasters and for energy modeling to optimize energy consumption and mitigate urban heat islands. Despite its importance, obtaining sufficient labeled data for training robust roof type classification models remains a persistent challenge in remote sensing. Manually annotating aerial imagery to identify diverse roof structures is time-consuming, requires expert knowledge, and can be cost-prohibitive. This challenge is amplified by the global variability in roof architectures, ranging from simple flat roofs to complex combinations of gables, hips, and dormers. Additionally, dense urban environments often present difficulties in accurately delineating individual roofs due to closely spaced buildings and complex building shapes. To address the limitations of relying on scarce labeled data, this paper explores the potential of self-supervised learning for building roof type classification. Self-supervised learning allows models to learn from readily available unlabeled data by leveraging inherent structures and patterns within the data itself to generate supervisory signals. This approach holds significant promise for remote sensing applications where labeled data is often limited. Specifically, we propose a novel framework that combines the computational efficiency of EfficientNet architectures, enhanced with a Convolutional Block Attention Module (CBAM) , and domain-specific pretraining on the Aerial Image Dataset (AID) to achieve accurate and efficient roof type classification, even with limited labeled examples. Figure 1 : Classification results of BEit model pretrained using Aerial Image Dataset on building roof types in the Braunschweig area. 1.2 Related work Self-Supervised Learning . The scarcity of labeled data in remote sensing has spurred the development of self-supervised learning methods, enabling models to learn representations from unlabeled data. These methods have gained significant traction due to their ability to leverage the abundance of unlabeled aerial imagery and reduce the reliance on costly manual annotations. A prominent category of self-supervised learning is contrastive learning, where models are trained to distinguish between augmented views of the same image (positive pairs) and different images (negative pairs). Chen et al., (2020) , He et al., (2020) , and Caron et al., (2020) are notable examples of contrastive learning methods that have shown success in learning useful representations for various downstream tasks, including image classification and object detection. These methods encourage models to learn invariant features that are robust to different viewpoints, lighting conditions, and other variations commonly encountered in remote sensing imagery. Other approaches leverage pretext tasks, where models are trained to solve a predefined task using the unlabeled data, as a form of self-supervision. Examples include Gidaris et al., (2018) , Larsson et al., (2017) , or Noroozi and Favaro, (2016) . While these pretext tasks might not be directly related to the final downstream task, they encourage models to learn meaningful representations that can be transferred and fine-tuned for specific applications. More recently, transformer-based models have emerged as powerful tools for self-supervised learning in computer vision. He et al., (2021) , inspired by the success of Devlin et al., (2018) in natural language processing, employ a masking strategy where portions of the input image are masked, and the model is trained to reconstruct the missing pixels. Bao et al., (2021) and Peng et al., (2022) leverage masked image modeling for pretraining, achieving state-of-the-art results on various image classification benchmarks. Chen et al., (2021) combines contrastive and generative objectives by incorporating masked image modeling into the momentum contrastive (MoCo) framework. This paper investigates the effectiveness of several of these self-supervised learning approaches, including Simple Framework for Contrastive Learning of Visual Representations (SimCLR) , Swapping Assignments between Views (SwAV) , and BEit, for the specific task of building roof type classification from aerial imagery. Building Roof Type Classification . Classifying building roof types from aerial imagery is a crucial task in remote sensing, with applications in urban planning, 3D city modeling, disaster response, and energy modeling. However, developing accurate and robust methods for this task is challenging, primarily due to the difficulty of obtaining large, high-quality labeled datasets. Traditional approaches to roof type classification often relied on handcrafted features and rule-based systems ( Pu and Vosselman,, 2009 ) . However, these methods typically struggle to generalize to diverse roof structures and are sensitive to variations in image quality and scene complexity. With the advent of deep learning, supervised learning approaches using convolutional neural networks ( Convolutional Neural Network (CNN) ) have become dominant in building roof type classification. Interestingly, Buyukdemircioglu et al., (2021) showed that even a shallow CNN architecture can achieve acceptable accuracy for roof type classification from very high-resolution orthophotos, particularly when dealing with sparse data. They compared their shallow CNN to fine-tuned versions of VGG-16 ( Simonyan and Zisserman,, 2015 ) , EfficientNetB4 ( Tan and Le,, 2019 ) , and ResNet-50 ( He et al.,, 2015 ) , finding that while the shallow model had slightly lower overall accuracy, it still performed adequately for many applications. This suggests that computationally efficient CNN models can be effective for roof type classification. Huang et al., (2023) introduced the Urban Building Classification (UBC) V2-A Benchmark, a large-scale dataset for global building detection and fine-grained classification from satellite imagery, demonstrating the capabilities of CNN s for this task. While promising, these supervised methods require substantial amounts of labeled

Read the complete text