Saliency-Guided Deep Learning for Bridge Defect Detection in Drone Imagery

Loucif Hebbache, Dariush Amirkhani, Mohand Saïd Allili, Jean-François Lapointe · 2025

Read Saliency-Guided Deep Learning for Bridge Defect Detection in Drone Imagery by Loucif Hebbache, Dariush Amirkhani, Mohand Saïd Allili, Jean-François Lapointe (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14040.txt.

Introduction

Loucif Hebbache, Dariush Amirkhani, and Mohand Saïd Allili automate bridge inspection from drone photos in two stages. Cracks and other concrete defects break the normal surface pattern, so the first stage uses visual saliency to propose regions where defects are likely. That narrows the search before any heavy model runs.

The second stage runs a YOLOX-based detector on images whose salient defect regions have been brightened at the bounding-box level. Tests on standard data sets confirm good accuracy with modest computing cost. The authors note the framework's efficiency gives it strong potential for a self-powered inspection system that could screen bridges without lane closures or scaffolding crews.

Catalog record

CREATORLoucif Hebbache, Dariush Amirkhani, Mohand Saïd Allili, Jean-François Lapointe
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-14040

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Saliency-Guided Deep Learning for Bridge Defect Detection in Drone Imagery Loucif Hebbache, Dariush Amirkhani, Mohand Saïd Allili, Jean-François Lapointe Abstract Anomaly object detection and classification are one of the main challenging tasks in computer vision and pattern recognition. In this paper, we propose a new method to automatically detect, localize and classify defects in concrete bridge structures using drone imagery. This framework is constituted of two main stages. The first stage uses saliency for defect region proposals where defects often exhibit local discontinuities in the normal surface patterns with regard to their surrounding. The second stage employs a YOLOX-based deep learning detector that operates on saliency-enhanced images obtained by applying bounding-box level brightness augmentation to salient defect regions. Experimental results on standard datasets confirm the performance of our framework and its suitability in terms of accuracy and computational efficiency, which give a huge potential to be implemented in a self-powered inspection system. I Introduction Inspection to detect surface defects is an important task for maintaining the structural reliability of bridges. Failing to do so can lead to disastrous consequences as shown by the recent collapse of the Morandi bridge [ 7 ] . According to public data, out of 607,380 existing bridges in USA, nearly 67,000 are classified as structurally deficient whereas approximately 85,000 are considered functionally obsolete. Currently, the inspection task is often conducted manually by inspectors which could be time-consuming and sometimes cumbersome and painstaking. Recently, there has been a growing shift toward using aerial vehicles for performing inspection tasks, specifically for bridges, due to the provided benefits [ 18 ] . Drones can reduce dramatically inspection time which is important to detect early stage damages to prevent any further losses in their structural capacity and durability. Using drones allow also to avoid dangerous situations for professional inspectors. They can basically collect visual data in hard-to-reach sites, but also autonomously perform real-time analysis of the images to assess about potential defects. Beyond basic imaging, recent AI–AR systems have shown that UAV-based bridge inspection can be carried out remotely with real-time defect overlays and interactive visualization, further reducing on-site time and cognitive load for inspectors [ 19 , 20 ] . Recent developments in deep learning (DL), specifically for object detection and classification, have unleashed huge opportunities for applications such as monitoring and visual inspection for anomaly detection and robust object detection in adverse imaging conditions [ 25 , 4 , 27 ] . This also led to publishing of several benchmark datasets with annotations, facilitating model training and testing. One of the most popular datasets is COncrete DEfect BRidge IMage dataset (CODEBRIM) proposed by Mundt et al. [ 27 ] , which exhibits multiple defects, including : crack, spallation, exposed reinforcement bar, efflorescence, corrosion (stains). This gave rise to several works that used machine learning techniques to detect bridge surface anomalies [ 9 ] and, more generally, to support visual maintenance of other civil infrastructure components such as sidewalks [ 30 ] .. Comprehensive surveys such as [ 2 ] provide an up-to-date overview of visual concrete bridge defect classification and detection using deep learning, highlighting the need for robust multi-defect and multi-scale models that operate reliably on UAV imagery. For example, authors in [ 18 ] used CNNs for detecting cracks via image classification. This method has shown a good performance, but shadows and low contrast can affect its accuracy. In [ 39 ] , the authors have proposed to use a single-stage for defect detection and classification based on the You Only Look Once V3 (YOLOv3) model [ 29 ] . The approach has succeeded in detecting multiple damages in concrete bridges by achieving 80% accuracy on the CODEBRIM dataset and out-performing the two-stage R-CNN method [ 33 ] . However, it has shown some limitations when dealing with small and low-contrasted defects. In the same vein, Tabernik et al. [ 38 ] used segmentation-based deep learning architecture to specifically tackle crack detection. More recently, Amirkhani et al. proposed CrackSight, an efficient crack segmentation model that maintains high accuracy across varying acquisition ranges and complex backgrounds, further improving robustness for real inspection scenarios [ 1 ] . Finally, [ 16 ] used YOLO and MobileNetV3-SSD object detection algorithms to detect and classify concrete defects, which showed very promising results. More recent work has started to exploit the latest YOLO family members for concrete and building defect detection. For instance, Tian et al. proposed YOLOv11-EMC, an optimized YOLOv11-based framework with deformable and dynamic convolutions that improves precision, recall, and F1 for multi-category concrete surface defects, including drone field tests [ 37 ] . At a broader level, Sapkota et al. reviewed the evolution of YOLO models from YOLOv1 up to the recently unveiled YOLOv12, showing consistent progress in speed and accuracy for real-time object detection and outlining future directions for YOLOv11/YOLOv12-based applications in infrastructure monitoring [ 35 ] . All the above methods have achieved noticeable successes when tackling individual defect classes such as cracks, but they loose effeciency when dealing with other types of defects. Indeed, developing a unique model that can deal with all defect classes hard to achieve. Defect detection and classification, and particularly on bridge surfaces, pose several challenges. First, even if defects can be categorized into different classes, there is huge intra-class variability due to varying illumination conditions, angle of view changes and size and severity of defects [ 9 ] . On the other hand, some defect classes can have a huge overlapping, while co-occurrence of different defects at some locations is not uncommon. Finally, datasets often contain noisy labels which add an extra difficulty in correctly training and evaluating algorithms [ 28 ] . Saliency information has also been leveraged more explicitly in recent one-stage multi-label detectors for concrete defects, where Grad-CAM-based saliency maps are fused into a single-stage network to emphasize defect regions and improve performance on CODEBRIM and UAV datasets [ 14 ] . In this paper, we propose a method for automatic detection, localisation, and classification of defects using drone imagery. Our method is composed of two main steps. In the first step, we compute local saliency maps to highlight potential defect regions and derive bounding boxes around them, and then apply bounding-box level brightness augmentation to these salient regions to generate a saliency-enhanced image. In the second step, we use a multi-label YOLOX model [ 11 ] operating on the saliency-enhanced image to localize and classify defects. Finally, we prune over- and under-detections by analysing the extent and continuity of the detected defects. Our method has been evaluated on the CODEBRIM [ 27 ] dataset, and the results show that it outperforms other state-of-the-art methods. This paper is organized as follows: Section II presents the proposed method, Section III presents some experimental results for validation. We end the paper with a conclusion and future work perspectives. II Proposed method Our core idea in this paper is to improve defect detection and classification by leveraging saliency as a front-end enhancement module for a deep object detector. This is motivated by the observation that, regardless of its type, a defect is typically characterized by a local surface discontinuity that can be more effectively captured by analysing local saliency

Read the complete text