Deformable Attention Mechanisms Applied to Object Detection, case of Remote Sensing Paper accepted at the 29th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems (KES 2025)

Anasse Boutayeb, Iyad Lahsen-cherif, Ahmed El Khadimi · 2025

Read Deformable Attention Mechanisms Applied to Object Detection, case of Remote Sensing Paper accepted at the 29th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems (KES 2025) by Anasse Boutayeb, Iyad Lahsen-cherif, Ahmed El Khadimi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24489.txt.

Introduction

Anasse Boutayeb, Iyad Lahsen-Cherif, and Ahmed El Khadimi apply a deformable attention detector to remote sensing images in a 2025 paper. Finding objects in satellite and radar views matters for many fields, and transformer models have become strong tools for the job.

A model called Deformable-DETR, whose attention can shift its focus points, was tested in two modes. One data set held optical photos of aircraft, and the other held radar images of ships. Careful cross validation gave F1 scores near ninety five percent on both sets. The authors compare their results with a range of detectors, from classic convolutional networks to transformers and remote sensing specialists.

Catalog record

CREATORAnasse Boutayeb, Iyad Lahsen-cherif, Ahmed El Khadimi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24489

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Deformable Attention Mechanisms Applied to Object Detection, case of Remote Sensing Paper accepted at the 29th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems (KES 2025) Anasse Boutayeb, Iyad Lahsen-cherif, Ahmed El Khadimi Abstract Abstract- Object detection has recently seen an interesting trend in terms of the most innovative research work, this task being of particular importance in the field of remote sensing, given the consistency of these images in terms of geographical coverage and the objects present. Furthermore, Deep Learning (DL) models, in particular those based on Transformers, are especially relevant for visual computing tasks in general, and target detection in particular. Thus, the present work proposes an application of Deformable-DETR model, a specific architecture using deformable attention mechanisms, on remote sensing images in two different modes, especially optical and Synthetic Aperture Radar (SAR). To achieve this objective, two datasets are used, one optical, which is Pleiades Aircraft dataset, and the other SAR, in particular SAR Ship Detection Dataset (SSDD). The results of a 10-fold stratified validation showed that the proposed model performed particularly well, obtaining an F1 score of 95.12% for the optical dataset and 94.54% for SSDD, while comparing these results with several models detections, especially those based on CNNs and transformers, as well as those specifically designed to detect different object classes in remote sensing images. Keywords : Deformable-DETR, Transformers, Remote sensing, Object Detection, K-Fold Validation. 1 Introduction In addition to several Artificial Intelligence (AI) novel methods [ 1 , 2 ] , transformer-based models [ 3 ] represent a prominent trend in Deep Learning (DL), particularly with regard to highly complex tasks such as target detection. In particular, object detection on remote sensing images is a current challenge [ 4 ] , given the increasing use of this mode by a large community of users. Moreover, this specific task, in both active and passive modes, represents a very delicate task, given the difficulty of recognizing objects, particularly small-scale ones, on the one hand, and the consistency of the concerned images, on the other. Consequently, extracting sufficient features in this context is an obstacle to be solved, notably by using the most innovative models. Given the wealth of information contained in remote sensing images, particularly for very high-resolution ones (less than 1m), target detection takes on greater importance. Several applications can take advantage of the products resulting from this process, such as agriculture [ 5 ] , security [ 6 ] , or even the field of energy and mining, where the automatic detection of solar panels [ 7 ] , for example, represents a key requirement. Indeed, the aim of this work is to present the application of a particular concept, especially deformable attention mechanisms, on two datasets. Therefore, the final purpose is to evaluate the performance of this model in terms of prediction accuracy and convergence speed, by comparing it with the models most widely used in the literature. In fact, the remainder of this paper will be organized as follows, Section 2 is devoted to the situation of this work in relation to similar research, while emphasizing its particular contribution. Then, Section 3 presents the models and datasets used for comparison, while Section 4 introduces the methodology by discussing the evaluation metrics and the benchmarking workflow. Section 5 illustrates the experimental results, mentioning the metric values, as well as the measurement of model speed based on training times, together with a rapid evaluation in order to compare Deformable-DETR with other transformer-based remote sensing detectors. Finally, the last section is devoted to the outlooks, illustrating the possible follow-up to this research as well as the main conclusions. 2 Related works A multitude of recent research have addressed the issue of target detection on remotely sensed images. As an example, Coulson et al. [ 8 ] conducted a comparative study to present a set of CNN-based models. The authors compared several methods, namely Single Shor Detector (SSD) [ 9 ] , YOLOv3, RetinaNet and Faster R-CNN, while obtaining the highest performance for the Faster R-CNN model. Besides, Aleissaee et al. [ 10 ] proposed the first survey of the application of Vision Transformers (ViT) [ 11 ] on remote sensing. With regard to object detection, the authors emphasized the difficulty of this task, due to scale variations, and the diversified orientations of the present objects. Also, the authors presented two main categories of models, specifically those based on detector transformers (DETR), and hybrid models, combining Convolutional Neural Networks (CNNs) with transformer-based architectures, including Arbitrary-Oriented Object DEtection TRansformer (AO2-DETR) [ 12 ] and O2DETR [ 13 ] . Given the interest and novelty of deformable attention mechanisms in computer vision tasks, particularly with regard to optimizing training and inference over computational costs, several previous researches have applied this principle to remote sensing field. Zhao et al. [ 14 ] propose DOCswin-Trans, an innovative method for road detection, based on the CSwin Transformer improved classifier and deformable attention in order to address the problem of scale variability. In another context, Ning et al. [ 15 ] present Multi-scale Attention Boosted Deformable Transformer (MADBT), a model for denoising remote sensing images. The authors used multiscale attention to extract fine local image features, and Attention Deformable Transformer Block (ADTB) to solve the problem of noise variations at different scales. Furthermore, several research papers have addressed the subject of applying Deformable-DETR model to remote sensing images. For example, Chen et al. [ 16 ] present PR-Deformable DETR, a novel architecture applying adaptive pyramidal fusion on the base model, while achieving mAP values of 95.1% and 88.3% on RSOD and NWPU VHR-10 optical datasets. Plus, Li et al. [ 17 ] propose Refined Deformable-DETR, which is a variant of Deformable-DETR, with innovative contributions including a multi-scale adapter for feature extraction, and an Auxiliary Feature Extractors (AFE) for calculating additional losses, resulting finally in a mAP@50 of 90.2% and a mAP of 68.2% on the HRSID dataset. Under the same context, the present research is situated regarding the existing literature in order to present the contribution of deformable attention mechanisms to the service of a complex task, that of object detection. The basic model, Deformable-DETR [ 18 ] , is proposed to measure its performance against the best-known models in this field, while using two different datasets. Furthermore, this work differs from previous research in that the models presented are applied to both modes of acquisition, relating to optical and SAR images. Moreover, a robust benchmarking protocol is employed, together with the complete code of the benchmarking, enabling users to visualize and compare the results. 3 Work Benchmarks: Models and Dataset In this section, all the models used for the benchmarking pipeline are presented, including those based on classical CNNs and Transformers, together with the used datasets, while introducing the data preparation stage. 3.1 Benchmarking models A bibliographic study is conducted to explore the models most widely used in previous research, and a customized query is carried out using Scopus platform. Several distinct models emerged from this study, in addition to Deformable-DETR, especially RetinaNet, Faster R-CNN, YOLOv11, as well as transformer-based architectures, which are indeed DETR, DN-DETR, Conditional DETR and DAB-DETR. 3.1.1 Deformable DETR This is a transformer-based model, implemented

Read the complete text