Enhanced Small Target Detection via Multi-Modal Fusion and Attention Mechanisms: A YOLOv5 Approach

1 st Xiaoxiao Ma, 2 nd Junxiong Tong · 2025

Read Enhanced Small Target Detection via Multi-Modal Fusion and Attention Mechanisms: A YOLOv5 Approach by 1 st Xiaoxiao Ma, 2 nd Junxiong Tong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11262.txt.

Introduction

Xiaoxiao Ma and Junxiong Tong improve small target spotting in a 2025 paper with military uses in mind. Tiny, dim targets in cluttered scenes are hard for cameras to catch, yet modern defense relies on fast, automated spotting. Their method builds on a popular detection network and feeds it two kinds of images at once.

Infrared and visible-light images are first aligned by matching feature points. A built-in attention module then helps the network weigh the fused features. Tests on anti-drone and drone-view datasets showed stronger results than rival methods, above all for small and faint targets. The authors present the pairing of image types, plus attention, as a practical boost for real-time detection.

Catalog record

CREATOR1 st Xiaoxiao Ma, 2 nd Junxiong Tong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-11262

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhanced Small Target Detection via Multi-Modal Fusion and Attention Mechanisms: A YOLOv5 Approach 1 st Xiaoxiao Ma, 2 nd Junxiong Tong Abstract With the rapid development of information technology, modern warfare increasingly relies on intelligence, making small target detection critical in military applications. The growing demand for efficient, real-time detection has created challenges in identifying small targets in complex environments due to interference. To address this, we propose a small target detection method based on multi-modal image fusion and attention mechanisms. This method leverages YOLOv5, integrating infrared and visible light data along with a convolutional attention module to enhance detection performance. The process begins with multi-modal dataset registration using feature point matching, ensuring accurate network training. By combining infrared and visible light features with attention mechanisms, the model improves detection accuracy and robustness. Experimental results on anti-UAV and Visdrone datasets demonstrate the effectiveness and practicality of our approach, achieving superior detection results for small and dim targets. I Introduction The rapid advancement of information technology is reshaping modern warfare, transitioning it toward more intelligent and information-based forms. Modern military superiority no longer relies solely on advanced weaponry but also requires efficient information processing and decision-making systems. In this context, target detection and recognition have emerged as crucial technologies that significantly impact reconnaissance, surveillance, and precision strikes. Among the various challenges in military operations, small target detection (such as micro-UAVs, stealth missiles, and small ground vehicles) holds particular importance [ 1 ] . These targets often possess characteristics such as small size and high mobility, making their accurate and real-time detection critical for modern warfare capabilities. However, real-world operational environments are highly complex and dynamic, presenting numerous interference factors such as complicated terrain, dynamic backgrounds, and various environmental noise. Accurately detecting small targets amidst these challenges has become a vital technological hurdle. Traditional large-target detection algorithms have shown success in certain scenarios; however, when applied to small targets, their detection performance suffers due to limitations in resolution and feature extraction. This performance gap highlights the need for more sophisticated detection methodologies tailored specifically for small targets. Multi-source information fusion is a promising technique that combines data from various sensors and information sources through advanced algorithms. The goal is to deliver a more accurate and comprehensive understanding than could be achieved with any single information source. In military applications, multi-source information fusion is particularly valuable. Different types of sensors, such as infrared sensors, radar, and visible-light cameras, each offer unique advantages and limitations depending on the scenario and target. For example, infrared sensors excel in night-time and adverse weather conditions but typically have lower resolution; radar can track targets over large distances but may struggle with reflection and noise in complex environments; visible-light cameras capture high-resolution imagery but are hindered by poor lighting conditions. This research builds on the need for more robust small target detection systems by leveraging multi-source information fusion. Through the integration of infrared, radar, and visible-light data, this study seeks to enhance detection capabilities in challenging environments. Furthermore, this paper introduces innovative fusion algorithms designed to improve the accuracy and reliability of small target detection in real-world operational settings. II Related Work In recent years, the problem of small object detection in images has attracted a lot of attention in both civil and military fields. Small target is the object occupying the least pixels in the image, and its low resolution and unobvious features are difficult to detect accurately [ 2 ] . To address these challenges, various approaches have been developed, each bringing unique benefits. Among them, the four most commonly used methods are multi-scale, super-resolution, attention mechanism and context-based strategy detection methods. The progress and examples of each method are described in detail below. II-A Multi-Scale Detection Methods Multi-scale detection methods are essential in addressing the challenges posed by small objects, which are often difficult to detect due to their limited pixel representation. These methods leverage the extraction of features at different scales to enhance detection accuracy. Below, we outline two recent approaches that have made significant contributions in this area. RetinaNet [ 3 ] , developed by Facebook AI Research, is a single-stage object detection algorithm that combines a Feature Pyramid Network (FPN) with Focal Loss to address class imbalance in detection tasks. The FPN enables the model to detect objects of various sizes by extracting multi-scale features, while Focal Loss focuses on hard-to-classify samples, improving detection of small objects obscured by larger elements. Its single-stage design simplifies and speeds up detection, enhancing small object performance. Libra R-CNN [ 4 ] , introduced by Pang et al. in 2019, enhances multi-scale feature extraction for more consistent detection across object sizes. Its key feature, the Balanced Feature Pyramid (BFP), adaptively fuses multi-level features to improve small object representation in low-resolution maps. Libra R-CNN also employs IoU-balanced sampling and branch-balanced loss to tackle small object detection challenges, leading to better performance in complex environments. II-B Super-Resolution Methods Super-resolution methods have emerged as a key approach to enhancing the detection of small objects by increasing the resolution of input images. These methods reconstruct high-resolution images from low-resolution inputs, allowing detection models to capture finer details. Below, we discuss two significant super-resolution techniques that have contributed to the advancement of small object detection. FSRCNN (Fast Super-Resolution Convolutional Neural Network) [ 5 ] by Dong et al. is a fast and efficient method that builds on the SRCNN model. It innovates with a ”down-scaling, convolution, and up-scaling” approach, performing convolutions in the low-resolution space to reduce computation while maintaining high-quality reconstruction. The final upscaling is done through a sub-pixel convolution layer, which enhances image detail and improves small object detection accuracy. For example, applying FSRCNN to the COCO dataset improved YOLOv3’s small object detection performance by about 5 HRDNet (High-Resolution Detection Network) [ 6 ] by Liu et al. (2021) aims to boost detection performance while managing the computational load of high-resolution images. It combines a Multi-Depth Image Pyramid Network (MD-IPN) and a Multi-Scale Feature Pyramid Network (MS-FPN) to balance efficiency and object size variance. Using a deep backbone for low-resolution and a shallow backbone for high-resolution images, HRDNet captures detailed features for small objects, improving detection efficiency and effectiveness with high-resolution data. II-C Attention Mechanism Methods Recent advancements in Transformer-based architectures have shown promise in improving small object detection through enhanced feature extraction mechanisms. Two notable approaches are Vision Transformer and Swin Transformer. Vision Transformer (ViT) [ 7 ] applies the Transformer model, initially successful in natural language processing, to image processing. ViT divides an image into fixed-size patches, then embeds these patches linearly before feeding them into a Transformer encoder. This self-attention mechanism captures dependencies across different patches, enhancing the detection of small objects by focusing on relevant image features across the entire image. ViT’s ability to model global attention helps improve performance in small object detection tasks. Swin Transformer [ 8 ] , developed by Microsoft, builds on ViT by introducing a hierarchical structure and a sliding window mechanism. Unlike ViT, Swin Transformer uses window-based attention, which allows it to process image information more efficiently by focusing on local regions and shifting windows to capture global dependencies. This balance between local and global attention leads to higher

Read the complete text