Lightweight Deep Unfolding Networks with Enhanced Robustness for Infrared Small Target Detection

Jingjing Liu, Yinchao Han, Xianchao Xiu, Jianhua Zhang · 2025

Read Lightweight Deep Unfolding Networks with Enhanced Robustness for Infrared Small Target Detection by Jingjing Liu, Yinchao Han, Xianchao Xiu, Jianhua Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08205.txt.

Introduction

Tiny hot targets in infrared images get a lighter, tougher detector from Jingjing Liu and 4 co-authors in a 2025 image processing paper. Deep unfolding networks perform well at this task because they unroll a classical algorithm into a learnable network, keeping interpretability. Existing versions, though, carry too many parameters and falter under noise.

The proposed network rebuilds robust principal component analysis, which separates a scene into background and sparse targets, with a hierarchical bottleneck that squeezes channel dimensions to cut weight. Infrared small target detection supports surveillance, rescue, and guidance systems where the target may be a few pixels. A detector that runs on modest hardware and survives noisy sensors widens where it can be deployed.

Catalog record

CREATORJingjing Liu, Yinchao Han, Xianchao Xiu, Jianhua Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-08205

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lightweight Deep Unfolding Networks with Enhanced Robustness for Infrared Small Target Detection Thanks: This work was supported in part by the National Natural Science Foundation of China under Grant 62204044 and Grant 12371306, and in part by the State Key Laboratory of Integrated Chips and Systems under Grant SKLICS-K202302. ( Corresponding author: Xianchao Xiu .) Thanks: J. Liu, Y. Han, and J. Zhang are with the Shanghai Key Laboratory of Automobile Intelligent Network Interaction Chip and System, School of Microelectronics, Shanghai University, Shanghai 200444, China (e-mail: {jjliu, ychan, jhzhang}@shu.edu.cn). Thanks: X. Xiu is with the School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China (e-mail: [email protected]). Thanks: W. Liu is with the School of Intelligent Systems Engineering, Sun Yat-sen University, Guangzhou 510275, China (e-mail: [email protected]). Jingjing Liu, Yinchao Han, Xianchao Xiu, Jianhua Zhang Abstract Infrared small target detection (ISTD) is one of the key techniques in image processing. Although deep unfolding networks (DUNs) have demonstrated promising performance in ISTD due to their model interpretability and data adaptability, existing methods still face significant challenges in parameter lightweightness and noise robustness. In this regard, we propose a highly lightweight framework based on robust principal component analysis (RPCA) called L-RPCANet. Technically, a hierarchical bottleneck structure is constructed to reduce and increase the channel dimension in the single-channel input infrared image to achieve channel-wise feature refinement, with bottleneck layers designed in each module to extract features. This reduces the number of channels in feature extraction and improves the lightweightness of network parameters. Furthermore, a noise reduction module is embedded to enhance the robustness against complex noise. In addition, squeeze-and-excitation networks (SENets) are leveraged as a channel attention mechanism to focus on the varying importance of different features across channels, thereby achieving excellent performance while maintaining both lightweightness and robustness. Extensive experiments on the ISTD datasets validate the superiority of our proposed method compared with state-of-the-art methods covering RPCANet, DRPCANet, and RPCANet++. The code will be available at https://github.com/xianchaoxiu/L-RPCANet . I Introduction Unlike traditional visible light imaging techniques, infrared imaging records the thermal radiation naturally emitted by objects and captures ambient information [ 1 , 2 ] . This enables reliable detection of small targets even in scenarios with strong electromagnetic interference and darkness [ 3 ] . Consequently, infrared small target detection (ISTD) has attracted widespread attention, with applications ranging from remote sensing, intelligent transportation, aerospace, and medicine, see [ 4 , 5 , 6 , 7 , 8 ] . As a fundamental image processing task, ISTD faces two major challenges [ 9 , 10 ] . On the one hand, targets in infrared images typically occupy an extremely limited number of pixels and have a relatively low signal-to-noise ratio (SNR), resulting in limited target texture information [ 11 ] . On the other hand, the computing resources of mobile devices are generally limited, making it difficult to meet the requirements of real-time detection systems [ 12 ] . During the past few decades, numerous ISTD methods have been developed, which can be generally divided into three categories: model-based methods [ 13 ] , data-driven methods [ 14 ] , and model-data-driven methods [ 15 ] . Model-based ISTD methods integrate the detection task into a physical model, where targets are represented as compact heat sources embedded in a background with statistical characteristics [ 11 , 16 ] . Due to its simple mathematical formulation, low-rank representation has been broadly used in computer vision and industrial engineering [ 17 , 18 ] . The core idea of low-rank ISTD methods is to characterize the slowly varying but highly correlated background as a low-rank component, and extremely small-sized but energy-isolated targets as sparse components [ 19 ] . Building on this, Gao et al. [ 13 ] proposed a baseline method called the infrared patch image (IPI), which leverages the classic principal component analysis (PCA) to simultaneously separate the low-rank background matrix and the sparse target matrix, thereby extracting target texture information. However, the IPI converts infrared images into two-dimensional matrices, which destroys the natural spatial-spectral neighborhood correlation within the image. Instead of using matrices to characterize the data, Zhang et al. [ 20 ] utilized the low-rank tensor to capture the background and detect targets through a nonconvex method based on the partial sum of the tensor nuclear norm (PSTNN). By applying non-local self-similarities, the above two methods can simultaneously achieve background estimation and target extraction while suppressing large-scale textures and fixed pattern noise [ 3 ] . Different from low-rank methods, Wei et al. [ 21 ] suggested using neighborhood windows of varying sizes to scan pixel by pixel to form a multilayer saliency map, followed by adaptive threshold segmentation to extract infrared small targets. This method, called multiscale patch-based contrast measurement (MPCM), also performs well numerically. Although model-based ISTD methods offer high interpretability, they are often affected by noise and complex background, and involve a large number of hyperparameters when modeling, resulting in poor robustness and generalization [ 22 , 23 , 24 ] . Data-driven ISTD methods achieve promising pixel-level detection accuracy through end-to-end learning with a variety of semantic segmentation networks [ 25 , 26 ] . For example, Zhang et al. [ 27 ] integrated dilated spatial pyramid pooling to ResNet-101 [ 28 ] , then fused low-level details and high-level semantics through convolution and up-sampling. This method is called attention-guided pyramid context networks (AGPCNet), which significantly improves the performance of ISTD compared to IPI and PSTNN. Later, Liu et al. [ 29 ] proposed a simple multiscale head to the plain U-Net [ 30 ] named MSHNet by considering ResNet-50 as the encoder. At the stem layer, the first convolution is replaced with a rotation-equivariant windmill convolution, thus achieving lightweight multiscale semantic segmentation. In addition, Wu et al. [ 14 ] employed a nested structure of U-Net in U-Net to enclose an isomorphic sub-network within the encoding-decoding process, which is abbreviated as UIUNet. This design allows the outer network to preserve global contours, while the inner network focuses on pixel hotspots. However, there are still some practical challenges, such as the computationally intensive fusion phase and the large amount of data required for self-training [ 31 ] . Compared to model-based and data-driven ISTD methods, model-data-driven ISTD methods have the ability to take into account their advantages [ 32 , 33 ] . The design of deep unfolding networks (DUNs) to handle ISTD is a popular direction that bridges the gap between iterative algorithms and neural networks, leveraging mechanistic modeling and network-based solutions [ 34 , 35 , 36 ] . Recently, Wu et al. [ 15 ] treated the ISTD task as a robust PCA (RPCA) problem [ 37 ] , and extended the optimization steps to DUNs. This method is dubbed RPCANet, and enjoys good interpretability. Xiong et al. [ 36 ] proposed a dynamic RPCA network (DRPCANet), which employs a dynamic parameter generation mechanism and a dynamic residual group module to separate sparse targets from the low-rank background to achieve efficient detection of infrared small targets. To further improve detection efficiency and convergence speed, Wu et al. [ 38 ] proposed RPCANet++ based on RPCANet, which incorporates a memory-augmented module to preserve

Read the complete text