STAR-Net: An Interpretable Model-Aided Network for Remote Sensing Image Denoising
Jingjing Liu, Jiashun Jin, Xianchao Xiu, Jianhua Zhang, Wanquan Liu · 2025
Read STAR-Net: An Interpretable Model-Aided Network for Remote Sensing Image Denoising by Jingjing Liu, Jiashun Jin, Xianchao Xiu, Jianhua Zhang, Wanquan Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24327.txt.
Introduction
Liu and four co-authors present STAR-Net, a model-aided network for cleaning remote sensing images, in a 2025 paper. Most deep learning denoisers act as black boxes with little physical grounding. Classic iterative methods need tedious tuning and may miss non-local patterns in images.
STAR-Net uses a low-rank prior to capture repeated structure across an image. It is built as a deep unrolling network guided by a classic optimization method, so tuning values are learned on their own. A sparse variant handles non-Gaussian noise for extra robustness. Tests on synthetic and real data beat leading methods. The design aims to keep results interpretable while gaining learning-based strength.
Catalog record
| CREATOR | Jingjing Liu, Jiashun Jin, Xianchao Xiu, Jianhua Zhang, Wanquan Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-24327
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
STAR-Net: An Interpretable Model-Aided Network for Remote Sensing Image Denoising Jingjing Liu, Jiashun Jin, Xianchao Xiu, Jianhua Zhang, Wanquan Liu Abstract Remote sensing image (RSI) denoising is an important topic in the field of remote sensing. Despite the impressive denoising performance of RSI denoising methods, most current deep learning-based approaches function as black boxes and lack integration with physical information models, leading to limited interpretability. Additionally, many methods may struggle with insufficient attention to non-local self-similarity in RSI and require tedious tuning of regularization parameters to achieve optimal performance, particularly in conventional iterative optimization approaches. In this paper, we first propose a novel RSI denoising method named sparse tensor-aided representation network (STAR-Net), which leverages a low-rank prior to effectively capture the non-local self-similarity within RSI. Furthermore, we extend STAR-Net to a sparse variant called STAR-Net-S to deal with the interference caused by non-Gaussian noise in original RSI for the purpose of improving robustness. Different from conventional iterative optimization, we develop an alternating direction method of multipliers (ADMM)-guided deep unrolling network, in which all regularization parameters can be automatically learned, thus inheriting the advantages of both model-based and deep learning-based approaches and successfully addressing the above-mentioned shortcomings. Comprehensive experiments on synthetic and real-world datasets demonstrate that STAR-Net and STAR-Net-S outperform state-of-the-art RSI denoising methods. The code will be available at https://github.com/Jason011212/STAR-Net . Journal: Pattern Recognition 1 Introduction With the rapid development of remote sensing technology, remote sensing image (RSI) has found extensive applications in anomaly detection [ 1 ] , denoising [ 2 ] , classification [ 3 ] , and unmixing [ 4 ] . By capturing detailed spectral information, RSI enables precise analysis of ground features. Nevertheless, during the acquisition process, RSI is inevitably affected by noise, which significantly impacts subsequent data analysis. Therefore, recovering clean RSI from noisy ones has become a critical challenge. Gernerally speaking, the existing RSI denoising methods can be categorized into two primary groups: model-based and deep learning-based. Model-based methods, whose core is to create a connection between clean and noisy RSI through physical priors related to natural statistics or image formation for denoising [ 5 ] . A widely used method is block matching 3D (BM3D) [ 6 ] , which exploits the similarity between non-local blocks to achieve the purpose of denoising. To consider the information across bands, Maggioni et al. [ 7 ] proposed a 4D collaborative filtering paradigm for volumetric data denoising called block matching 4D (BM4D). Another successful method is low-rank matrix factorization [ 8 ] . Zhang et al. [ 9 ] was the first to introduce it to the field of RSI denoising. After that, Xu et al. [ 10 ] constructed robust principal component analysis with it to accelerate the iterative optimization process. Nevertheless, matrix factorization-based methods require 3D RSI to be converted into 2D data first, which may result in some loss of image information. Since RSI is essentially 3D image, leveraging tensor representation is very suitable for RSI denoising. In recent years, there has been considerable advancement in low-rank tensor factorization. For example, Chang et al. [ 11 ] proposed a hyper-Laplacian regularized unidirectional low-rank tensor recovery (LLRT) method and showed its advantages over matrix-based models. Wang et al. [ 12 ] incorporated the total variation prior into low-rank tensor decomposition (LRTDTV), thus achieving excellent RSI denoising performance. Recently, He et al. [ 13 ] introduced non-local self-similarity and developed a promising denoiser named non-local meets global (NGMeet), which can fully exploit both global and local geometric structures. Zha et al. [ 14 ] introduced a nonlocal structured sparsity regularization (NLSSR) method, which simultaneously exploits global spectral characteristics and nonlocal structured sparsity priors to improve the denoising of RSI. It is worth noting that although the above model-based methods provide strong interpretability and theoretical guarantees, they often require tedious tuning of regularization parameters to achieve optimal performance. Deep learning-based methods, which can dynamically adjust the trainable parameters based on external data and labels, have received extensive attention in RSI denoising [ 15 ] . For instance, Yuan et al. [ 16 ] developed a spatial-spectral convolutional neural network (CNN) that exploits the nonlinear relationship between noisy and clean RSI. Wei et al. [ 17 ] developed a 3D quasi-recurrent neural network by employing 3D convolution to simultaneously extract RSI features. Maffei et al. [ 18 ] enhanced denoising efficiency by introducing a reversible downsampling operator and utilizing a noise level map to flexibly handle different levels of noise. This method is abbreviated as hyperspectral image (HSI) single denoising CNN (HSI-SDeCNN). Zhuang et al. [ 19 ] decomposed remote sensing image features and combined them with CNN to improve RSI denoising performance. In fact, when there is enough training data, deep learning-based methods often outperform model-based ones. However, since neural networks are black boxes, deep learning-based methods have poor interpretability, which makes it difficult to understand the underlying denoising mechanism. Recently, researchers have tried to combine the advantages of deep learning with the high interpretability of model-based methods, and some excellent works have emerged [ 20 ] . Zhuang et al. [ 21 ] integrated a deep learning network named fast and flexible denoising network (FFDNet) [ 22 ] into the subspace representation framework and proposed a fast and parameter free HSI mixed noise removal method (FastHyMix). Xiong et al. [ 23 ] extended the low-rank matrix model with spatial deep priors for RSI denoising. To handle multidimensional structures, Xiong et al. [ 24 ] constructed a subspace-based multidimensional sparse tensor model and then unrolled it into a neural network (SMDS-Net). The non-local self-similarity prior captures the repetitive patterns of textures and structures across distant regions within an image, enabling effective preservation of edges and fine details. Unfortunately, SMDS-Net overlooks the non-local self-similarity of RSI. Very recently, Peng et al. [ 25 ] suggested a framework based on the representative coefficient image (RCI) with spectral low-rank tensor decomposition (RCILD). However, in terms of interpretability, this method retrains denoising CNN (DnCNN) [ 26 ] as the RCI denoiser within the iterative optimization process. The above methods either fail to fully unroll the iterative process of the entire physical model into the network or overlook non-local self-similarity, which may result in inaccurate learned geometric structures. Therefore, a natural question arises whether it is possible to propose a novel end-to-end network that can address “lack of non-local self-similarity, sensitivity to parameter tuning, and interpretability of neural networks"? Figure 1 : Illustration of the proposed STAR-Net and STAR-Net-S with K stages. The denoised RSI is obtained through K iterations after the noisy RSI is fed into the network. STAR-Net and STAR-Net-S employ the ADMM framework, unrolling each iteration into a network structure. Inspired by the above observations, this paper first introduces a low-rank prior to characterize the non-local self-similarity, which is often ignored in the literature. Meanwhile, matrix-based methods reshape the data from 3D to 2D, which often disrupts the inherent structural self-similarity of the original RSI [ 27 ] . Unlike matrix representation, tensor representation can fully exploit prior knowledge and more effectively preserve the complete spatial-spectral structure of RSI, thereby better capturing the inherent non-local self-similarity. Therefore, a tensor representation model is established to improve the interpretability.