Spectral Dynamic Attention Network for Hyperspectral Image Super-Resolution

Tengya Zhang, Feng Gao, Member, IEEE, Lin Qi, Junyu Dong, Member, IEEE, Qian Du, Fellow, IEEE · 2026

Read Spectral Dynamic Attention Network for Hyperspectral Image Super-Resolution by Tengya Zhang, Feng Gao, Member, IEEE, Lin Qi, Junyu Dong, Member, IEEE, Qian Du, Fellow, IEEE (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27326.txt.

Introduction

Zhang, Gao, Qi, Dong, and Du propose SDANet, a Spectral Dynamic Attention Network for hyperspectral image sharpening. It enhances spatial detail of hyperspectral data. Existing deep methods struggle with large spectral overlap and the limited non-linear modeling capacity of standard feed-forward networks. SDANet suppresses redundant spectral interactions on the fly through two components. A Dynamic Channel Sparse Attention module computes channel-wise links and preserves the most useful responses through dynamic thinning. A Frequency-Enhanced Feed-Forward Network jointly models spatial and frequency-domain representations.

Catalog record

CREATORTengya Zhang, Feng Gao, Member, IEEE, Lin Qi, Junyu Dong, Member, IEEE, Qian Du, Fellow, IEEE
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23916
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27326

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Spectral Dynamic Attention Network for Hyperspectral Image Super-Resolution Tengya Zhang, Feng Gao, Member, IEEE, Lin Qi, Junyu Dong, Member, IEEE, Qian Du, Fellow, IEEE Abstract Hyperspectral image super-resolution is essential for enhancing the spatial fidelity of HSI data, yet existing deep learning methods often struggle with substantial spectral redundancy and the limited non-linear modeling capacity of standard feed-forward networks (FFNs). To address these challenges, we propose Spectral Dynamic Attention Network (SDANet), a framework designed to adaptively suppress redundant spectral interactions. SDANet integrates two key components: 1) Dynamic Channel Sparse Attention (DCSA) module that computes channel-wise correlations and selectively preserves the most informative attention responses through dynamic and data-dependent sparsification. 2) Frequency-Enhanced Feed-Forward Network (FE-FFN) that jointly models spatial and frequency-domain representations to enhance non-linear expressiveness. Extensive experiments on two benchmark datasets demonstrate that SDANet achieves state-of-the-art HISR performance while maintaining competitive efficiency. The code will be made publicly available at https://github.com/oucailab/SDANet . I Introduction Hyperspectral images (HSIs) capture hundreds of narrow and contiguous spectral bands, enabling finer-grained material identification than conventional RGB imaging. The rich spectral information in HSIs enables diverse applications in precision agriculture [ 13 ] , environmental monitoring [ 17 ] , and medical imaging [ 14 ] . However, to maintain an acceptable signal-to-noise ratio (SNR), HSI sensors inherently trade spatial resolution for this high spectral detail, resulting in low-resolution images [ 10 ] . The resulting low-resolution measurements hinder the accurate delineation of fine structures and compromise subsequent analytical tasks. As a result, HSI super-resolution (HISR), which seeks to reconstruct high-resolution HSIs from limited-resolution inputs, has attracted increasing research attention [ 18 ] . It has become a pivotal component in enhancing the usability of HSI data for real-world scenarios [ 11 ] . Numerous approaches have been developed for the HISR task, which can be broadly categorized into model-based methods and deep learning–based methods [ 12 ] . The former leverages handcrafted priors, such as sparse representation [ 7 ] and low-rank modeling [ 5 ] . The performance of these methods heavily depends on how well the priors are designed, and they may struggle to generalize to unknown or complex image patterns. Recently, many deep learning-based methods have been designed to leverage the powerful capability of neural networks to model complex relationships within HSI data. In [ 15 ] , a spectral–spatial unmixing fusion module is proposed to integrate into existing 2-D convolutional architectures to improve the HISR performance. Transformer-based architectures, such as MSDFormer [ 2 ] and AS3UNet [ 19 ] , excel at modeling global contextual dependencies via self-attention mechanisms. Furthermore, pioneering works like ESSAformer [ 21 ] elegantly mitigate Transformer bottlenecks by injecting crucial translational and scaling inductive biases to construct robust spatial-spectral representations. Although existing HISR models have achieved promising performance, they suffer from two key limitations: (1) Redundant spectral information introduces noise feature interactions. HSIs inherently contain massive highly correlated spectral bands. As illustrated by low-rank approaches [ 5 ] , excessive redundancy across high-dimensional channels adversely impacts SR performance. In modern Transformers, this inevitably flattens Softmax weights, forcing the network to disperse attention away from critical non-redundant details (see the Supplementary Material for a visual illustration). To mitigate this, recent works explored sparsification. A notable example is DRSformer [ 4 ] , which introduces row-wise sparse Top-K attention, though its spatial routing does not directly target spectral redundancy. To specifically target spectral redundancy, the Cross-Scope Spatial-Spectral Transformer (CST) [ 1 ] sought to reduce the channel number (i.e., C_{r}=C/2 ). However, scene-varying redundancy patterns render fixed-sparsity strategies suboptimal. Addressing this dynamic sparsification challenge, our proposed DCSA module offers an orthogonal and complementary strategy to methods like ESSAformer [ 21 ] . While ESSAformer maximizes the utility of dense spectral correlations to construct robust spatial-spectral representations, our DCSA explicitly identifies and dynamically prunes redundant spectral dependencies to prevent attention dispersion. (2) Standard feed-forward networks (FFNs) offer limited non-linear modeling capacity. Many existing Transformer-like architectures rely on FFN for feature transformation. The conventional FFN follows a simple linear–activation–linear structure, which restricts its ability to capture high-order spectral–spatial correlations. It limits the network’s ability to recover fine-grained details and leads to suboptimal reconstruction performance. Therefore, how to enhance the non-linear transformation is a tough challenge. To address the aforementioned challenges, we present a S pectral D ynamic A ttention Net work ( SDANet ) framework for HISR that integrates a Dynamic Channel Sparse Attention (DCSA) module , and a Frequency-Enhanced FFN (FE-FFN) . First, to mitigate spectral redundancy, we proposed the DCSA module, which computes channel-wise attention and dynamically filter the attention matrix. By leveraging sparsity to preserve only the most informative attention responses while suppressing noisy spectral information, the module effectively reduces spectral redundancy and enhances image restoration quality. Second, to enhance the non-linear modeling capacity, we introduce the FE-FFN to jointly model spatial and frequency domain information. This hybrid spatial–frequency design significantly improves non-linear representation capability, leading to more effective feature modeling for HSI reconstruction. The contributions of our SDANet are threefold: • Model Contribution. We propose the DCSA module to incorporate the dynamic channel sparse attention to the HISR task. This dynamic and data-dependent sparsification significantly reduces redundant spectral correlations while retaining discriminative spectral cues. • Feature Enhancement. We design FE-FFN that jointly modeling spatial and frequency domain information. It significantly improves non-linear feature transformation for HSI reconstruction. • Experimental Contribution. We conduct extensive experiments on two benchmark datasets demonstrating that our SDANet outperforms state-of-the-art methods. Moreover, we will publicly release our codes to facilitate further research in HSI data reconstruction. Fig. 1: The framework of Spectral Dynamic Attention Network (SDANet) for HSI super-resolution. Given a low-resolution HSI input I_{\mathrm{LR}} , the network first extracts shallow spectral–spatial representations through an initial convolution layer. These features are then fed into a series of Spectral Dynamic Attention Blocks (SDABs) to progressively refine spectral–spatial representations. After that, two reconstruction convolutions are applied to refine these features. Finally, a pixel-shuffle upsampling module is used to generate the high-resolution output I_{\mathrm{HR}} . II Methodology II-A Overall Architecture As depicted in Fig. 1 , the proposed SDANet follows a three-stage pipeline: shallow feature extraction, deep feature extraction, and image reconstruction. Given a low-resolution HSI as input I_{\mathrm{LR}} , the network reconstructs a high-resolution counterpart I_{\mathrm{HR}} . First, an initial 3\times 3 convolution performs shallow feature extraction. Next, the shallow features are then fed into a series of Spectral Dynamic Attention Blocks (SDABs) for deep feature extraction. The SDAB is the core of our network, and consists of two key components: (1) Dynamic Channel Sparse Attention (DCSA) module that performs dynamic channel-wise attention to suppress redundancy and highlight salient spectral responses. (2) Frequency-Enhanced Feed-Forward Network (FE-FFN) that enhances non-linear transformation capacity through frequency-domain feature modulation. Residual connections and layer normalization operations are employed before each module to stabilize training and preserve spectral fidelity. Multiple SDABs are cascaded to progressively refine spectral–spatial representations, while long skip connections bypass the deep blocks to maintain global consistency and prevent information degradation. After that, two reconstruction convolutions are applied to refine these features. Finally, a pixel-shuffle upsampling module is used to generate the high-resolution output I_{\mathrm{HR}} . Overall, SDANet integrates dynamic spectral attention, frequency-enhanced non-linear modeling, and efficient

Read the complete text