Spiking Meets Attention: Efficient Remote Sensing Image Super-Resolution with Attention Spiking Neural Networks
Yi Xiao, Qiangqiang Yuan, Kui Jiang, Wenke Huang, Qiang Zhang, Tingting Zheng, Chia-Wen Lin, Liangpei Zhang · 2025
Read Spiking Meets Attention: Efficient Remote Sensing Image Super-Resolution with Attention Spiking Neural Networks by Yi Xiao, Qiangqiang Yuan, Kui Jiang, Wenke Huang, Qiang Zhang, Tingting Zheng, Chia-Wen Lin, Liangpei Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04223.txt.
Introduction
Yi Xiao and co-authors sharpen satellite photos with spiking neural networks. Their 2025 paper deals with super-resolution for remote sensing, where spiking nets promise low energy yet lag in power. Spikes swing wildly across textures, a sign of active learning the team exploits. Their spiking attention block tunes membrane charge by inferred attention weights, which steers spike traffic for richer features.
The block joins time and channel cues and reads global self-similarity in wide scenes as a prior. The full net, SpikeSR, topped rivals on three benchmarks while staying lean in compute. Code is promised public.
Catalog record
| CREATOR | Yi Xiao, Qiangqiang Yuan, Kui Jiang, Wenke Huang, Qiang Zhang, Tingting Zheng, Chia-Wen Lin, Liangpei Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-04223
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Spiking Meets Attention: Efficient Remote Sensing Image Super-Resolution with Attention Spiking Neural Networks Yi Xiao, Qiangqiang Yuan, Kui Jiang, Wenke Huang, Qiang Zhang, Tingting Zheng, Chia-Wen Lin, Liangpei Zhang Abstract Spiking neural networks (SNNs) are emerging as a promising alternative to traditional artificial neural networks (ANNs), offering biological plausibility and energy efficiency. Despite these merits, SNNs are frequently hampered by limited capacity and insufficient representation power, yet remain underexplored in remote sensing image (RSI) super-resolution (SR) tasks. In this paper, we first observe that spiking signals exhibit drastic intensity variations across diverse textures, highlighting an active learning state of the neurons. This observation motivates us to apply SNNs for efficient SR of RSIs. Inspired by the success of attention mechanisms in representing salient information, we devise the spiking attention block (SAB), a concise yet effective component that optimizes membrane potentials through inferred attention weights, which, in turn, regulates spiking activity for superior feature representation. Our key contributions include: 1) we bridge the independent modulation between temporal and channel dimensions, facilitating joint feature correlation learning, and 2) we access the global self-similar patterns in large-scale remote sensing scenarios to infer spatial attention weights, incorporating effective priors for realistic and faithful reconstruction. Building upon SAB, we proposed SpikeSR, which achieves state-of-the-art performance across various remote sensing benchmarks such as AID, DOTA, and DIOR, while maintaining high computational efficiency. Code of SpikeSR will be available at https://github.com/XY-boy/SpikeSR . Figure 1 : (a) The visualization of pixel intensity and neuron voltage in images under various degradation factors reveals important insights. The pixel intensity map illustrates that the high-frequency components of the image tend to be smooth, indicating a reduction in sharp details during progressive downsampling. Neuron intensity maps, derived from a LIF model [ 37 , 14 ] , show that high-frequency details persist with drastic fluctuations, suggesting that the neurons remain in an active state. (b) FLOPs and PSNR performance comparison. The circle sizes represent the number of parameters. Our SpikeSR outperforms SOTA efficient SR methods with high efficiency. PSNR results are averaged on the AID, DOTA, and DIOR datasets. High-resolution remote sensing images (RSIs) contain fine-grained object structures and textures, which are critical for accurate interpretation in downstream tasks [ 42 , 11 , 6 ] . However, limited by the intrinsic resolution of airborne sensors, RSI can merely capture partial spatial details, resulting in suboptimal scene representation and visual quality. Image super-resolution (SR) aims to alleviate this problem by reconstructing high-resolution (HR) images from low-resolution (LR) observations [ 53 , 60 ] . Despite this, SR remains a challenging ill-posed issue, as a degraded input may correspond to multiple plausible outputs. Early efforts rely on hand-crafted priors to tame the ill-posedness, e.g. , nonlocal mean [ 67 , 7 ] and gradient profile [ 48 ] , but they are often trapped in limited performance and scalability. Recent advances in artificial neural networks (ANNs), e.g. , CNNs and Transformers, have witnessed remarkable progress in SR with large-capacity models [ 49 , 50 , 3 , 4 , 71 ] . However, they often come with a trade-off of increased computational overhead and growing storage costs, making them less efficient in practical scenarios, particularly when reconstructing large-scale RSIs. More recently, brain-inspired spiking neural networks (SNNs), as the third generation of neural networks, have emerged as a promising alternative for energy-efficient intelligence [ 25 , 59 , 40 ] . Different from ANNs that encode features as continuous values, SNNs can emulate biological communication with discrete spiking signals and propagate them by neurons, thus enjoying lower power consumption. As depicted in Fig. 1 (a), our experiments reveal a novel finding that spiking neurons maintain an active learning state across LR RSIs, even in severely damaged textures. Specifically, we observed that degraded RSIs exhibit smoothed pixel intensities and obscured sharp details, posing a significant challenge to characterize high-frequency representations. In contrast, spiking signals retain drastic responses and pronounced spike rates, highlighting that neurons remain in an active learning state. This naturally arises a question: Can SNNs leverage their inherent properties to handle image degradation for efficient yet high-quality RSI SR? In fact, to effectively grasp complex and diverse spatial details in RSIs, the network must possess adequate capacity and representation power. Unfortunately, there are two critical challenges when adapting SNNs for SR tasks. Firstly, spiking activity in SNNs inevitably causes pixel-wise information loss, which hampers the representation capacity of SNNs, especially when the network deepens. This stems from the discrete nature of binary spiking signals, leading to undesirable spiking degradation problems [ 61 , 15 ] . Secondly, SNNs remain constrained by suboptimal membrane potential dynamics, restricting effective exploration of global context during spiking communications. This necessitates a customized strategy to optimize membrane potentials, but is barely explored before. To address these limitations, we propose SpikeSR, an SNN-based framework inspired by human visual attention mechanisms, which can actively represent image degradation and modulate synaptic weights to focus on salient regions, which, in turn, regulate the spiking activity for improved capacity and representation power. Specifically, SpikeSR employs a concise yet effective spiking attention block (SAB) to optimize feature emphasis through spiking response dynamics, which integrates three key innovations: 1) the combination of CNN and SNN layers to mitigate information loss induced by discrete spiking activity; 2) introducing hybrid dimension attention (HDA) to recalibrate spiking response across both temporal and channel dimensions, facilitating a joint feature correlations learning; 3) accessing global self-similarity patterns in RSIs to infer spatial attention weights, incorporating effective priors for realistic and faithful reconstruction. Compared to state-of-the-art (SOTA) ANN-based efficient SR models, our SpikeSR demonstrates lower model complexity and superior performance, as shown in Fig. 1 (b). Our contributions are summarized as follows: • We pioneer an attention spiking neural network for efficient SR of RSIs, providing a new perspective on developing efficient models in large-scale Earth observation scenarios. • We devise a concise yet effective SAB, which mitigates the information loss and regulates membrane potentials of spiking activity for improved representation of SNNs. • Extensive experimental results on various remote sensing datasets demonstrate that our SpikeSR achieves competitive SR performance against SOTA ANN-based methods. 1 Related Work Deep Networks for SR . Inspired by the pioneering SRCNN [ 10 ] , CNN-based SR methods have achieved remarkable progress, dominating the field for years. They mainly elaborated on the network design to tame the ill-posedness, with notable advances in residual connections [ 21 , 32 ] and attention mechanisms [ 69 , 39 ] . However, these methods often suffer from high computational complexity, e.g., exhaustive non-local modeling [ 28 , 38 ] , making them less efficient in large-scale RSIs. Recently, transformer-based SR models have demonstrated impressive performance, benefiting from their ability to model long-range dependencies. IPT [ 2 ] first introduces Transformers in SR field, but requires massive parameters and laborious pre-training processes. SwinIR [ 31 ] effectively reduces the model size by partitioning the image into smaller windows when applying multi-head attention mechanisms, while maintaining favorable performance. Against transformer, Mamba-based SR methods achieve comparable global model capacity with linear complexity [ 18 , 57 , 17 ] . Despite these advancements, advanced SR models are often trapped by rising