SAAT: Synergistic Alternating Aggregation Transformer for Image Super-Resolution
Jianfeng Wu, Nannan XU · 2025
Read SAAT: Synergistic Alternating Aggregation Transformer for Image Super-Resolution by Jianfeng Wu, Nannan XU (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-03740.txt.
Introduction
Sharpening a blurry photo into a clear one is a standard task for image models, and transformer designs lead the field. Jianfeng Wu and Nannan Xu present a new design, SAAT, in this 2025 paper. They note that most designs attend within small windows and ignore two rich signals: links across color channels and the spatial structure that forms mid-computation.
SAAT alternates two grouped forms of attention that mix channel and space information with the window scheme. One group fuses channel attention with shifted windows for broader feature blending. The other leans on spatial attention to capture structure. In broad tests and ablations, SAAT matched the best rival models at the same size, which the authors credit to the synergy between the two attention kinds.
Catalog record
| CREATOR | Jianfeng Wu, Nannan XU |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-03740
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SAAT: Synergistic Alternating Aggregation Transformer for Image Super-Resolution Jianfeng Wu, Nannan XU Abstract Single image super-resolution is a well-known downstream task which aims to restore low-resolution images into high-resolution images. At present, models based on Transformers have shone brightly in the field of super-resolution due to their ability to capture long-term dependencies in information. However, current methods typically compute self-attention in nonoverlapping windows to save computational costs, and the standard self-attention computation only focuses on its results, thereby neglecting the useful information across channels and the rich spatial structural information generated in the intermediate process. Channel attention and spatial attention have, respectively, brought significant improvements to various downstream visual tasks in terms of extracting feature dependency and spatial structure relationships, but the synergistic relationship between channel and spatial attention has not been fully explored yet.To address these issues, we propose a novel model. Synergistic Alternating Aggregation Transformer (SAAT), which can better utilize the potential information of features. In SAAT, we introduce the Efficient Channel & Window Synergistic Attention Group (CWSAG) and the Spatial & Window Synergistic Attention Group (SWSAG). On the one hand, CWSAG combines efficient channel attention with shifted window attention, enhancing non-local feature fusion, and producing more visually appealing results. On the other hand, SWSAG leverages spatial attention to capture rich structured feature information, thereby enabling SAAT to more effectively extract structural features.Extensive experimental results and ablation studies demonstrate the effectiveness of SAAT in the field of super-resolution. SAAT achieves performance comparable to that of the state-of-the-art (SOTA) under the same quantity of parameters. keywords image super-resolution ,Transformer,Multi-scale Spatial Attention ,Efficient Channel Attention † † corresponding: Corresponding author 1 Introduction Single image super-resolution involves reconstructing high-resolution images from low-resolution inputs. It has become a popular research area in the fields of computer vision and image restoration and has been widely applied across various domains [ 1 , 2 ] , such as medical image super-resolution [ 3 , 4 ] , surveillance equipment [ 5 ] , and satellite remote sensing [ 6 ] . Despite extensive research and applications, super-resolution models are still striving to obtain richer feature information.In the early days of 2014, the development of deep neural networks (DNNs) marked a turning point. Due to their superior performance compared to traditional methods, convolutional neural networks (CNNs) have dominated the field of super-resolution. As a result, numerous CNN-based image super-resolution techniques have been proposed [ 7 , 8 , 9 , 10 ] . However, due to the local processing principle of CNNs, deep neural networks are still limited in their ability to perceive global context. In recent years, following the success of natural language processing, Transformers [ 11 ] have garnered attention in the computer vision community. Owing to the long-range dependency modeling capability of the self-attention mechanism in Transformers and their multi-scale processing advantages, Transformer-based methods have rapidly gained popularity in downstream tasks, including super-resolution. Many works have validated the effectiveness of Transformer-based approaches, such as SwinIR [ 12 ] , SRFormer [ 13 ] , ESRT [ 14 ] , and HAT [ 15 ] . Despite the success of Transformer-based methods in the field of super-resolution, there are still several areas that need improvement. SwinIR [ 12 ] introduced window attention, which restricts attention computation within fixed windows. This approach clearly results in a limited receptive field and an inability to fully utilize all the pixel information of the original image. SRFormer [ 13 ] proposed a new image super-resolution permutation self-attention method, enlarging the window to obtain more information. However, the channel compression also leads to the loss of spatial information. ESRT [ 14 ] presented a novel efficient super-resolution network for single-image super-resolution, which extracts deep features using a lightweight CNN backbone and models long-range dependencies between similar local regions in the image using a Transformer backbone. However, such feature extraction lacks flexibility and adaptability. HAT [ 15 ] designed a new overlapping cross-attention to enhance information interaction between adjacent local windows. HAT’s method of using channel attention and shifted window self-attention to obtain long-range pixel associations depends on the increase in network depth, which also increases the difficulty of model training. As a result, when it comes to capturing local (high-frequency) information, such as edges and textures, which are finer details crucial for the global information of SR tasks, their effectiveness diminishes. The scope of global pixel dependency also needs to be further expanded. In other words, current super-resolution reconstruction networks need to simultaneously improve their ability to capture edge features and high-frequency information. To address the aforementioned issues and further enhance the extraction of edge features and high-frequency information in images, we propose a novel super-resolution reconstruction network, SAAT, in this paper. It incorporates CNN-based efficient channel attention, window-based attention, and spatial attention mechanisms. In SAAT, we introduce a CNN-based lightweight module, the efficient channel attention module, which we combine with window attention (ECWAG). This allows us to leverage the global information perception capability of channel attention to compensate for the shortcomings of self-attention while keeping the parameter count low. Meanwhile, we employ spatial structural attention, using multi-scale, depth-shared 1D convolutions to capture multi-scale spatial information in each feature channel. This effectively integrates global context dependencies and multi-scale spatial priors while synergizing with window attention. We alternate between ECWAG and SWAG to enhance information interaction between adjacent local windows. Additionally, we utilize ConvFFN, adding a local depthwise convolution branch between the two linear layers of the FFN block to help encode more details. Through the aforementioned model design, SAAT is able to surpass the state-of-the-art (SOTA). In summary, our contributions are as follows: \bullet We propose the Synergistic Alternating Aggregation Transformer (SAAT) for image super-resolution. SAAT aims to explore the synergistic effects between spatial attention and channel attention, enabling the capture of global channel information and spatial structural information. Our SAAT achieves significant super-resolution performance in terms of both parameter count and visual quality. \bullet We introduce the Spatial & Window Synergistic Attention Group (SWSAG), which obtains rich spatially structured feature information and effectively integrates global contextual dependencies and multi-scale spatial priors. \bullet We propose the Efficient Channel & Window Synergistic Attention Group (CWSAG), which synergizes with window-based attention and alternates with SWSAG. This achieves a balance between parameter count and computational complexity while obtaining global feature information. 2 Related Works 2.1 CNN Based Super-Resolution Over the past period, compared with traditional super-resolution methods, CNNs have made significant progress in the field of super-resolution based on their powerful ability to extract spatial features. As a pioneer, SRCNN [ 16 ] used a three-layer convolutional network to fit a nonlinear mapping, reconstructing low-resolution images into high-resolution ones. FSRCNN [ 17 ] proposed a compact hourglass-shaped CNN structure to achieve faster and better image super-resolution reconstruction. ESPCN [ 18 ] introduced sub-pixel convolution, presenting an efficient method to directly extract features on the size of low-resolution images and compute high-resolution images. However, when increasing the number of CNN layers to extract more complex features, a sharp decline in performance was observed. EDSR [ 19 ] and RDN [ 20 ] are SR structures based on residual networks, which addressed this issue through residual connections. SRGAN proposed using generative adversarial networks