Dual-domain Adaptation Networks for Realistic Image Super-resolution
Chaowei Fang, Bolin Fu, De Cheng, Lechao Cheng, Guanbin Li · 2025
Read Dual-domain Adaptation Networks for Realistic Image Super-resolution by Chaowei Fang, Bolin Fu, De Cheng, Lechao Cheng, Guanbin Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17217.txt.
Introduction
Chaowei Fang and four co-authors address realistic image super-resolution: enlarging real low-resolution photographs, whose blur and noise follow messy real-world patterns rather than tidy synthetic ones. Models trained on synthetic data know a lot, but real paired training data is scarce. Their Dual-domain Adaptation Networks transfer a pretrained model from the simulated world to real data efficiently, instead of starting over.
One branch adapts in the spatial domain, updating selected parameters and using low-rank adjustments for the rest. A second branch works in the frequency domain, since recovering detail means restoring high frequencies, and merges spectral information with the backbone's features to predict the missing frequency map. On three public realistic benchmarks, including RealSR, the method beat the state of the art. Code is publicly available.
Catalog record
| CREATOR | Chaowei Fang, Bolin Fu, De Cheng, Lechao Cheng, Guanbin Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-17217
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dual-domain Adaptation Networks for Realistic Image Super-resolution Chaowei Fang, Bolin Fu, De Cheng, Lechao Cheng, Guanbin Li Abstract Realistic image super-resolution (SR) focuses on transforming real-world low-resolution (LR) images into high-resolution (HR) ones, handling more complex degradation patterns than synthetic SR tasks. This is critical for applications like surveillance, medical imaging, and consumer electronics. However, current methods struggle with limited real-world LR-HR data, impacting the learning of basic image features. Pre-trained SR models from large-scale synthetic datasets offer valuable prior knowledge, which can improve generalization, speed up training, and reduce the need for extensive real-world data in realistic SR tasks. In this paper, we introduce a novel approach, Dual-domain Adaptation Networks , which is able to efficiently adapt pre-trained image SR models from simulated to real-world datasets. To achieve this target, we first set up a spatial-domain adaptation strategy through selectively updating parameters of pre-trained models and employing the low-rank adaptation technique to adjust frozen parameters. Recognizing that image super-resolution involves recovering high-frequency components, we further integrate a frequency domain adaptation branch into the adapted model, which combines the spectral data of the input and the spatial-domain backbone’s intermediate features to infer HR frequency maps, enhancing the SR result. Experimental evaluations on public realistic image SR benchmarks, including RealSR, D2CRealSR, and DRealSR, demonstrate the superiority of our proposed method over existing state-of-the-art models. Codes are available at: https://github.com/dummerchen/DAN . I Introduction Fig. 1: Our dual-domain adaptation method aims to adapt pre-trained image super-resolution (SR) models from simulated to realistic datasets. The first and third rows show SR enhancements, and the second and fourth rows highlight improved high-frequency components. The second column presents the pre-trained DAT model outcomes [ 7 ] . The third and fourth columns demonstrate visual and structural improvements achieved with our spatial and dual-domain adaptation strategies, respectively. Realistic image super-resolution (SR) aims to transform low-resolution (LR) inputs from the real world to high-resolution (HR) images. In contrast to traditional super-resolution [ 11 , 60 , 4 ] , which often deals with clean and synthetic datasets, realistic image SR focuses on handling real-world degradation patterns, making it much more applicable to actual applications. It focuses on enhancing overall image quality, recovering finer details and textures in a natural and perceptually appealing manner. This is important for improving user experiences in electronic devices such as TVs and smartphone photographs. It also has huge significance in applications such as security and surveillance, medical imaging, and forensic analysis, where improving image quality can lead to better decision-making, diagnosis, or analysis. Hence, this paper focuses on efficiently learning neural network-based models for addressing the realistic image SR task. Recent methods [ 58 , 51 ] are dedicated to improving the robustness of SR models by simulating the image degradation process to generate LR images from their HR counterparts. However, the real image degradation process remains more complex than these simulations. An emerging solution lies in harnessing directly captured LR-HR image pairs with diverse camera configurations [ 2 , 1 , 53 , 34 ] . The pioneering works [ 1 , 53 , 34 ] introduce methods focusing on leveraging adjacent information, improving the reconstruction of textural nuances, and modeling disparate high-frequency distributions. Considering image SR models pre-trained on large-scale simulated datasets are exposed to abundant images, they are advantageous at capturing these basic features. Intuitively, such prior knowledge of pre-trained image SR models can be used for improving the generalization ability, accelerating the training process, and relieving the burden of training data collection quality when coping with the realistic image SR task. To address the challenges of realistic image SR, we propose a novel Dual-domain Adaptation Network (DAN) that efficiently adapts pre-trained SR models on simulated datasets to realistic scenarios. Our approach introduces two key innovations: a spatial-domain adaptation strategy and a frequency-domain adaptation branch , designed to synergistically enhance SR performance. Image SR models pre-trained on simulated datasets excel in extracting fundamental features, but their direct application to realistic datasets is suboptimal due to domain-specific variations. To bridge this gap, our spatial-domain adaptation strategy refines the pre-trained model by selectively freezing intermediate module parameters while updating others. This selective freezing strategy achieves an optimal balance between performance and retraining efficiency, outperforming the traditional approach of freezing only shallow modules. Additionally, we incorporate low-rank adaptation (LoRA) [ 20 ] to fine-tune static parameters with minimal computational overhead. These techniques enable effecctive and efficient adaptation of pre-trained SR models to realistic datasets. Fig. 1 provides two examples for illustrating the effect of our proposed method in adapting a pre-trained image SR model, DAT [ 7 ] . As shown by the third column of Fig. 1 , the above spatial-domain adaptation strategy can significantly improve the SR results of the pre-trained DAT, while minimal extra trainable parameters are introduced. High-frequency detail restoration is critical for high-quality SR but is inadequately addressed by spatial-domain techniques alone. This may lead to memorizing pixel values without explicitly capturing intricate high-frequency textural features. Previous researches [ 15 , 48 , 40 ] underscore the potential for image restoration based on the frequency domain, which exhibits advantages in recovering intricate high-frequency details compared to techniques based solely on the spatial domain. Exploiting this insight, we incorporate a frequency-domain adaptation branch into our model. Unlike existing frequency domain methodologies [ 48 , 40 ] , our approach merges the Fourier transform coefficients of the input images and intermediate features produced by the spatial-domain backbone model to infer HR frequency domain images. Subsequently, transforming these images to the spatial domain yields the final prediction. As illustrated by the fourth column of Fig. 1 , the above frequency-domain adaptation branch helps enhance the SR results by generating more accurate and clear high-frequency components. Comprehensive evaluations of public realistic image SR benchmarks, including RealSR [ 1 ] , D2CRealSR [ 34 ] , and DRealSR [ 53 ] , confirm the superior performances of our method over existing state-of-the-art realistic image SR solutions. Our main contributions are summarized as follows: • We introduce a dual-domain adaptation networks that is able to seamlessly transfer models from simulated to real-world image SR datasets. • We devise a frequency-domain adaptation branch which can be flexibly integrated with existing spatial-domain backbone models, enhancing the restoration of high-frequency components. • Through extensive benchmark testing on public realistic image SR datasets, our method establishes a new state-of-the-art in SR performances. II Related Work II-A Realistic Image Super-resolution Image super-resolution, which seeks to increase the spatial resolution of images, attracts significant attention. Dong et al. [ 11 ] pioneer the introduction of the first deep neural networks (DNN) for the image SR task. With advances in DNN architectures, piles of models [ 44 , 25 , 27 , 37 , 59 , 12 , 62 , 42 , 41 , 13 , 4 , 10 , 32 , 7 , 61 , 38 , 43 , 39 ] are proposed with the aim of improving the performance of image SR. To enhance the reality of image SR results, Ledig et al. [ 28 ] advocate for regularizing the VGG [ 45 ] feature distance and incorporating the generative adversarial learning loss [ 16 ] for constraining the