Not All Degradations Are Equal: A Targeted Feature Denoising Framework for Generalizable Image Super-Resolution
Hongjun Wang, Jiyuan Chen, Zhengwei Yin, Xuan Song, Yinqiang Zheng · 2025
Read Not All Degradations Are Equal: A Targeted Feature Denoising Framework for Generalizable Image Super-Resolution by Hongjun Wang, Jiyuan Chen, Zhengwei Yin, Xuan Song, Yinqiang Zheng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14841.txt.
Introduction
Hongjun Wang and four co-authors present a targeted denoising framework for image super-resolution in a 2025 computer vision paper. Super-resolution models must sharpen images degraded in unknown ways, and they tend to overfit the degradation instead of the content. Earlier fixes assumed overfitting happens for every degradation type equally.
Careful experiments show the models mostly overfit noise, whose pattern differs sharply from blur or compression artifacts. The proposed framework therefore adds a noise detection module and a denoising module focused on that specific weakness. It plugs into existing super-resolution models without changing their architecture. Tests show stronger performance than earlier regularization methods across unknown degradations. The finding reframes a general problem as a specific, treatable one.
Catalog record
| CREATOR | Hongjun Wang, Jiyuan Chen, Zhengwei Yin, Xuan Song, Yinqiang Zheng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-14841
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Not All Degradations Are Equal: A Targeted Feature Denoising Framework for Generalizable Image Super-Resolution Hongjun Wang, Jiyuan Chen, Zhengwei Yin, Xuan Song, Yinqiang Zheng Abstract Generalizable Image Super-Resolution aims to enhance model generalization capabilities under unknown degradations. To achieve such goal, the models are expected to focus only on image content-related features instead of overfitting degradations. Recently, numerous approaches such as Dropout [ 17 ] and Feature Alignment [ 29 ] have been proposed to suppress models’ natural tendency to overfitting degradations and yields promising results. Nevertheless, these works have assumed that models overfit to all degradation types (e.g., blur, noise, JPEG), while through careful investigations in this paper, we discover that models predominantly overfit to noise, largely attributable to its distinct degradation pattern compared to other degradation types. In this paper, we propose a targeted feature denoising framework, comprising noise detection and denoising modules. Our approach presents a general solution that can be seamlessly integrated with existing super-resolution models without requiring architectural modifications. Our framework demonstrates superior performance compared to previous regularization-based methods across five traditional benchmark and datasets, encompassing both synthetic and real-world scenarios. 1 Introduction Image Super-Resolution (SR) has achieved remarkable progress in recent years, largely driven by the rapid evolution of deep learning techniques [ 11 , 30 , 16 , 23 ] . However, despite these advancements, deploying SR models in practical real-world applications remains highly challenging, which stems primarily from a persistent domain gap between synthetic training pipelines and the complex, diverse degradations encountered in real-world imagery. Figure 1 : Visualization of different degradation types, including input images (top), their Fourier spectra of residual images (middle), and SRResNet feature maps (bottom). Noise (first columns) shows distinct characteristics compared to others. Conventional SR models are typically trained on synthetic low-resolution (LR) images, which are generated using predefined degradations (e.g., bicubic downsampling) [ 39 , 28 ] . This simplified degradation process, while computationally convenient, is fundamentally misaligned with the intricate degradation patterns observed in real photographs. This misalignment arises from three key factors: (1) Real-world paired LR-HR data collection is non-trivial, requiring precisely aligned captures across different camera systems, lighting conditions, and imaging pipelines [ 6 , 42 ] ; (2) Real-world degradations involve complex interactions between sensor noise, optical aberrations, compression artifacts, and environmental factors, which are difficult to fully characterize using simple analytical models [ 24 , 40 ] ; and (3) Existing real-world SR datasets often have limited coverage, capturing only a narrow subset of real degradations, thus lacking the diversity needed for robust generalization [ 5 , 33 ] . (a) (b) Figure 2 : Frequency-domain analysis of image degradation showing average magnitude differences across normalized frequencies for DIV2K training set (a) and BSD100 test set (b). The distinctive spectral characteristics of noise degradation contribute to model overfitting issues. To bridge this gap, recent works have introduced more realistic, high-order degradation modeling pipelines [ 31 , 40 , 41 ] , designed to synthesize complex degradation mixtures that better mimic real-world scenarios by mixing several basic degradations, like blur, noise, JPEG. While these efforts represent significant progress, Kong et al. 2022 observed that even with improved degradation modeling, existing SR models still tend to overfit to specific degradation patterns, ultimately limiting their generalization potential. In response, regularization-based strategies such as dropout [ 17 ] and feature alignment [ 29 ] have been proposed to mitigate degradation overfitting. However, these methods often implicitly assume uniform overfitting across all degradation types, applying generic regularization regardless of the degradation source (e.g., blur, noise, or compression artifacts). Such uniform treatment overlooks the degradation-specific characteristics that drive overfitting. In particular, through detailed analysis, we uncover a critical observation: noise degradations exhibit uniquely disruptive behaviors that make them the dominant factor contributing to overfitting . To systematically analyze degradation impacts, we decompose high-order degradations [ 31 ] into individual components and examine their isolated effects on model performance. As shown in Figure 1 , noise exhibits random, unstructured spatial patterns, unlike the localized or texture-aware degradations (e.g., blur, JPEG). This irregularity propagates into the feature space, corrupting structural consistency far more severely than other degradations. In Figure 2 , noise further amplifies mid-to-high frequency magnitudes [ 10 ] , while other degradations follow smoother spectral decay. But, in low-frequency regions, due to the contamination of various degradations, it more challenging to overfit to specific degradation. This discrepancy makes noise prone to overfitting, severely impairing the model’s ability to learn reliable content features. Analysis of SRResNet’s internal feature maps (Figure 3 ) reveals that conventional regularization techniques inadequately suppress noise, resulting in persistent artifacts. While the baseline SRResNet exhibits significant noise amplification, established strategies like dropout and feature alignment offer only marginal improvement. This highlights a critical limitation: conventional regularization fails to effectively disentangle noise from content features, ultimately compromising both image fidelity and robustness. To explicitly address this issue, we propose a targeted feature denoising (TFD) framework, which directly tackles noise-induced overfitting in SR models. Instead of applying uniform constraints across all features, it dynamically detects noise-corrupted features and applies adaptive denoising, preserving content-related structures while suppressing noise artifacts. Our design is: 1) noise-aware : unlike generic regularization, TFD on noise—the primary source of overfitting—and applies degradation-specific treatment. 2) model-agnostic : feature denoising framework is a plug-and-play module compatible with diverse SR architectures [ 18 , 8 ] . 3) lightweight : The selective denoising mechanism introduces minimal computational overhead. Comprehensive experiments on ten synthetic and real-world benchmarks demonstrate that TFD consistently enhances generalization across diverse degradation scenarios, significantly outperforming state-of-the-art regularization techniques. (a) (b) (c) (d) Figure 3 : Visualization of feature representations across different methods. The baseline model (a) shows significant noise corruption. While dropout [ 17 ] and feature alignment [ 29 ] reduce noise to some extent, they both retain noticeable artifacts. Our denoising approach effectively preserves structural details while thoroughly suppressing noise artifacts. 2 Related Work Single Image Super-Resolution. Deep learning has revolutionized single image super-resolution, beginning with SRCNN’s pioneering CNN application [ 11 ] . Subsequent architectural innovations—including residual learning [ 16 ] , dense connectivity [ 44 ] , and attention mechanisms [ 43 ] —have progressively improved reconstruction quality. However, these methods primarily excel on synthetic benchmarks with well-defined degradation models, limiting their real-world applicability. Blind super-resolution has emerged to address this limitation by enhancing images without prior knowledge of degradation processes. Recent approaches pursue two complementary strategies: (1) Practical degradation modeling , where Zhang et al. [ 40 ] proposed comprehensive degradation pipelines, Wang et al. [ 31 ] introduced Real-ESRGAN with carefully designed training data synthesis, and Liang et al. [ 22 ] developed degradation-adaptive networks with improved computational efficiency. (2) Explicit degradation estimation , exemplified by the IKC framework’s iterative kernel refinement [ 14 ] , Zheng et al.’s unfolded deep learning approach with domain adaptation [ 45 ] , and Bell-Kligler et al.’s GAN-based kernel estimation for unknown degradations [ 2 ] . Generalizable Image Super-Resolution. Achieving robust generalization across diverse degradation conditions remains a fundamental challenge in SISR. Recent advances have explored complementary strategies to address this issue. Component-based approaches include Wei et al.’s degradation-specific subcomponent decomposition [ 32 ] and Li et al.’s