Degradation-Aware and Structure-Preserving Diffusion for Real-World Image Super-Resolution
Yang Ji, Zonghao Chen, Zhihao Xue, Junqin Hu · 2026
Read Degradation-Aware and Structure-Preserving Diffusion for Real-World Image Super-Resolution by Yang Ji, Zonghao Chen, Zhihao Xue, Junqin Hu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11470.txt.
Introduction
Ji and three colleagues improve super-resolution with a degradation-aware diffusion framework. One module encodes degradation statistics from low-resolution input and fuses them with semantic features. A second module modulates diffusion noise by local edge strength to preserve structural regions. Both are light add-ons needing only minor changes. Tests on DIV2K and RealSR show competitive perceptual quality and more realistic results than baselines, with a favorable quality trade-off. In short, the model knows what damage to undo and where edges must stay sharp.
Catalog record
| CREATOR | Yang Ji, Zonghao Chen, Zhihao Xue, Junqin Hu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33499 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.11470
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Degradation-Aware and Structure-Preserving Diffusion for Real-World Image Super-Resolution Yang Ji, Zonghao Chen, Zhihao Xue, Junqin Hu Abstract Real-world image super-resolution is particularly challenging for diffusion models because real degradations are complex, heterogeneous, and rarely modeled explicitly. We propose a degradation-aware and structure-preserving diffusion framework for real-world SR. Specifically, we introduce Degradation-aware Token Injection, which encodes lightweight degradation statistics from low-resolution inputs and fuses them with semantic conditioning features, enabling explicit degradation-aware restoration. We further propose Spatially Asymmetric Noise Injection, which modulates diffusion noise with local edge strength to better preserve structural regions during training. Both modules are lightweight add-ons to the adopted diffusion SR framework, requiring only minor modifications to the conditioning pipeline. Experiments on DIV2K and RealSR show that our method delivers competitive no-reference perceptual quality and visually more realistic restoration results than recent baselines, while maintaining a favorable perception–distortion trade-off. Ablations confirm the effectiveness of each module and their complementary gains when combined. The code and model are publicly available at https://github.com/jiyang0315/DASP-SR . 1 Introduction Single image super-resolution (SISR) is a fundamental challenge in computer vision, aiming to reconstruct a high-resolution (HR) image from its low-resolution (LR) counterpart. While traditional learning-based methods driven by pixel-wise regression achieve high PSNR 8 ; 13 ; 19 , they often suffer from regression-to-the-mean, resulting in over-smoothed textures that lack perceptual realism 14 ; 5 . Recently, diffusion probabilistic models have emerged as a powerful paradigm for generative modeling 10 ; 24 , demonstrating an exceptional ability to synthesize high-frequency details for image super-resolution 26 . However, transitioning diffusion models to real-world SR remains non-trivial. Unlike classical benchmarks that assume a fixed bicubic downsampling, real-world images are plagued by complex, unknown, and spatially varying degradations, including blur, noise, and compression artifacts, which pose significant hurdles for robust restoration 40 ; 30 ; 1 . Existing diffusion-based SR methods typically condition the denoising process on the LR image via simple concatenation or latent embeddings 26 ; 17 ; 29 . Despite their improved visual quality, these approaches largely treat the LR input as a monolithic conditioning signal, failing to explicitly decouple the underlying degradation patterns from the image content. This implicit treatment often leads to restoration ambiguity; without explicit knowledge of the degradation type and severity, the model may struggle to distinguish between genuine textures and artifacts, resulting in either insufficient restoration or unnatural hallucinations. Recent methods such as SeeSR and DiffBIR partially alleviate this issue by introducing degradation-aware conditioning and restoration guidance 35 ; 20 . Furthermore, standard diffusion training applies spatially uniform Gaussian noise to the latent space 10 ; 25 . This overlooks the inherent spatial heteroscedasticity of image information: high-frequency structural regions (e.g., edges) are more sensitive to noise perturbations than flat areas. Applying uniform noise tends to prematurely eradicate critical structural cues, forcing the model to ”re-invent” geometry from scratch rather than refining existing structural remnants. To address these limitations, we propose a degradation-aware and structure-preserving diffusion framework for real-world SISR. Rather than introducing a fundamentally new diffusion formulation, our approach focuses on practical and targeted improvements to conditioning and training noise design within the adopted diffusion SR framework. Specifically, we introduce two lightweight modules that provide explicit restoration guidance. First, we develop a Degradation-aware Token Injection (DTI) module. DTI extracts a compact set of degradation statistics, encompassing blur kernels, noise levels, compression severity, and contrast, and projects them into a specialized conditioning token. By fusing this token with semantic embeddings, we provide the denoising network with explicit degradation cues, enabling more targeted and robust reconstruction across diverse degradation scenarios. Second, we introduce a Spatially Asymmetric Noise Injection (SANI) strategy. Unlike standard uniform diffusion, SANI modulates the training noise magnitude based on local edge strength. By assigning lower noise levels to structural regions, SANI preserves the geometric skeleton of the image during the diffusion process, effectively anchoring the generative process to the original structural topology. We evaluate our method on the DIV2K and RealSR benchmarks 3 ; 6 using a comprehensive suite of full-reference (PSNR, SSIM 33 , LPIPS) and no-reference perceptual metrics (NIQE 23 , NRQM, PI 4 , CLIP-IQA 28 , MUSIQ 12 ). Experimental results demonstrate that our method achieves a favorable trade-off between perceptual quality and fidelity, with competitive or superior performance on no-reference perceptual metrics compared with recent baselines. Extensive ablation studies further verify that DTI and SANI provide complementary benefits within the adopted diffusion SR pipeline.In addition, this work is part of the NTIRE 2026 Image Super-Resolution ( \times 4 ) challenge, whose benchmark results and method overview are summarized in the corresponding challenge report 7 . Our main contributions are summarized as follows: • We propose Degradation-aware Token Injection (DTI), which explicitly encodes degradation characteristics into conditioning tokens, enabling the diffusion model to better handle diverse real-world corruptions through more targeted restoration conditioning. • We introduce Spatially Asymmetric Noise Injection (SANI), a structure-aware training strategy that modulates noise levels based on local image geometry to better preserve edges and fine textures. • Extensive experiments on DIV2K and RealSR demonstrate that the proposed modules consistently improve perceptual quality and structural integrity on the adopted diffusion SR framework, with only marginal parameter and runtime overhead. 2 Related Work Real-World Image Super-Resolution. Image super-resolution has evolved from pixel-wise regression toward perceptual realism. SRGAN 14 and ESRGAN 31 pioneer this direction by combining adversarial and perceptual losses, but their effectiveness is largely limited to synthetic bicubic degradations. To handle complex real-world corruptions, BSRGAN 40 introduces a shuffled degradation pipeline to cover diverse corruption types, and Real-ESRGAN 30 further advances robustness through high-order degradation modeling. Recognizing that real images often suffer from non-uniform corruptions, recent works explore spatially-variant degradation models that estimate per-pixel degradation patterns 2 ; 16 , while CDFormer 21 learns content-aware degradation priors via a diffusion-based estimator. Despite these advances, most methods still characterize degradations implicitly through latent embeddings or complex synthesis pipelines, leaving the potential of explicit, interpretable degradation cues largely unexplored. Diffusion Models for Image Restoration. Diffusion probabilistic models have emerged as powerful generative priors for image restoration, owing to their strong ability to synthesize realistic textures and fine structural details 10 ; 26 ; 11 ; 22 . In real-world SR, StableSR 29 and PASD 36 leverage pre-trained latent diffusion models to inherit rich visual priors, producing perceptually realistic outputs. DiffBIR 20 extends this paradigm to blind image restoration by decoupling degradation removal and detail regeneration into two complementary stages. To address the prohibitive inference cost of standard diffusion sampling, ResShift 39 reformulates the forward process via residual shifting, achieving competitive quality with substantially fewer steps, and SinSR 32 further pushes efficiency toward one-step diffusion SR. SeeSR 35 introduces degradation-aware semantic prompts to maintain semantic correctness under severe degradations. These results collectively confirm that diffusion models provide a versatile generative foundation for real-world SR, though how to effectively condition the generation process remains a key open problem. Conditioning and Degradation-Aware Guidance. The generative flexibility of diffusion models also introduces the risk of hallucination and semantic drift, making effective conditioning and guidance mechanisms essential. SeeSR 35 addresses this by extracting hard and soft semantic prompts that remain reliable under heavy corruption, while DiffBIR 20 introduces region-adaptive restoration guidance to balance realism