Degradation-Aware All-in-One Image Restoration via Latent Prior Encoding

S. M. A. Sharif, Abdur Rehman, Fayaz Ali Dharejo, Radu Timofte, Rizwan Ali Naqvi · 2025

Read Degradation-Aware All-in-One Image Restoration via Latent Prior Encoding by S. M. A. Sharif, Abdur Rehman, Fayaz Ali Dharejo, Radu Timofte, Rizwan Ali Naqvi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17792.txt.

Introduction

S M A Sharif and 4 co-authors tackle photos spoiled in more than one way at once. Their 2025 paper deals with haze, rain, snow, and low light, which can all harm an image. Past all-in-one fix tools lean on text prompts or hand-built rules, which can break on new mixes.

Their view is to let the tool infer a hidden code for the harm from the image itself. That code then guides which traits to use, where to fix, and what harm to undo. On many test sets, the method beat top tools on image score. It also ran about three times as fast.

Catalog record

CREATORS. M. A. Sharif, Abdur Rehman, Fayaz Ali Dharejo, Radu Timofte, Rizwan Ali Naqvi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-17792

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Degradation-Aware All-in-One Image Restoration via Latent Prior Encoding S. M. A. Sharif, Abdur Rehman, Fayaz Ali Dharejo, Radu Timofte, Rizwan Ali Naqvi Abstract Real-world images often suffer from spatially diverse degradations such as haze, rain, snow, and low-light, significantly impacting visual quality and downstream vision tasks. Existing all-in-one restoration (AIR) approaches either depend on external text prompts or embed hand-crafted architectural priors (e.g., frequency heuristics); both impose discrete, brittle assumptions that weaken generalization to unseen or mixed degradations. To address this limitation, we propose to reframe AIR as learned latent prior inference, where degradation-aware representations are automatically inferred from the input without explicit task cues. Based on latent priors, we formulate AIR as a structured reasoning paradigm: (1) which features to route (adaptive feature selection), (2) where to restore (spatial localization), and (3) what to restore (degradation semantics). We design a lightweight decoding module that efficiently leverages these latent encoded cues for spatially-adaptive restoration. Extensive experiments across six common degradation tasks, five compound settings, and previously unseen degradations demonstrate that our method outperforms state-of-the-art (SOTA) approaches, achieving an average PSNR improvement of 1.68 dB while being three times more efficient. Figure 1: Comparison of common all-in-one image restoration paradigms. Existing approaches depend on explicit task-specific guidance through manual prompts or predefined architectural biases. Our DAIR learns degradation-aware representations directly from degraded images through latent prior inference. 1 Introduction Real-world images are frequently degraded by factors like haze, rain, snow, low-light, and motion blur Tian et al. 2025a ; Jiang et al. 2025 . These spatially varying degradations may occur alternately or even overlap, depending on environmental and capture conditions Guo et al. 2024 . Such entangled degradation patterns significantly reduce visual quality, resulting in impaired downstream vision tasks Tian et al. 2025a ; Jiang et al. 2025 . Recent deep learning-based single-task methods Dong et al. 2020 ; Valanarasu et al. 2022 ; Chen et al. 2021 ; Cai et al. 2023 ; Wang et al. 2022 ; Zhang et al. 2017 have made significant progress in addressing individual restoration challenges. However, deploying separate task-specific (TS) networks for each degradation type is computationally expensive and impractical, driving interest in AIR frameworks Jiang et al. 2025 . Current AIR approaches can be broadly categorized into two paradigms. (1) Adaptive feature learning methods, such as ADAIR Cui et al. 2024 and AirNet Li et al. 2022 , utilize hand-crafted frequency priors or architectural inductive biases to automatically differentiate degradation types. Although these methods circumvent manual specification, they inherently depend on pre-defined assumptions about degradation characteristics, which often fail to generalize to novel or compound corruptions Gao et al. 2024 . (2) Prompt-based restoration methods, such as PromptIR Vaishnav et al. 2023 and DFPIR Tian et al. 2025a , rely on explicit, manually provided prompts to guide the restoration network by specifying degradation types. These methods offer flexible control but face a fundamental ”chicken-and-egg” dilemma: in real-world scenarios, the degradation type and location are rarely known beforehand, yet the network requires this information to perform effective restoration Jiang et al. 2025 . Moreover, TS instructions constrain generalization, particularly in cases of mixed degradations or varying homogeneous degradations (e.g., different noise levels). As illustrated in Fig. 1 , both existing AIR paradigms have limited robustness and practical applicability in unconstrained environments. To overcome these limitations, we reframe AIR as a latent prior inference problem. Unlike existing methods Vaishnav et al. 2023 ; Cui et al. 2024 ; Tian et al. 2025a that rely on explicit degradation prompting or predefined architectural inductive biases, we propose learning degradation-aware representations directly from the degraded image through a multi-level feature descriptor inspired by the variational autoencoder (VAE) Kingma & Welling 2013 . Our learned prior eliminates the need for manual degradation hints and enables spatially adaptive restoration of diverse and unseen degradations. Guided by these learned priors, the proposed degradation-aware AIR (DAIR) framework incorporates a ”where, which, what” reasoning paradigm: it learns degradation-aware feature selection (which), localizes corrupted regions using spatial attention maps (where), and adaptively fuses multi-scale global representations (what). Our unified strategy substantially enhances the flexibility and generalizability of blind restoration methods. Our contributions are: – We propose reframe AIR to directly learn latent degradation priors from the corrupted image, eliminating the need for external manual prompts (MP). – We propose a reasoning image restoration paradigm comprising: (1) latent priors for learning degradation-aware representations, enabling decisions on ”which” encoder features to utilize for reconstruction; (2) spatially-adaptive degradation map (DM) that integrate frequency-domain cues with efficient element-wise attention, providing interpretable and localized restoration guidance on ”where” to focus beyond implicit attention; (3) cross-modal fusion of structural and color cues with global degradation priors via adaptive scaling and shifting to determine ”what” content to reconstruct; and (4) a decoder with linear complexity performing explicit spatial reasoning for leverages 1-3 cues, we termed it 3WD (which–where–what decoding). – DAIR consistently outperforms SOTA on six common restoration tasks (e.g., snow, low-light), five compound degradations (e.g., haze + rain, low-light + haze + rain), and unseen degradations, achieving an average 1.68 dB PSNR gain. It also improves downstream tasks on images with unknown multi-type degradations, e.g., boosting YOLOv12-L Tian et al. 2025b object detection by up to 7.40 mAP over SOTA AIR methods, highlighting strong generalizability (Fig. 1 ). 2 Related works 2.1 Image-to-image Translation Early image restoration methods were designed to address individual TS settings, such as denoising Zhang et al. 2017 ; Pang et al. 2021 ; Zhang et al. 2018a , dehazing Dong et al. 2020 ; Qin et al. 2020 , deraining Jiang et al. 2020 ; Ren et al. 2019 , low-light image enhancement (LLIE) Wei et al. 2018 ; Yi et al. 2023 , or deblurring Cho et al. 2021 ; Nah et al. 2017 . These task-dependent approaches achieved impressive results; their limited scope prevented generalization across diverse restoration challenges. Transformer-based models, such as Restormer Zamir et al. 2022 and Uformer Wang et al. 2022 , have explored multiple degradation scenarios; however, they still require separate training for individual tasks. To address this, recent methods shift towards AIR, aiming to handle diverse degradations within a unified framework. AirNet Li et al. 2022 pioneered this field by introducing contrastive learning to extract degradation representations, guiding restoration for unknown corruptions. ADAIR Cui et al. 2024 recalibrate features using adaptive frequency statistics, enabling task-agnostic restoration. Recent methods, such as DiffUIR Zheng et al. 2024 , have also explored generative techniques (i.e., latent diffusion Rombach et al. 2022 ). These unified approaches mark a significant step forward, minimizing TS training and advancing toward generalizable AIR solutions. 2.2 Prompt-Guided All-in-one Restoration Image-to-image translation-based method commonly fails in separating unique degradations Brooks et al. 2023 ; Jiang et al. 2025 . To counter this, recent AIR Gao et al. 2024 ; Vaishnav et al. 2023 ; Tian et al. 2025a methods have incorporated MP to provide prior knowledge of degradation cues. PromptIR Vaishnav et al. 2023 integrates text-based prompts into a transformer framework, leveraging degradation-specific semantic information to guide the restoration process. OneRestore Guo et al. 2024 introduced visual and text prompts within a transformer-based framework to encode TS information. Recently, DFPIR Tian et al. 2025a introduced a degradation-aware feature

Read the complete text