Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration

I-Hsiang Chen, Isma Hadji, Enrique Sanchez, Adrian Bulat, Sy-Yen Kuo, Radu Timofte, Georgios Tzimiropoulos, Brais Martinez, Samsung AI Center Cambridge · 2026

Read Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration by I-Hsiang Chen, Isma Hadji, Enrique Sanchez, Adrian Bulat, Sy-Yen Kuo, Radu Timofte, Georgios Tzimiropoulos, Brais Martinez, Samsung AI Center Cambridge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26385.txt.

Introduction

Chen and co-authors present RAR, a framework that restores images by looping through repair and review. Restoration must cope with mixed damage from weather, blur, and low light, often of unknown type. RAR joins quality assessment and restoration in one model that works in the latent domain. Each pass spots the damage, repairs it, and checks the result, then repeats if needed. Tests show steady gains on single, unknown, and mixed damage, with less delay than split pipelines.

Catalog record

CREATORI-Hsiang Chen, Isma Hadji, Enrique Sanchez, Adrian Bulat, Sy-Yen Kuo, Radu Timofte, Georgios Tzimiropoulos, Brais Martinez, Samsung AI Center Cambridge
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61584
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26385

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Restore, Assess, Repeat: A Unified Framework for Iterative Image Restoration I-Hsiang Chen, Isma Hadji, Enrique Sanchez, Adrian Bulat, Sy-Yen Kuo, Radu Timofte, Georgios Tzimiropoulos, Brais Martinez, Samsung AI Center Cambridge Abstract Image restoration aims to recover high quality images from inputs degraded by various factors, such as adverse weather, blur, or low light. While recent studies have shown remarkable progress across individual or unified restoration tasks, they still suffer from limited generalization and inefficiency when handling unknown or composite degradations. To address these limitations, we propose RAR, a Restore, Assess and Repeat process, that integrates Image Quality Assessment (IQA) and Image Restoration (IR) into a unified framework to iteratively and efficiently achieve high quality image restoration. Specifically, we introduce a restoration process that operates entirely in the latent domain to jointly perform degradation identification, image restoration, and quality verification. The resulting model is fully trainable end-to-end and allows for an all-in-one assess and restore approach that dynamically adapts the restoration process. Also, the tight integration of IQA and IR into a unified model minimizes the latency and information loss that typically arises from keeping the two modules disjoint, (e.g. during image and/or text decoding). Extensive experiments show that our approach offers consistent improvements under single, unknown and composite degradations, thereby establishing a new state-of-the-art. † † Project: https://restore-assess-repeat.github.io/ † † * Work conducted during I-Hsiang's internship at Samsung AI Center, Cambridge, UK. 1 Introduction Image Restoration is a challenging task that aims at recovering a clean image from one or several degradations such as blur, haze, rain, or lighting. Most early works focused on tackling one kind of degradation only 7 ; 36 ; 48 ; 45 . However, in real world settings, degradations are complex and rarely known a priori. In here, we focus on image restoration under unknown composite degradations, so images can present one or more unknown degradations at a time. Figure 1 : Overview of RAR . Given an input image with unknown composite degradations, RAR operates entirely in latent by iteratively assessing current image quality, restoring the image based on the assessment, and verifying the quality improvement. Recent methods tackling composite degradations can be broadly categorized into two paradigms. The first, all-in-one models 51 ; 25 ; 16 ; 35 utilize a single, unified generative model for restoration. The second, agentic models 53 ; 47 ; 3 , employ an agent that iteratively selects and applies tools from a suite of specialized, single-degradation restorers. Tool selection is guided by an IQA step, which identifies the main degradation. While agentic models allow for progressive restoration, they are cumbersome and slow. Conversely, all-in-one models offer a more efficient and unified alternative, but currently lag in performance. AutoDIR 16 , one of the best-performing all-in-one models, also uses an assessment step in line with agentic models. However, it relies on CLIP 32 , which treats IQA as n-way classifier over a predefined set of degradation labels. This limits the generalization capability of the restoration model. Furthermore, zero-shot CLIP performs poorly for IQA. Thus, supervised finetuning is required to make it focus on degradations rather than semantics. Instead, recent agentic models (e.g AgenticIR 53 ) rely on a description-based IQA model 46 , which provides a rich free-form assessment of the image and covers multiple assessment tasks. However, given the lack of integration with the restoration step, even when the IQA explicitly identifies image degradations, final performance is still limited by the availability of a corresponding restoration tool and proper execution. In this work, we take the best of both worlds by integrating a more descriptive IQA model, capable of assessing image quality through free form text, into an all-in-one generative IR model. Importantly, we propose a deep integration of the two modules such that they share a common latent space, thereby yielding a single end-to-end trainable model that is capable of multiple rounds of degradation identification, restoration and quality verification in latent space. To achieve this, we start from an IQA model that can describe the degradations in an image using free form text but enforce the IQA model to operate in the same latent space as the IR module. For the IR we use a generative model, which we condition on the feedback obtained from the IQA model directly using its output logits rather than the decoded text, thereby tightly combining the assessment and restoration steps. The resulting model is fully trainable in an end-to-end fashion to dynamically adapt the IR on the IQA feedback. At inference, the IQA model is also used to compare images before and after each restoration step to decide that (a) the restoration process is successful or (b) repeat the process with a new conditioning based on trailing issues in the restored image. The entire process is illustrated in Fig. 1 . In summary, our contributions are threefold: • We propose to combine free-form IQA with an all-in-one restoration model. • We tightly integrate the IQA and restoration into a single end-to-end trainable model. • We enable multiple assessment, restoration, validation rounds, all operating in latent space, thereby improving both training process and inference performance. Together, these contribution yield state-of-the-art performance on unknown, composite and single degradation settings. For example, in the challenging composite degradations setup, our method achieves improvements ranging from +2.71 dB (PSNR) to +72.4 (MANIQA), while being 11.27× faster than the state-of-the-art. 2 Related Work Image restoration is a challenging inverse imaging task. Early works focused on single-degradation settings such as denoising 48 ; 7 , deblurring 27 ; 36 , dehazing 11 ; 6 ; 48 , deraining 40 ; 44 or low-light enhancement 45 ; 50 . To better align with real-world conditions, recent works address multiple degradations, which is our main focus in this work. We categorize methods into two main tacks: all-in-one models and agentic models. All-in-one models rely on a single model to tackle multiple degradations. These methods are either non-generative 5 ; 48 ; 22 ; 49 ; 21 ; 39 ; 30 , or rely on a generative model 29 ; 54 ; 43 ; 51 ; 25 ; 4 ; 35 . Most such methods use known degradation priors or a classifier to recognize the degradation category present in the image to guide the restoration model. Therefore, these methods are constrained to handle a limited set of degradations. While we also rely on generative priors to perform restoration, we do not assume knowledge of the degradation. Instead, we enlist an IQA model to condition the restoration process. Most closely related work to ours is AutoDIR 16 , which attempts to handle unknown degradations also using an IQA model. However, they rely on CLIP, which by default performs poorly for degradation identification, thus needing finetuning to operate on a predefined closed set of degradations. Therefore, it inherits the shortcoming of prior methods. Instead, we start from DepictQA 46 , a VLM-based IQA, which not only can describe image quality with free-form text, but also can compare pairs of images. We then adapt it to operate in the latent space of a restoration module, to yield an end-to-end trainable model, which enables an iterative assess and restore process. Agentic Models. instead consider a

Read the complete text