RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Models
Yufeng Yang, Xianfang Zeng, Zhangqi Jiang, Fukun Yin, Jianzhuang Liu, Wei Cheng, Jinghong Lan, Shiyu Liu, Yuqi Peng, Gang Yu, Shifeng Chen, [0.4em] Southern University of Science, Technology · 2026
Read RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Models by Yufeng Yang, Xianfang Zeng, Zhangqi Jiang, Fukun Yin, Jianzhuang Liu, Wei Cheng, Jinghong Lan, Shiyu Liu, Yuqi Peng, Gang Yu, Shifeng Chen, [0.4em] Southern University of Science, Technology (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25502.txt.
Introduction
Yang and co-authors train an open image restorer that handles real-world damage of many kinds. Restoration models often fail off their home turf because training sets are small and narrow. Giant editing models generalize well but cost too much to copy. The team built a large set spanning nine common damage types. They trained a top open model on it. A new bench, RealIR-Bench, grades 464 real damaged photos on cleanup and faithfulness. Their model ranks first among open rivals.
Catalog record
| CREATOR | Yufeng Yang, Xianfang Zeng, Zhangqi Jiang, Fukun Yin, Jianzhuang Liu, Wei Cheng, Jinghong Lan, Shiyu Liu, Yuqi Peng, Gang Yu, Shifeng Chen, [0.4em] Southern University of Science, Technology |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57682 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.25502
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Models Yufeng Yang, Xianfang Zeng, Zhangqi Jiang, Fukun Yin, Jianzhuang Liu, Wei Cheng, Jinghong Lan, Shiyu Liu, Yuqi Peng, Gang Yu, Shifeng Chen, [0.4em] Southern University of Science, Technology Abstract Image restoration under real-world degradations is critical for downstream tasks such as autonomous driving and object detection. However, existing restoration models are often limited by the scale and distribution of their training data, resulting in poor generalization to real-world scenarios. Recently, large-scale image editing models have shown strong generalization ability in restoration tasks, especially for closed-source models like Nano Banana Pro, which can restore images while preserving consistency. Nevertheless, achieving such performance with those large universal models requires substantial data and computational costs. To address this issue, we construct a large-scale dataset covering nine common real-world degradation types and train a state-of-the-art open-source model to narrow the gap with closed-source alternatives. Furthermore, we introduce RealIR-Bench, which contains 464 real-world degraded images and tailored evaluation metrics focusing on degradation removal and consistency preservation. Extensive experiments demonstrate our model ranks first among open-source methods, achieving state-of-the-art performance. Figure 1 : RealRestorer effectively restores diverse real-world image degradations, including deblurring, moiré pattern removal, compression restoration, reflection removal, hazing removal, rain removal, deflare, and low-light enhancement. † † footnotetext: {\dagger} leads this project; ‡Corresponding authors. 1 Introduction Image restoration 37 ; 15 ; 31 ; 70 ; 35 aims to recover high-quality images from degraded observations and serves as a fundamental building block for downstream applications such as autonomous driving 23 ; 4 , remote sensing 62 , detection 22 ; 27 , and 3D reconstruction 68 . However, real-world images often suffer from diverse and co-existing degradations 36 ; 25 ; 13 ; 10 ; 71 ; 11 ; 26 ; 40 ; 16 ; 19 ; 21 ; 1 ; 60 ; 3 , including blur, rain, noise, low-light, moiré patterns, haze, compression artifacts, reflection, and flare. This complexity goes beyond the single degradation and single model paradigm. To address this, recent all-in-one restoration methods 33 ; 69 ; 48 ; 24 attempt to handle multiple degradations within a unified framework. Nevertheless, they often rely on a limited set of synthetic degradation distributions, while collecting large-scale real degraded-clean pairs remains expensive and difficult. As a result, these models can generalize poorly to real-world scenarios. In parallel, large image editing models trained on massive editing datasets have recently demonstrated strong restoration capabilities 74 , such as Nano Banana Pro 56 and GPT-Image-1.5 45 . However, these models are typically trained with closed-source data and compute, which makes them hard to reproduce and limits their utility for the research community. Despite this, leveraging the strong priors learned by image editing models provides a promising path to overcome the key limitation of traditional restoration approaches. However, conventional restoration datasets often focus on a narrow degradation distribution that is not representative of real-world conditions. Evaluation protocols that emphasize only reference-based metrics further exacerbate this issue, as they may not reflect perceptual quality, robustness across diverse degradations, or detail consistency in real scenes. To bridge these gaps, we design a comprehensive degradation synthesis pipeline to generate high-quality training data, aiming to narrow the gap between synthetic and real-world degradations. Based on this dataset, we fine-tune an open-source image editing model RealRestorer across nine restoration tasks, and further introduce a new benchmark RealIR-Bench to evaluate restoration performance under real-world degradations. In summary, our contributions are threefold: • We develop RealRestorer , an open-source real-world image restoration model that sets a new state of the art and achieves performance highly comparable to closed-source systems. We will release the model to facilitate future research in real-world restoration. • We propose a data generation pipeline to produce high-quality restoration training data with diverse and representative degradations. This pipeline provides a valuable resource for developing more robust restoration models. • We develop a new benchmark, RealIR-Bench , grounded in real-world cases, to evaluate both degradation restoration and consistency preservation. By addressing the lack of reliable evaluation protocols for real-world restoration, it enables more authentic and comprehensive assessment of restoration models. 2 Related Work 2.1 Single-Degradation Restoration Single-degradation restoration methods typically focus on removing one specific type of degradation under constrained and well-defined scenarios. With the rapid development of deep learning, numerous works 44 ; 32 ; 5 ; 73 ; 24 have achieved impressive performance on individual tasks such as deblurring, haze removal, low-light enhancement, deflare, and reflection removal. These approaches often rely on carefully designed architectures and degradation-specific priors, enabling strong performance. However, most single-degradation models are built upon task-specific assumptions, where the degradation type is predefined and relatively homogeneous, which makes models trained for a single degradation tend to generalize poorly and may even introduce secondary artifacts when encountering unseen or compound degradations. Moreover, many existing methods are trained and evaluated primarily on synthetic datasets with simplified degradation models, which may not faithfully represent the complexity of real-world data distributions. This gap between synthetic training data and real-world testing scenarios further limits their robustness and practical applicability. Consequently, while single-degradation methods achieve strong performance on benchmark datasets, their effectiveness in real-world applications remains constrained. 2.2 All-in-One Image Restoration All-in-one approaches 34 ; 38 ; 48 ; 42 ; 33 ; 7 ; 69 ; 17 aim to handle multiple degradations within a unified network by balancing shared representations and task-specific components. Nevertheless, many of these methods still rely heavily on synthetic datasets with limited and overly simplified degradation patterns. Such a narrow training distribution often results in weak robustness and poor generalization to real-world degradations, where corruption characteristics are diverse, complex, and domain-dependent. Meanwhile, large diffusion or flow-matching image editing models 39 ; 12 ; 46 ; 53 have recently demonstrated strong semantic priors for image enhancement and restoration. Trained on massive image–text pairs, these image editing models 29 ; 41 ; 65 ; 57 can leverage semantic conditioning and often generalize better to real-world data than small specialized restoration networks. Therefore, transferring and exploiting the priors of large image editing models provides a promising direction for building restoration systems with stronger real-world generalization. Motivated by this observation, we develop a high-quality and realistic degradation synthesis pipeline covering nine major degradations and use it to fine-tune open-source image editing models for robust real-world restoration while maintaining strong content consistency. Furthermore, to evaluate real-world restoration performance in the absence of clean references, we curate a benchmark of 464 real images spanning nine single-degradation categories, and propose new evaluation metrics that measure both degradation removal ability and consistency with the input content. Based on the proposed dataset and metrics, our fine-tuned model achieves state-of-the-art performance among open-source methods and is competitive with closed-source systems, while qualitative results further demonstrate strong generalization to real-world degradations. 3 RealRestorer 3.1 Data Construction Figure 2 : Overview of our large-scale Synthetic Degradation Data pipeline. We construct nine representative degradation types, including blur, compression artifacts, moiré patterns, low-light, noise, flare, reflection, haze, and rain. Compared with previous synthetic-only pipelines, our upgraded framework incorporates granular noise modeling, segment-aware perturbations, and web-style degradation processes, significantly narrowing the gap between synthetic and real-world distributions. This comprehensive pipeline enables more robust