EndoIR: Degradation-Agnostic All-in-One Endoscopic Image Restoration via Noise-Aware Routing Diffusion
Tong Chen, Xinyu Ma, Long Bai, Wenyang Wang, Yue Sun, Luping Zhou · 2025
Read EndoIR: Degradation-Agnostic All-in-One Endoscopic Image Restoration via Noise-Aware Routing Diffusion by Tong Chen, Xinyu Ma, Long Bai, Wenyang Wang, Yue Sun, Luping Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05873.txt.
Introduction
Tong Chen and co-authors restore endoscopic images damaged by several problems at once: dim light, smoke, and bleeding during surgery. Such flaws hide details clinicians need. Older restoration tools each handle one flaw type and often must be told which flaw is present, which limits real-world use.
Their system, EndoIR, handles all flaw types with one diffusion model and no prior label. A prompter extracts features from both the image and its frequency view. Clean and degraded inputs run through separate streams and are fused in a structured way. A routing block picks only noise-relevant features to save compute. On two data sets EndoIR beat strong baselines with fewer parameters, and follow-up segmentation tests confirmed clinical value.
Catalog record
| CREATOR | Tong Chen, Xinyu Ma, Long Bai, Wenyang Wang, Yue Sun, Luping Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-05873
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EndoIR: Degradation-Agnostic All-in-One Endoscopic Image Restoration via Noise-Aware Routing Diffusion Tong Chen, Xinyu Ma, Long Bai, Wenyang Wang, Yue Sun, Luping Zhou Abstract Endoscopic images often suffer from diverse and co-occurring degradations such as low lighting, smoke, and bleeding, which obscure critical clinical details. Existing restoration methods are typically task-specific and often require prior knowledge of the degradation type, limiting their robustness in real-world clinical use. We propose EndoIR, an all-in-one, degradation-agnostic diffusion-based framework that restores multiple degradation types using a single model. EndoIR introduces a Dual-Domain Prompter that extracts joint spatial–frequency features, coupled with an adaptive embedding that encodes both shared and task-specific cues as conditioning for denoising. To mitigate feature confusion in conventional concatenation-based conditioning, we design a Dual-Stream Diffusion architecture that processes clean and degraded inputs separately, with a Rectified Fusion Block integrating them in a structured, degradation-aware manner. Furthermore, Noise-Aware Routing Block improves efficiency by dynamically selecting only noise-relevant features during denoising. Experiments on SegSTRONG-C and CEC datasets demonstrate that EndoIR achieves state-of-the-art performance across multiple degradation scenarios while using fewer parameters than strong baselines, and downstream segmentation experiments confirm its clinical utility. Introduction Endoscopic imaging is indispensable for gastrointestinal diagnosis and surgical guidance. However, in real-world clinical settings, captured images are often degraded by multiple co-occurring factors such as low illumination, smoke, and bleeding ( 3 ; 21 ; 25 ) . These degradations obscure fine anatomical structures, reduce visibility of surgical tools, and impair downstream computational analysis. Restoring such degraded images is therefore essential for improving both the diagnostic quality and the safety of endoscopic procedures. A variety of restoration approaches have been developed over the years ( 9 ; 20 ; 10 ) . Early methods largely targeted single degradations in isolation, such as illumination enhancement, smoke removal, or denoising, typically using task-specific CNNs, GANs, or transformer-based architectures ( 31 ; 21 ; 29 ) . While effective for their intended degradation type, these models cannot handle complex, mixed degradations without retraining or explicit knowledge of the degradation type. More recent research in the broader computer vision community has explored all-in-one restoration frameworks, aiming to address multiple degradations with a single unified model. Figure 1: Comparison of average restoration accuracy (PSNR/SSIM), model size, and inference speed (FPS, annotated above each marker). Both our EndoIR ( \gamma=0.5 ) and ( \gamma=1 ) achieve state‑of‑the‑art restoration quality, while the \gamma=0.5 variant offers a compact model size and high inference speed, making it well‑suited for real‑time clinical use. Despite these advances, three limitations remain prominent. First , many unified methods rely on explicit degradation-type input or accurate prompt extraction. For example, prompt-based methods such as PromptIR ( 23 ) and AutoDIR ( 13 ) condition restoration on learned visual or language prompts, but these approaches require either prior knowledge of the degradation type or robust degradation classification, which is unreliable in dynamic surgical scenes. Second , routing-based ( 27 ) architectures such as AMIR [1]teyang2024all select restoration paths from degradation-specific cues. While effective for distinguishing degradation types, this can bias the model toward degradation modeling at the expense of preserving fine anatomical structures—a critical concern in medical images where subtle structural fidelity is essential. Third , in the case of diffusion-based methods ( 6 ; 33 ) , conventional concatenation-based conditioning merges degraded and noisy inputs early in the network. This can confuse the model with mixed feature distributions, particularly when degradations co-occur, leading to unstable optimization and reduced restoration quality. A detailed side-by-side comparison of these approaches and our EndoIR is provided in Supplementary Table 1, highlighting the differences in degradation handling, conditioning strategy, and efficiency. To address these challenges, we introduce EndoIR , the first all-in-one, degradation-agnostic diffusion framework tailored for complex endoscopic image restoration. EndoIR is designed to operate without any prior knowledge of the degradation type, while effectively disentangling and leveraging both degradation-specific and content-preserving information. Central to our approach is a Dual-Domain Prompter that jointly extracts spatial and frequency features to produce informative restoration prompts, coupled with a Task Adaptive Embedding mechanism that separates shared anatomical content from degradation-specific cues. To overcome feature confusion in conventional conditioning, we design a Dual-Stream Diffusion architecture that processes clean and degraded inputs independently, followed by a Rectified Fusion Block that integrates them in a structured, degradation-aware manner. Finally, to improve computational efficiency, we propose a Noise-Aware Routing Block that dynamically selects only noise-relevant features for denoising, reducing redundant computation while preserving restoration quality. Our main contributions are summarized as follows: • We propose degradation-agnostic restoration without labels via a Dual-Domain Prompter and task adaptive embedding for joint spatial-frequency prompt learning. • We introduce a disentangled dual-stream conditioning mechanism for stable diffusion restoration, with a Rectified Fusion Block for structured feature integration. • We design an efficient, noise-aware decoding strategy using the Noise-Aware Routing Block that reduces computation without compromising quality. • We conduct comprehensive validation on challenging endoscopic benchmarks, achieving state-of-the-art performance on SegSTRONG-C and CEC datasets and demonstrating strong generalization in downstream surgical tool segmentation tasks. Related Work In general scenarios for all-in-one restoration, early works addressed diverse degradation scenarios using corruption-agnostic frameworks, such as contrastive degradation encoders and degradation-guided decoders ( 14 ) . Subsequent methods like RAM ( 24 ) introduced masked image modeling for intrinsic feature extraction, while ADMS ( 22 ) utilized adaptive filters to handle unknown degradations with minimal overhead. Recent studies explored adaptive prompts to guide restoration. PromptIR ( 23 ) and PIP ( 17 ) developed prompt-based modules to dynamically encode degradation information, combining high-level and low-level prompts through dedicated interaction mechanisms. Vision-language approaches also advanced the field by injecting semantic cues. AutoDIR ( 13 ) integrated a vision-language module for open-vocabulary degradation recognition with a diffusion model guided by text prompts. MPerceiver ( 1 ) leveraged CLIP for improved zero-shot and few-shot performance. To mitigate task interference and data scarcity, DFPIR ( 30 ) introduced feature perturbations guided by degradation prompts, while FoundIR ( 15 ) constructed a large real-world dataset and a two-stage diffusion-refinement framework. Defusion ( 19 ) further refined diffusion models with degradation-specific visual priors, focusing on visual rather than language cues. In summary, unified frameworks and more recent prompt- and diffusion-based approaches have advanced all-in-one restoration with strong adaptability and robustness to diverse degradations. However, in medical imaging, degradation types and patterns often differ from those in natural images. Medical images typically have more regular structures and are highly sensitive to small changes, especially at lesion borders and in fine textures. Inaccurate restoration can cause errors in tasks like segmentation and diagnosis. Only a few studies address all-in-one restoration for medical images ( 16 ) . Recently, AMIR ( 35 ) introduced a task-adaptive routing network for multiple tasks, such as MRI super-resolution, CT denoising, and PET synthesis. Subsequent work further explores new paradigms in model architecture design ( 36 ; 4 ) . Nevertheless, in endoscopic scenarios, most work still targets specific tasks, like low-light enhancement ( 3 ; 6 ) , super-resolution ( 7 ; 18 ) , or desmoking ( 21 ; 32 ) , and optimizes each task in isolation. Few methods aim for a unified solution. For example, EndoUIC ( 2 ) provides unified enhancement for