Super-Resolution Enhancement of Medical Images Based on Diffusion Model: An Optimization Scheme for Low-Resolution Gastric Images

Haozhe Jia · 2025

Read Super-Resolution Enhancement of Medical Images Based on Diffusion Model: An Optimization Scheme for Low-Resolution Gastric Images by Haozhe Jia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22209.txt.

Introduction

Haozhe Jia applies diffusion models to sharpen the blurry pictures from capsule endoscopy, the swallowable-camera exam of the digestive tract. Capsule cameras are limited by size, power, and transmission, so their images lack the fine mucosal detail doctors need for early diagnosis. Jia's system learns a probabilistic mapping from low-resolution to high-resolution images using the SR3 approach built on denoising diffusion models.

Trained and tested on the HyperKvasir dataset of gastrointestinal endoscopy images, the method beat bicubic interpolation and GAN-based rivals such as ESRGAN. With attention methods added, image quality reached a peak signal-to-noise ratio of 29.3 decibels and a structural similarity of 0.71 in the reported tests. Anatomical boundaries, blood vessel patterns, and lesion forms were preserved better than with the alternatives.

Catalog record

CREATORHaozhe Jia
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-22209

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Super-Resolution Enhancement of Medical Images Based on Diffusion Model: An Optimization Scheme for Low-Resolution Gastric Images Haozhe Jia Abstract The advent of capsule endoscopy has revolutionized gastrointestinal imaging by enabling minimally invasive internal visualization. However, its clinical utility is constrained by the inherently low resolution of the acquired imagery, resulting from limitations in onboard hardware, power supply, and wireless data transmission. These constraints impede the accurate identification of fine-grained mucosal textures, pathological features such as polyps or ulcerations, and subtle morphological variations essential for early diagnosis. This study addresses these challenges by investigating the efficacy of a diffusion-based super-resolution framework that can enhance capsule endoscopy images in a data-driven and anatomically consistent manner. This research adopts the SR3 (Super-Resolution via Repeated Refinement) framework [ 8 ] , built upon Denoising Diffusion Probabilistic Models (DDPMs), to learn a probabilistic mapping from low-resolution to high-resolution images. Unlike adversarial learning-based approaches that suffer from instability and hallucination artifacts, diffusion models offer robust likelihood-based training with reliable convergence behavior. The HyperKvasir dataset [ 2 ] , a large-scale publicly available collection of gastrointestinal endoscopy images labeled by anatomical and pathological attributes, serves as the primary training and evaluation corpus. The model takes as input a six-channel concatenation of a bicubic-upsampled low-resolution image and random Gaussian noise, and progressively denoises it across 2000 diffusion steps to approximate the high-resolution ground truth. The network architecture is a U-Net backbone with hierarchical feature extraction, multiscale supervision, and group normalization. Empirical evaluations demonstrate that the SR3 model significantly enhances image fidelity over traditional interpolation methods and GAN-based super-resolution frameworks such as ESRGAN. Quantitatively, the proposed approach achieves mean PSNR of 27.5 dB and SSIM of 0.65 for the first-generation model, improving to 29.3 dB and 0.71 for the second-generation model with attention mechanisms. Qualitatively, the model preserves mucosal boundaries, vascular patterns, and lesion structures with high anatomical faithfulness, which are critical for downstream tasks such as computer-aided detection and classification. The findings suggest that diffusion-based super-resolution techniques hold strong promise for advancing non-invasive medical imaging, particularly in capsule endoscopy where hardware-imposed constraints limit image resolution. Keywords: Medical image super-resolution, Diffusion models, Capsule endoscopy, Deep learning, Image enhancement, SR3, DDPM 1 Introduction Capsule endoscopy has emerged as a widely adopted non-invasive diagnostic tool for visualizing the gastrointestinal (GI) tract [ 1 , 7 ] . However, due to the constraints of miniaturized camera sensors and energy efficiency, the resolution of images captured by capsule endoscopes remains relatively low. This limitation hinders the accurate identification of subtle pathological features, such as small polyps, ulcers, or bleeding points, which are essential for early diagnosis and effective treatment. In contrast, traditional invasive endoscopy offers high-resolution imagery but at the cost of patient discomfort, procedural risk, and limited accessibility. Therefore, a significant research challenge lies in enhancing the resolution of non-invasive capsule images without compromising patient comfort. This forms the core motivation of our work: to bridge the gap between image quality and non-invasiveness in modern GI diagnostics. Super-resolution (SR) techniques—especially recent advances using deep generative models—offer promising solutions. Among them, diffusion-based methods such as SR3 (Super-Resolution via Iterative Refinement) [ 8 ] have shown outstanding performance in recovering fine-grained details from severely degraded inputs. By treating super-resolution as a conditional generation task, SR3 iteratively denoises a noisy version of the upsampled low-resolution image until convergence to a sharp, high-resolution output. Figure 1 : Example of low-resolution capsule endoscopy image showing limited detail for diagnostic purposes. The primary objective of this work is to explore and improve diffusion-based super-resolution strategies—starting with SR3 and evolving toward more efficient latent-diffusion approaches—for enhancing capsule endoscopy image resolution. Using the HyperKvasir dataset [ 2 ] as a training benchmark, we aim to develop a scalable, semantically-aware resolution enhancement pipeline that could eventually support real-world medical applications. 1.1 Challenges and Contributions Despite the recent success of diffusion models, several challenges persist in the context of medical super-resolution: • High computational cost: Traditional DDPM models such as SR3 operate in pixel space, requiring thousands of sampling steps and high-resolution memory usage. • Sensitivity to image noise and clinical variations: Capsule endoscopy images often suffer from motion blur, low contrast, and lighting inconsistencies. • Semantic inconsistency: Super-resolution models may enhance image sharpness but fail to preserve anatomical correctness if not appropriately trained. To address these issues, our contributions in this work are threefold: 1. We implement and optimize a first- and second-generation SR3-based model tailored for capsule endoscopy imagery, including architecture customization and step-wise upscaling strategies. 2. We conduct comprehensive experiments demonstrating quantitative improvements (PSNR: 27.5 → 29.3 dB, SSIM: 0.65 → 0.71) through architectural enhancements including attention mechanisms and optimized training procedures. 3. We propose a third-generation model based on latent diffusion by integrating a pretrained VAE from the Stable Diffusion architecture [ 5 ] , enabling semantic compression and faster inference in latent space as future work. 2 Related Work This section reviews the existing literature related to diffusion-based image generation and super-resolution, with a particular focus on their applications in the medical imaging domain. 2.1 Diffusion-Based Super-Resolution Diffusion-based models have recently demonstrated significant success in the area of image generation and super-resolution. One notable contribution is SR3 [ 8 ] , which formulates the super-resolution task as a denoising problem using a score-based generative model. SR3 progressively refines a low-resolution image toward high-resolution through a stochastic denoising process. This approach achieves impressive visual quality, especially in facial and natural image domains. To address SR3’s limitations in terms of computational and memory costs due to pixel-space modeling, Latent Diffusion Models (LDMs) [ 5 ] were introduced. These models compress images into a semantic latent space using a pretrained Variational Autoencoder (VAE), allowing diffusion to operate in a more efficient representation. While these methods show great potential, their applications in domain-specific settings such as medical imaging remain relatively underexplored. 2.2 Medical Image Super-Resolution The reviewed literature reveals increasing interest in generative diffusion models for healthcare applications. Compared to GAN-based methods, diffusion models offer more stable training and superior image fidelity, which are essential in clinical scenarios. For instance, Mahapatra et al. [ 3 ] introduced GAN-based models with perceptual loss for retinal and MRI image enhancement. However, such models risk generating anatomically inconsistent hallucinations. Med-DDPM [ 11 ] demonstrates that DDPM-based models can be successfully adapted for CT and MR image reconstruction by incorporating domain priors. Likewise, Polyp-DDPM [ 12 ] applies diffusion models to generate structure-preserving polyp images, enhancing segmentation model training. Nevertheless, both works prioritize generation or synthesis rather than resolution enhancement. Moreover, gastrointestinal imaging—especially non-invasive capsule endoscopy—remains under-addressed in terms of domain-specific super-resolution. 3 Theoretical Background and Motivation In this section, we introduce the theoretical principles behind image super-resolution, with a focus on diffusion probabilistic models. 3.1 Background on Image Super-Resolution Image super-resolution (SR) refers to the process of reconstructing a high-resolution (HR) image from its low-resolution (LR) counterpart. It plays a crucial role in medical imaging applications where high-quality visuals are essential for diagnosis, especially in non-invasive procedures such as capsule endoscopy. Traditional SR methods include interpolation-based approaches, CNN-based mappings, adversarial GAN models, and more recently, diffusion-based models. In the context of this project, we evaluated multiple architectures before choosing SR3 as the final model.

Read the complete text