Computationally Efficient Diffusion Models in Medical Imaging: A Comprehensive Review

Abdullah, Tao Huang, Ickjai Lee, Euijoon Ahn · 2025

Read Computationally Efficient Diffusion Models in Medical Imaging: A Comprehensive Review by Abdullah, Tao Huang, Ickjai Lee, Euijoon Ahn (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-07866.txt.

Introduction

Abdullah and co-authors wrote a review from 2025 on making diffusion image models cheap enough for routine medical use. Diffusion models now make strikingly good synthetic images, and hospitals want them for spotting disease and filling imaging gaps. Their flaw is cost: training and sampling both burn heavy computing. The review sorts the fast variants into three families and compares how each cuts the bill.

The first family denoises step by step in full image space. The second works in a compressed latent space, which slashes the load. The third uses wavelets to split the work by scale. For each, the authors lay out the frame, the true computing cost, and what it buys in medical tasks. They then list the standing limits: scarce data, trust, and proof of safety. Future paths include leaner sampling and tighter ties to clinical workflow.

Catalog record

CREATORAbdullah, Tao Huang, Ickjai Lee, Euijoon Ahn
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE97 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-07866

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Computationally Efficient Diffusion Models in Medical Imaging: A Comprehensive Review Abdullah, Tao Huang, Ickjai Lee, Euijoon Ahn Abstract . The diffusion model has recently emerged as a potent approach in computer vision, demonstrating remarkable performances in the field of generative artificial intelligence. Capable of producing high-quality synthetic images, diffusion models have been successfully applied across a range of applications. However, a significant challenge remains with the high computational cost associated with training and generating these models. This study focuses on the efficiency and inference time of diffusion-based generative models, highlighting their applications in both natural and medical imaging. We present the most recent advances in diffusion models by categorizing them into three key models: the Denoising Diffusion Probabilistic Model (DDPM), the Latent Diffusion Model (LDM), and the Wavelet Diffusion Model (WDM). These models play a crucial role in medical imaging, where producing fast, reliable, and high-quality medical images is essential for accurate analysis of abnormalities and disease diagnosis. We first investigate the general framework of DDPM, LDM, and WDM and discuss the computational complexity gap filled by these models in natural and medical imaging. We then discuss the current limitations of these models as well as the opportunities and future research directions in medical imaging. 0 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Computer vision CCS: Applied computing Life and medical science CCS: Applied computing Computational biology CCS: Applied computing Imaging 1. Introduction Deep generative models have demonstrated remarkable capabilities in generating new and realistic images ( 1 ) . These models include Generative Adversarial Networks (GANs) ( 1 ) , Variational Autoencoder Encoder (VAE) ( 2 ) , and Energy-Based Models (EBMs) ( 3 ) . GANs have garnered great attention among these models due to their training process involving a dual neural network system: a generator and a discriminator. The generation network produces and synthesizes data from random noise, while a discrimination network evaluates the authenticity of the data by differentiating between real and generated synthetic data. These networks work simultaneously to produce realistic synthetic data and are used for multiple tasks such as image generation ( 4 ) , image classification ( 5 ) , image segmentation ( 6 ) , and object detection ( 7 ) . However, GANs are still limited in producing high-quality synthetic data when the generator and discriminator fail to attain a stable equilibrium during training. It hinders the accurate generation of realistic data. GANs can also lead to model collapse, where the generator struggles to produce diverse outputs, resulting in repetitive or similar samples. The model collapses when the generator dominates the discriminator network, receiving insufficient feedback to guide its learning effectively ( 8 ) . Moreover, GANs are limited in parallel processing due to dependencies in their alternating training process between the generator and discriminator. Recently, diffusion-based generative models ( 9 , 10 , 11 , 12 ) have been examined as State-Of-The-Art (SOTA) in generating synthetic data due to their stable training performance and their superior performance in generating high-quality synthetic data compared to GANs. Diffusion models have been successfully applied in numerous applications, such as image synthesis ( 13 , 14 , 15 ) , video generation ( 16 ) , Natural Language Processing (NLP) ( 17 ) , text generation ( 18 ) , image denoising ( 15 , 19 ) , image inpainting ( 20 ) , image super-resolution ( 21 , 22 ) , image segmentation ( 23 , 24 ) , image-to-image translation ( 25 ) , and classification ( 26 , 27 ) . Diffusion models effectively address the prominent limitations of GANs. These models progressively add Gaussian noise to the input image over a series of different time steps until the image becomes completely noisy. The model then learns to reconstruct the original input image from this fully noisy state. More recently, Denoising Diffusion Probabilistic Models (DDPMs) have been introduced, surpassing the performance of traditional diffusion models ( 15 ) . DDPMs incorporate a denoising technique to enhance the modeling of complex data distributions, improving sample quality and training stability compared to earlier diffusion models. This enhancement enables DDPMs to achieve superior performance for various generative modeling tasks. DDPMs have been successfully applied to many different imaging analysis tasks such as image generation ( 28 , 29 , 30 ) , image segmentation ( 31 , 32 , 33 , 34 ) , image inpainting ( 35 , 36 ) , image classification ( 26 , 37 , 38 ) , image translation ( 39 , 40 , 41 ) , image editing ( 42 , 43 , 44 ) , and image reconstruction ( 45 , 46 , 47 ) . In particular, DDPMs for text-to-image generation, such as Imagen ( 48 ) , Stable ( 49 ) , and DALL-E ( 50 ) , garnered significant attention due to their ability to produce high-quality images with broad applicability. Although DDPMs excel in generating high-quality data, their main drawback is the need for a high computational cost to generate new samples, i.e., inference time, after the DDPMs are trained. DDPM is categorized as one of the probabilistic models that demands substantial computational resources. This complexity intensifies, particularly when handling high-dimensional data such as histopathological Whole Slide Images (WSI) ( 51 ) . These images require significant memory resources and training time due to their exceptionally high resolution and large file size. Prominent advancements in diffusion models, notably demonstrated by Meta AI ( 52 ) and Google Research ( 16 ) , are attributed to their substantial computational capabilities. Evaluating pre-trained models entails significant time and memory costs, as the model may need to execute multiple steps to generate a data sample ( 14 ) . This drawback poses a challenge for integrating these models into scenarios that demand quick and responsive results. For this reason, a new trend is to focus on improving the speed and scalability of diffusion models. Rombach et al. ( 14 ) introduced the Latent Diffusion Model (LDM) to improve sampling efficiency and manage computational resources without sacrificing quality. It utilizes the latent space of a well-established pre-trained autoencoder, which offers a lower-dimensional representation that remains closely aligned with the data space. Consequently, it eliminates the need for spatial compression by training the diffusion model directly in the latent space. This approach exhibits superior scalability with respect to spatial dimensionality. Moreover, it strikes a balance between simplicity and the preservation of details, improving visual fidelity. Latent diffusion has been widely applied in generation tasks, demonstrating competitive performance. For instance, Pinaya et al. ( 28 ) used LDM for synthesizing images from high-resolution 3D brain scans. Additionally, it is extensively used in image editing and reconstruction ( 53 ) , classification ( 54 ) , and image translation ( 55 ) . LDM substantially enhances both the training and sampling efficiency of DDPMs, while maintaining their high-quality outcome. Despite its success, there remains rooms to improve the inference speed. More recently, the Wavelet Diffusion Model (WDM) has been introduced to further improve the computational efficiency. WDM diffuses information across scales with wavelet transformations, allowing them to leverage parallel processing to reduce the computational cost required for training

Read the complete text