Regression is all you need for medical image translation

Sebastian Rassmann, David Kügler, Christian Ewert, Martin Reuter · 2025

Read Regression is all you need for medical image translation by Sebastian Rassmann, David Kügler, Christian Ewert, Martin Reuter (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-02048.txt.

Introduction

Sebastian Rassmann and co-authors argue in 2025 that plain regression beats fancy generation for medical image translation. Generative models can invent details and copy noise, which is risky in medicine. Their framework, YODA, reuses a diffusion model but samples it differently.

Standard diffusion sampling rebuilds noise along with the image. Averaging many samples cancels that noise, and the team calls this expectation-approximation sampling. Their regression variant keeps the model's first prediction and skips all refinement steps. Across five datasets, including brain MRI and pelvis MRI-CT pairs, the single-step version matched or beat full sampling. It also beat eight rival methods while running far faster.

Catalog record

CREATORSebastian Rassmann, David Kügler, Christian Ewert, Martin Reuter
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-02048

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Regression is all you need for medical image translation Sebastian Rassmann, David Kügler, Christian Ewert, Martin Reuter Abstract While Generative Adversarial Nets (GANs) and Diffusion Models (DMs) have achieved impressive results in natural image synthesis, their core strengths – creativity and realism – can be detrimental in medical applications, where accuracy and fidelity are paramount. These models instead risk introducing hallucinations and replication of unwanted acquisition noise. Here, we propose YODA (You Only Denoise once – or Average), a 2.5D diffusion-based framework for medical image translation (MIT). Consistent with DM theory, we find that conventional diffusion sampling stochastically replicates noise. To mitigate this, we draw and average multiple samples, akin to physical signal averaging. As this effectively approximates the DM’s expected value, we term this Expectation-Approximation (ExpA) sampling. We additionally propose regression sampling YODA , which retains the initial DM prediction and omits iterative refinement to produce noise-free images in a single step. Across five diverse multi-modal datasets – including multi-contrast brain MRI and pelvic MRI-CT – we demonstrate that regression sampling is not only substantially more efficient but also matches or exceeds image quality of full diffusion sampling even with ExpA. Our results reveal that iterative refinement solely enhances perceptual realism without benefiting information translation, which we confirm in relevant downstream tasks. YODA outperforms eight state-of-the-art DMs and GANs and challenges the presumed superiority of DMs and GANs over computationally cheap regression models for high-quality MIT. Furthermore, we show that YODA -translated images are interchangeable with, or even superior to, physical acquisitions for several medical applications. I Introduction The ability to learn complex, multi-modal distributions has made Generative Adversarial Nets (GANs) [ 1 , 2 ] and, more recently, Diffusion Models (DMs) [ 3 , 4 , 5 ] dominant paradigms in natural image generation. These models excel at generating highly realistic textures and visually compelling images [ 6 , 7 , 8 , 9 , 10 ] , also leading to their increasing adoption in medical image generation tasks [ 11 , 12 ] . In medical image translation (MIT), the goal is often to generate synthetic but complementary target modalities from acquired source scans, e.g., to retrospectively augment datasets or accelerate imaging protocols by removing redundancy to reduce the acquisition time. A typical example in brain MRI is the acquisition of T2 fluid-attenuated inversion recovery (FLAIR), widely used to detect white matter hyperintensities (WMHs), a biomarker for various neurological conditions [ 13 , 14 ] . However, due to the inherently slow inversion recovery, FLAIR is often acquired at low resolution [ 15 , 16 , 17 ] or omitted entirely [ 18 ] . Thus, MIT offers a compelling way to synthesize such costly or missing sequences. Consequently, MIT has become an active research area focused on GANs [ 19 , 20 , 21 , 22 , 23 , 24 , 25 ] and more recently DMs [ 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 ] . DMs have shown strong performance, often attributed to their explicit likelihood estimation [ 28 , 29 ] , iterative refinement [ 28 ] , and the non-deterministic sampling process that is suggested to quantify uncertainty [ 34 , 36 ] . Yet, an important distinction must be made between image-to-image (I2I) tasks for natural and medical images (Fig. 1 a,b) . Whereas natural image generation typically aims to generate realistic and pleasing images from weak conditioning , medical images are acquired for the accurate depiction of medically relevant information. This demands strong conditioning to preserve underlying anatomical or pathological content, whereas perceptual quality and visual realism become irrelevant, provided that biomarkers and pathologies are faithfully represented . Moreover, acquisition noise is a well-known challenge in medical imaging [ 37 , 38 , 39 ] . Models like GANs and DMs, celebrated for reproducing fine-grained textures and high perceptual quality [ 9 , 6 ] , often risk replicating this noise or hallucinating structures, which in a medical context can cause misleading or even harmful outputs and conclusions. Hallucinations may lead to false findings, while deliberately reproducing noise opposes established efforts of noise suppression during acquisition [ 37 , 16 ] . Therefore, MIT methods must prioritize accurate information fidelity over visual realism. The sole objective should be to minimize distortion [ 40 ] , avoid hallucinations, and suppress noise, ensuring that the generated images remain diagnostically reliable and suitable for downstream analysis. In contrast to GANs and DMs, Regression Models (RMs) are trained with pixel-wise regression losses (e.g., minimum mean-squared-error, MMSE, models) [ 41 , 42 , 43 , 40 ] and approximate the expected value of the data distribution rather than stochastically sampling from a learned probability distribution like DMs and GANs (Fig. 1 a) . Thus, RMs do not replicate non-deterministic image features such as noise [ 44 , 6 ] . However, their outputs often appear overly smooth [ 40 , 45 , 9 , 46 , 47 , 2 , 6 ] , which may introduce a visual domain shift from acquired images and has been suggested impact clinical utility [ 36 ] . Also, using synthetic scintigraphy data, Li et al. [ 48 ] found that noise removal can improve measured image quality in terms of SSIM and PSNR, while still destroying information. Thus, assessing the actual contained medical information is critical when evaluating MIT results. Here, we present a systematic comparison of RMs and DMs for MIT. To this end, we propose YODA (You Only Denoise Once - or Average), a novel 2.5D diffusion-based framework operating in uncompressed pixel space and designed as a general-purpose solution for volumetric medical I2I tasks. While YODA is trained as a DM, it also supports regression sampling by directly using the initial prediction without iterative refinement – enabling a noise-free, single-step alternative to traditional diffusion sampling. To systematically compare traditional diffusion sampling, which stochastically replicates noise, and noise-free single-step regression sampling, we introduce Expectation-Approximation (ExpA) sampling (Fig. 1 e) . Inspired by signal averaging in physical MRI acquisition, ExpA draws and averages multiple diffusion samples to suppress stochastic noise, effectively approximating the model’s expected value. Hence, ExpA de-biases the quality assessment of realistic but inherently noisy diffusion -generated images compared to smooth regression images, providing a principled method to navigate the perception-distortion tradeoff [ 40 ] . To rigorously evaluate the medical information in generated images, we extend standard assessment protocols by incorporating medically meaningful downstream tasks. In extensive experiments across five large-scale datasets – the Rhineland Study (RS) [ 16 ] with external evaluation on the MindBodyBrain study (MBB) [ 49 ] , BraTS [ 17 , 50 , 51 ] and IXI for multi-contrast brain MRI, as well as the Gold Atlas comprising pelvic MRI and CT [ 52 ] – we find no systematic advantage of DMs over RMs in translating relevant medical information. Notably, our results reveal that superior perceptual realism of DMs is largely driven by their replication of acquisition noise, rather than improvements in medically-relevant accuracy. This suggests that, in the context of MIT, DMs incur significant computational costs merely to simulate noise. However, noise-free outputs which are preferred

Read the complete text