FgC2F-UDiff: Frequency-guided and Coarse-to-fine Unified Diffusion Model for Multi-modality Missing MRI Synthesis

Xiaojiao Xiao, Qinmin Vivian Hu, Guanghui Wang · 2025

Read FgC2F-UDiff: Frequency-guided and Coarse-to-fine Unified Diffusion Model for Multi-modality Missing MRI Synthesis by Xiaojiao Xiao, Qinmin Vivian Hu, Guanghui Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-03526.txt.

Introduction

Xiaojiao Xiao and two co-authors propose in 2025 a unified diffusion model that synthesizes whichever MRI scan types a patient is missing. Brain tumor care leans on several MRI contrasts, but scans go missing through time limits, motion, or contrast intolerance. Earlier synthesis tools generalized poorly and ran slowly.

Their model denoises in two passes, coarse then fine, to keep anatomy faithful from global shape down to detail. Frequency cues guide the learning of the tangled mapping between scan types. A hybrid speed-up mechanism trims the diffusion cost. One model handling many input-output combinations could spare patients repeat scans and keep tumor assessments complete when the scanner session falls short.

Catalog record

CREATORXiaojiao Xiao, Qinmin Vivian Hu, Guanghui Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-03526

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FgC2F-UDiff: Frequency-guided and Coarse-to-fine Unified Diffusion Model for Multi-modality Missing MRI Synthesis Xiaojiao Xiao, Qinmin Vivian Hu, Guanghui Wang Abstract Multi-modality magnetic resonance imaging (MRI) is essential for the diagnosis and treatment of brain tumors. However, missing modalities are commonly observed due to limitations in scan time, scan corruption, artifacts, motion, and contrast agent intolerance. Synthesis of missing MRI has been a means to address the limitations of modality insufficiency in clinical practice and research. However, there are still some challenges, such as poor generalization, inaccurate non-linear mapping, and slow processing speeds. To address the aforementioned issues, we propose a novel unified synthesis model, the Frequency-guided and Coarse-to-fine Unified Diffusion Model (FgC2F-UDiff) , designed for multiple inputs and outputs. Specifically, the Coarse-to-fine Unified Network (CUN) fully exploits the iterative denoising properties of diffusion models, from global to detail, by dividing the denoising process into two stages—coarse and fine—to enhance the fidelity of synthesized images. Secondly, the Frequency-guided Collaborative Strategy (FCS) harnesses appropriate frequency information as prior knowledge to guide the learning of a unified, highly non-linear mapping. Thirdly, the Specific-acceleration Hybrid Mechanism (SHM) integrates specific mechanisms to accelerate the diffusion model and enhance the feasibility of many-to-many synthesis. Extensive experimental evaluations have demonstrated that our proposed FgC2F-UDiff model achieves superior performance on two datasets, validated through a comprehensive assessment that includes both qualitative observations and quantitative metrics, such as PSNR SSIM, LPIPS, and FID. The source code is available at https://github.com/xiaojiao929/FgC2F-UDiff . I Introduction Multi-modality magnetic resonance imaging (MRI), encompassing T1, T2, FLAIR, and T1 contrast-enhanced (T1ce) sequences, is indispensable for the diagnosis, monitoring, and treatment of brain tumors, as it provides complementary information about tissue views and spatial details [ 1 , 2 , 3 ] . As shown in Fig. 1 , T1 images provide anatomical structure, FLAIR highlights the entire tumor region, T2 delineates a clear outline of the tumor edema area, and T1ce depicts a clear boundary of enhanced areas. However, the absence of modalities across different clinical centers is unavoidable [ 4 ] . Furthermore, modalities are often missing due to limitations in scan time, scan corruption, artifacts, motion, and contrast agent intolerance [ 5 , 6 ] . These factors restrict the ubiquity of multi-modality, adversely affecting various downstream tasks such as segmentation, detection, and quantification. Consequently, the synthesis of missing multi-modality MRI has garnered increasing research interest as a means to overcome the limitations of modality insufficiency in clinical practice and research. Fig. 1: Different image modalities provide different types of tissue contrast views and spatial resolution, which has variety in the histogram. In recent years, numerous studies have provided evidence of the effectiveness of deep learning in synthesizing missing modality [ 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 ] . Task-specific models, including one-to-one and many-to-one, focus on learning individual non-linear mappings from source to target imaging modalities, neglecting unique information present in shared features. These limitations can compromise synthesis performance and fail to meet the clinical needs for multi-modality applications. GAN-based methods utilize adversarial losses to better capture organizational structure and further enhance synthesis quality. Moreover, some unified method of GAN-based achieves many-to-many synthesis [ 16 , 17 , 18 ] to address the limitation of one modality synthesis. However, GAN-based methods suffer from mode collapse, non-convergence, instability, and high sensibility to hyperparameters [ 19 , 20 ] . Denoising diffusion probabilistic models (DDPM) may stably generate high-quality dependable images to improve MRI synthesis as a promising alternative to GAN [ 21 ] . Diffusion models show superiority in a wide variety of areas, ranging from generative modeling tasks (e.g., image generation [ 22 ] , image super-resolution [ 23 , 24 , 25 ] ) to discriminative tasks (e.g., image segmentation [ 26 , 27 ] , classification [ 28 , 29 ] , and anomaly detection [ 30 , 31 ] ) while reducing risk of modality collapse. The work [ 32 ] proposed a conditioned latent diffusion model for many-to-one synthesis, which preserves anatomical structure with accelerated sampling. However, only learning the mapping of a single task (i.e., many to one) is unable to meet clinical needs for multi-modality. And, the long time steps (t=1000) are unable to solve the slow sampling problem of DDPM [ 33 ] . Besides, significant challenges persist that limit the widespread application of existing methods: 1) Lack of an effective unified model to synthesize high-fidelity images from many to many. The existing methods suffer from poor generalization ability for atypical anatomical features, which limits the fidelity of synthesis, especially details. 2) Lack of effective strategy to guide the learning of unified highly non-linear mapping between multi-modality MRI. During the iterative denoising process, the randomness of noise alters the original distribution of the target image [ 34 ] . During the iterative denoising process, the randomness of the noise changes the original distribution of the target image. Therefore, the learned nonlinear mapping relationships are unable to accurately reflect the consistency of anatomical structures. 3) Lack of feasibility of many-to-many because of the slow sampling problem of DDPM. Motivation : To address the above-mentioned challenges, we propose a unified diffusion model, the Frequency-guided and Coarse-to-fine Unified Diffusion Model (FgC2F-UDiff) to synthesize the missing modality for multiple inputs and outputs. Our key hypothesis is to decompose the frequency domain into low-high-frequency as guidance information in coarse-to-fine stages based on the iterative denoising properties of diffusion models. Specifically, FgC2F-UDiff relies primarily on low-frequency with global anatomical features to guide coarse denoising and subsequently performs fine denoising progress guided by high-frequency with texture and detail. FgC2F-UDiff enables the effective synthesis of target modalities with high fidelity from any combination of modalities. Coarse-to-fine Unified Network (CUN) fully utilizes iterative denoising properties of diffusion model (global-to-detail), novelty dividing the denoising process into two stages (i.e., coarse-to-fine) to improve the fidelity of denoised images. Moreover, CUN based on the diffusion model provides an effective unified program for cross-modality missing synthesis of multiple inputs and outputs. Frequency-guided Collaborative Strategy (FCS) guides the learning of accurate non-linear mapping by enhancing the diversity of prior knowledge. Specifically, inspired by image signals, we incorporate low-frequency with global anatomical features in the early stages of coarse denoising and introduce high-frequency information with local fine-grained (i.e., texture and details) in the later stages of fine denoising. Therefore, frequency domain information of different granularity is decomposed and used to guide denoising collaboratively as prior knowledge, so the synthesized image has diverse features and similar edge and detail characteristics to the real image. At the same time, novel strategies were designed to dynamically search for appropriate frequency domain information to maximize the information of available modalities. Specific-acceleration Hybrid Mechanism (SHM) is designed for specific tasks to accelerate the diffusion model and improve the fidelity of synthesized images. First, the curriculum learning (CL) mechanism is employed to simulate the easy-to-hard learning of missing modalities. Second, the network divided into two coarse-to-fine phases fits the iterative denoising properties of diffusion models, thus accelerating the synthesis process from the whole image to the details. Finally, dynamically selecting constraint conditions of frequency ensures the maximization of information from available modalities, guaranteeing the

Read the complete text