Pattern-Aware Diffusion Synthesis of fMRI/dMRI with Tissue and Microstructural Refinement

Xiongri Shen, Jiaqi Wang, Yi Zhong, Zhenxi Song, Member, Leilei Zhao, Yichen Wei, Lingyan Liang, Shuqiang Wang, Senior Member, Baiying Lei, Senior Member, Demao Deng, Zhiguo Zhang, Member · 2025

Read Pattern-Aware Diffusion Synthesis of fMRI/dMRI with Tissue and Microstructural Refinement by Xiongri Shen, Jiaqi Wang, Yi Zhong, Zhenxi Song, Member, Leilei Zhao, Yichen Wei, Lingyan Liang, Shuqiang Wang, Senior Member, Baiying Lei, Senior Member, Demao Deng, Zhiguo Zhang, Member (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04963.txt.

Introduction

Xiongri Shen and co-authors propose PDS, a diffusion method that can create one kind of brain scan from another. Clinics use both functional and diffusion MRI to study brain disease, but one type is often missing for a patient.

PDS learns across the two modes with a pattern-aware design, then refines tissue and fine structure to keep scans true. The signal styles of the two modes differ a lot, which made past attempts weak. On three data sets, the method tops prior work on both scan types, with clear gains in standard quality scores.

Catalog record

CREATORXiongri Shen, Jiaqi Wang, Yi Zhong, Zhenxi Song, Member, Leilei Zhao, Yichen Wei, Lingyan Liang, Shuqiang Wang, Senior Member, Baiying Lei, Senior Member, Demao Deng, Zhiguo Zhang, Member
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-04963

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Pattern-Aware Diffusion Synthesis of fMRI/dMRI with Tissue and Microstructural Refinement Xiongri Shen, Jiaqi Wang, Yi Zhong, Zhenxi Song, Member, Leilei Zhao, Yichen Wei, Lingyan Liang, Shuqiang Wang, Senior Member, Baiying Lei, Senior Member, Demao Deng, Zhiguo Zhang, Member Abstract Magnetic resonance imaging (MRI), especially functional MRI (fMRI) and diffusion MRI (dMRI), is essential for studying neurodegenerative diseases. However, missing modalities pose a major barrier to their clinical use. Although GAN- and diffusion model-based approaches have shown some promise in modality completion, they remain limited in fMRI-dMRI synthesis due to (1) significant BOLD vs. diffusion-weighted signal differences between fMRI and dMRI in time/gradient axis, and (2) inadequate integration of disease-related neuroanatomical patterns during generation. To address these challenges, we propose PDS, introducing two key innovations: (1) a pattern-aware dual-modal 3D diffusion framework for cross-modality learning, and (2) a tissue refinement network integrated with a efficient microstructure refinement to maintain structural fidelity and fine details. Evaluated on OASIS-3, ADNI, and in-house datasets, our method achieves state-of-the-art results, with PSNR/SSIM scores of 29.83 dB/90.84% for fMRI synthesis (+1.54 dB/+4.12% over baselines) and 30.00 dB/77.55% for dMRI synthesis (+1.02 dB/+2.2%). In clinical validation, the synthesized data show strong diagnostic performance, achieving 67.92%/66.02%/64.15% accuracy (NC vs. MCI vs. AD) in hybrid real-synthetic experiments. Code is available in PDS GitHub Repository I Introduction Magnetic Resonance Imaging (MRI) has transformed medical diagnosis by enabling non-invasive visualization of anatomical structures with high soft tissue contrast. Two specialized MRI techniques have further advanced neuroimaging: functional MRI (fMRI) captures blood oxygen level-dependent (BOLD) signals to measure brain functions, while diffusion magnetic resonance imaging (dMRI) maps white matter integrity through water diffusion [ 11 , 25 , 17 , 1 , 34 ] . However, incompatible echo planar imaging (EPI) sequences of fMRI and dMRI prevent their concurrent acquisition, often resulting in missing modalities in clinical practice. This sequential MRI scanning approach increases costs, examination duration, and motion artifacts — limitations particularly challenging in resource-constrained settings. Cross-modal synthesis offers a promising solution by computationally generating missing MRI modalities from existing ones, enabling complete diagnostic information while addressing acquisition constraints [ 26 , 40 ] . fMRI and dMRI are 4D data with time/gradient axis, however, they lack of the implicit relationship in time/gradient axis . Therefore, using 3D cross-modal synthesis approach for mean data is more robust and resonable. 3D data is also critical for computing imaging biomarkers (e.g., ROI signals) [ 31 , 3 ] . While existing synthesis methods based on the U-Net family (UF), they fail to bridge fundamental 3D MRI modality gaps [ 35 , 33 ] . Specifically, current approaches overlook divergence between fMRI and dMRI, and ignore disease semantics. U-Net generates images through direct transformation, but is limited by its representation capabilities. Generative adversarial networks (GANs) and diffusion models (DMs) have emerged as two leading approaches for medical image synthesis, with GANs leveraging adversarial training and DMs employing iterative denoising to generate medical images (including neuroimages) [ 8 , 4 , 39 ] . GAN variants, such as self-attention GAN (SA-GAN) [ 44 ] , perceptual GAN (pGAN) [ 18 ] , etc., establish cross-modal mappings via adversarial training between generators and discriminators. While effective for 2D data, GAN variants struggle with 3D cross-modal MRI synthesis, often experiencing model collapse due to the heterogeneity and inherent sparsity between 3D source and target domains (fMRI or dMRI ) [ 20 , 36 , 12 ] . Fig. 1: We divide the uneven time axis into N segments to align the temporal/gradient dimensions between fMRI and dMRI. Then, to implement the cross-modal fMRI/DTI synthesis, we employ the pattern-aware dual-modal diffusion model (PDM), tissue refinement (TR), and microstructure refinement (MR) to improve the image quality and clinical applicability. DMs employ a unique generation paradigm that reconstructs data through Markov chain-based iterative denoising of corrupted inputs. Although it shows a stronger theoretical robustness than GAN in 2D image synthesis, their noise estimation strategy does not scale effectively for 3D volumes that exhibit amplified fMRI/dMRI heterogeneity [ 29 , 28 , 13 ] , leading to a poorer performance in 3D neuroimage synthesis compared to GAN-based architectures in some scenario (3D fMRI/dMRI synthesis, e.g.) [ 15 ] . However, two key challenges remain for both GAN- and DM-based fMRI/dMRI synthesis approaches. (1) BOLD vs. diffusion-weighted signal difference : it is challenging to bridge the substantial discrepancy between fMRI-derived BOLD and dMRI’s microstructural diffusion properties [ 24 ] . This multidimensional challenge encompasses both spatial discordance (voxel-level heterogeneity) and functional mismatch (neurophysiological-process decoupling), resulting in compromised semantic accuracy, tissue specificity, and microstructural fidelity in synthesized neuroimages. (2) Semantic dissociation : current fMRI/dMRI synthesis approaches primarily focus on image-level fidelity while overlooking disease-specific semantics and diagnostic relevance [ 45 ] . This oversight means that synthesized neuroimages, while visually plausible, may not capture subtle pathological features critical for disease diagnosis. Consequently, the clinical utility of these synthetic images remains limited, as they may fail to reflect the distinctive neural signatures of various conditions. To address these challenges, we incorporate disease semantics (patterns) into neuroimaging synthesis, using anatomical atlases to identify multimodal neural markers in fMRI/dMRI. These markers show coupling in cognitive impair disease due to disrupted functional-structural relationships, a key factor overlooked by conventional 3D diffusion models. We embed disease semantics as denoising priors, conditioning diffusion steps on atlas-derived correlations from NC/MCI/AD cohorts, ensuring synthetic data reflect pathological truths and bridge fMRI-dMRI discrepancies. Additionally, tissue and microstructure refinement modules reduce spatial blurring and improve biophysical consistency. The resulting P attern-aware D iffusion S ynthesis ( PDS ) overcomes 3D cross-modal synthesis limitations while preserving diagnostic relevance. Our key contributions include: • Pattern-aware Dual-modal 3D Diffusion Model. We condition disease semantic estimation during the denoising steps of a dual-modal diffusion model on paired 3D source-target modalities (e.g., fMRI→dMRI as well as dMRI→fMRI). This directly mitigates the 3D cross-modal domain gap that causes feature misalignment in conventional diffusion models, enhancing disease semantic details in the generated fMRI and dMRI. • Tissue and Efficient Microstructure Refinements. We introduce (1) Tissue Refinement : A projection network with learnable neuroanatomical priors that mitigates spatial blurring caused by noise estimation in the dual-modal diffusion model; (2) Efficent Microstructure Refinement : A parameter-efficient module that computes and reduces microstructure-perception feature discrepancies between synthesized and real neuroimaging across axial/coronal/sagittal planes. • Comprehensive Experiments. Our synthetic fMRI and dMRI achieve SOTA 3D image fidelity (SSIM=0.908/0.902/0.923 on three datasets: OASIS-3/ADNI/self-collected) while demonstrating clinical efficacy through improved cognitive decline disease classification accuracy (67.92%/66.02%/64.15%), enhanced inter-class discrimination in dual-modal feature space and higher-quality ROI signals. II Related Work fMRI/dMRI Synthesis. Clinical MRI often lacks certain modalities due to cost, safety, and time constraints, especially between sequences with different EPI protocols (e.g., fMRI vs. dMRI) [ 3 ] . While existing synthesis methods based on the UF, they fail to bridge fundamental 3D MRI modality gaps [ 35 , 33 ] . Specifically, current approaches overlook divergence between fMRI and dMRI, and ignore disease semantics. Generative Methods in MRI and Medical Image Synthesis. Three major generative architectures in medical image synthesis are the U-Net family (UF) [ 14 ] , GAN family (DF) [ 38 , 42 , 43 ] , and diffusion model family

Read the complete text