Diffusion with a Linguistic Compass: Steering the Generation of Clinically Plausible Future sMRI Representations for Early MCI Conversion Prediction

Zhihao Tang, Chaozhuo Li, Litian Zhang, Xi Zhang · 2025

Read Diffusion with a Linguistic Compass: Steering the Generation of Clinically Plausible Future sMRI Representations for Early MCI Conversion Prediction by Zhihao Tang, Chaozhuo Li, Litian Zhang, Xi Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-05428.txt.

Introduction

Zhihao Tang, Chaozhuo Li, Litian Zhang, and Xi Zhang proposed MCI-Diff in 2025 to predict early which people with mild memory trouble will go on to develop worse disease. A single brain scan at the start is fast but less accurate. Waiting for later scans shows the change but delays the call.

Their method uses a diffusion model to create plausible future scan features from the first scan alone. Training covered both filling gaps and extending forward in time. A fine-tuned language model then acts as a guide, scoring candidate features against expected signs of disease to keep them realistic. On two cohorts, the method beat leading rivals on early prediction accuracy.

Catalog record

CREATORZhihao Tang, Chaozhuo Li, Litian Zhang, Xi Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-05428

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Diffusion with a Linguistic Compass: Steering the Generation of Clinically Plausible Future sMRI Representations for Early MCI Conversion Prediction Zhihao Tang, Chaozhuo Li, Litian Zhang, Xi Zhang Abstract Early prediction of Mild Cognitive Impairment (MCI) conversion is hampered by a trade-off between immediacy—making fast predictions from a single baseline sMRI—and accuracy—leveraging longitudinal scans to capture disease progression. We propose MCI-Diff, a diffusion-based framework that synthesizes clinically plausible future sMRI representations directly from baseline data, achieving both real-time risk assessment and high predictive performance. First, a multi-task sequence reconstruction strategy trains a shared denoising network on interpolation and extrapolation tasks to handle irregular follow-up sampling and learn robust latent trajectories. Second, an LLM-driven “linguistic compass” is introduced for clinical plausibility sampling: generated feature candidates are quantized, tokenized, and scored by a fine-tuned language model conditioned on expected structural biomarkers, guiding autoregressive generation toward realistic disease patterns. Experiments on ADNI and AIBL cohorts show that MCI-Diff outperforms state-of-the-art baselines, improving early conversion accuracy by 5–12%. 1 Introduction The prediction of MCI (Mild Cognitive Impairment) conversion aims to forecast the clinical trajectory of individuals diagnosed with MCI 2006mci ; ADsurvey ; Fan2022CancerSP ; so5 ; so6 . MCI patients typically exhibit two progression patterns: a subset may deteriorate into progressive MCI (pMCI), while others remain clinically stable (sMCI) mci2 . Accurate classification of patients into pMCI or sMCI subgroups has significant implications for personalized treatment planning and improved clinical trial stratification mci ; augdiff ; deepmcisurvey . Conventional models for predicting MCI conversion primarily rely on Structural Magnetic Resonance Imaging (sMRI) data, as sMRI captures nuanced patterns of neural alterations associated with brain structural changes. Existing sMRI-based models can be broadly categorized into two types: cross-sectional and longitudinal methods deepmcisurvey ; so1 ; so2 ; so3 ; so4 . Cross-sectional models generate predictions from a single baseline sMRI scan obtained at the initial timepoint MPS-FFA ; HFCN ; DA-MIL ; guan2021domain ; so7 , whereas longitudinal approaches utilize serial sMRI scans acquired at multiple follow-up intervals to model temporal dynamics in brain morphology 2023vggts ; wang2018temporal ; RNNMCI ; mri3 ; mri4 . Despite advancements in existing models, a fundamental trade-off persists: the inherent trade-off between prediction immediacy and accuracy. Immediacy quantifies the latency between data acquisition and actionable predictions, while accuracy reflects the effectiveness in capturing ground-truth outcomes. As illustrated in Fig. 1 (a), cross-sectional methods leverage only a baseline sMRI scan (e.g., at 0 months), enabling rapid predictions (high immediacy). However, their reliance on a single timepoint restricts access to temporal dynamics, resulting in suboptimal accuracy due to limited anatomical context and absence of disease progression signals. For instance, Fig. 1 (b) demonstrates that HFCN HFCN trained solely on 0-month sMRIs underperforms its longitudinal counterpart (integrating sMRIs from 0–36 months) on the ADNI dataset Vaswani2017AttentionIA ; so8 . Conversely, longitudinal methods exploit serial imaging data to capture temporal trajectories, thereby enhancing accuracy. Yet, their dependency on historical scans (e.g., 36-month follow-ups) inherently compromises immediacy, delaying predictions until sufficient longitudinal data is acquired. Figure 1: Comparison of MCI Conversion Prediction Models and Performance. (a) Schematics illustrate the input sMRI data for cross-sectional (baseline), longitudinal (0 to 36 months), and our generated longitudinal-like feature approaches, highlighting their implications for prediction immediacy and accuracy. (b) Accuracy of these three approaches over a 36-month prediction window. Here comes a novel question: Can we leverage the merits of both approaches to achieve a win-win balance between immediacy and accuracy? In contrast to cross-sectional models (which lack temporal dynamics) and longitudinal models (which suffer from delayed predictions), our goal is to learn informative longitudinal features derived from baseline sMRI scans as complementary data. As illustrated in Fig. 1 (a), by generating latent longitudinal trajectories from a single baseline scan, our proposal enables accurate predictions at the earliest time point while eliminating the latency inherent in longitudinal data acquisition. This generation-based paradigm, relying exclusively on baseline sMRI, is expected to deliver predictive performance comparable to longitudinal methods while retaining the critical advantage of real-time risk assessment. However, effectively generating realistic longitudinal sMRI sequences that accurately reflect the subtle and heterogeneous progression in MCI patients remains a significant challenge. First, accurately modeling the complex distribution of longitudinal sMRI sequences is difficult for existing generative models. For example, GAN-based models goodfellow2020generative often face instability issues, while VAE-based models may suffer from posterior collapse VAE . Second, the high dimensionality and intricate spatial correlations in sMRI data challenge traditional generative models due to their limited capacity for high-dimensional representation frisoni2010clinical . Such limitations restrict the ability of conventional generative models to capture nuanced MCI progression patterns. To address these challenges, we propose a diffusion-based framework for generating realistic longitudinal sMRI sequences. Leveraging its stable denoising process to learn complex data distributions croitoru2023diffusion , the diffusion model could effectively capture the subtle and heterogeneous progression within sequences. To mitigate computational complexity, we focus on synthesizing low-dimensional feature representations of future scans. However, directly applying vanilla denoising diffusion models to our task is undesirable. First, the irregular temporal sampling inherent in longitudinal MCI studies conflicts with the uniform time-step assumption of standard diffusion architectures. This mismatch impairs modeling of complex progression trajectories, particularly when handling missing intermediate or terminal time points. Second, autoregressive generation risks compounding errors over time. Even minor deviations from actual neurodegeneration patterns which exacerbated by uneven time intervals may snowball across predictions, reducing conversion accuracy. In this paper, we propose MCI-Diffusion ( MCI-Diff ), a novel framework for generating clinically plausible future sMRI representations to predict early MCI conversion. MCI-Diff employs two key strategies: Multi-task Sequence Reconstruction Training and LLM-driven Clinical Plausibility Sampling . The former tackles the irregular temporal sampling by training a shared denoising network conditioned on task-specific information to perform both interpolation and extrapolation, effectively learning to handle non-uniform time steps. The latter mitigates error compounding in autoregressive future sMRI generation by using an LLM to iteratively score and select plausible outputs based on expected progression, thereby guiding the generation towards clinically coherent trajectories. By leveraging baseline sMRIs to predict future representations, MCI-Diff enables early and accurate MCI conversion prediction. We evaluate MCI-Diff on two real-world datasets, demonstrating its effectiveness in generating longitudinal MRI sequences and improving early prediction accuracy. In summary, our contributions are as follows: First, to our knowledge, this work is the first to leverage diffusion models for synthesizing future MRI representations specifically aimed at enhancing early MCI conversion prediction. Second, we introduce MCI-Diff, a novel framework employing multi-task sequence reconstruction training and LLM-driven clinical plausibility sampling to address the challenges of irregular temporal sampling and error compounding in generating future sMRI representations. Finally, extensive experiments on two widely adopted real-world datasets demonstrate that MCI-Diff generates clinically plausible longitudinal MRI representations and achieves improved accuracy in early MCI conversion prediction compared to existing methods. 2 Problem Setup 2.1 Definition of Longitudinal sMRI Data and MCI Conversion Outcome Consider a cohort of MCI individuals \mathcal{P}=\{p_{1},\ldots,p_{|\mathcal{P}|}\} , where each individual p has a baseline sMRI X_{0}^{(p)}\in\mathcal{X} and a conversion label Y^{(p)}\in\{\mathrm{pMCI,sMCI}\} . In the context of longitudinal analysis (even though our goal is to avoid relying on it directly for prediction), each MCI patient p is scheduled for sMRI scans at fixed time points \mathcal{T}=\{0,6,12,18,24,36\}\,\text{months}

Read the complete text