Accurate and Interpretable Postmenstrual Age Prediction via Multimodal Large Language Model

Qifan Chen, Jin Cui, Cindy Duan, Yushuo Han, Yifei Shi · 2025

Read Accurate and Interpretable Postmenstrual Age Prediction via Multimodal Large Language Model by Qifan Chen, Jin Cui, Cindy Duan, Yushuo Han, Yifei Shi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02525.txt.

Introduction

Qifan Chen and co-authors present a 2025 arXiv paper on predicting a newborn's postmenstrual age from brain scans with a language model that can explain itself. Age at scan guides judgments of infant development, and plain deep models predict it well but silently. The team fine-tuned a vision-language model on four flat maps of the cortex surface, using light training methods.

Training prompts cast the task as number prediction; test prompts ask for clinical explanations. The tuned model missed by roughly a week on average, with a tight error band, and its explanations cited real developmental features. The authors offer the design as a step toward transparent perinatal tools.

Catalog record

CREATORQifan Chen, Jin Cui, Cindy Duan, Yushuo Han, Yifei Shi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-02525

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Accurate and Interpretable Postmenstrual Age Prediction via Multimodal Large Language Model Qifan Chen, Jin Cui, Cindy Duan, Yushuo Han, Yifei Shi Abstract Accurate estimation of postmenstrual age (PMA) at scan is crucial for assessing neonatal development and health. While deep learning models have achieved high accuracy in predicting PMA at scan from brain MRI, they often function as "black boxes", offering limited transparency and interpretability in clinical decision-support. In this work, we address the dual challenge of accuracy and interpretability by adapting a multimodal large language model (MLLM) to perform both precise PMA prediction and clinical-relevant explanation generation. We introduce a parameter-efficient fine-tuning (PEFT) strategy using Instruction Tuning and Low-Rank Adaptation (LoRA) applied to the Qwen2.5-VL-7B model. The model is trained on four 2D cortical surface projection maps derived from neonatal MRI scans. By employing distinct prompts for training and inference, our approach enables the MLLM to handle a regression task during training and generate clinically relevant explanations at inference time. The fine-tuned model achieves a low prediction error (95% CI: 0.78–1.52 weeks) while producing interpretable outputs grounded in developmental features, marking a significant step toward transparent and trustworthy AI systems in perinatal neuroscience. 1 Introduction Postmenstrual age (PMA), defined as the sum of gestational age and postnatal age, provides a biologically meaningful indicator of brain maturation pmadefinition . It plays a crucial role in neurodevelopmental assessment, particularly in preterm and high-risk infants Childs2001 . Accurate estimation of PMA facilitates the interpretation of neuroimaging biomarkers, enables personalized risk stratification, and informs clinical decision-making across critical developmental windows Plaisier2014 . The developing Human Connectome Project (dHCP) has provided an unprecedented open-access dataset of neonatal brain MRI scans, enabling advanced computational analysis of early brain development ref_dhcp . Consequently, various deep learning (DL) methods, particularly Convolutional Neural Networks (CNNs), have been developed to predict PMA at scan from these scans with high accuracy ref_cnn_ga . However, a major limitation of these models is their lack of interpretability. They provide a numerical prediction but offer no insight into which neuroanatomical features informed their decision, hindering clinical trust and adoption. Recently, the advent of Multi-modal Large Language Models (MLLMs) has opened new frontiers in medical image analysis ref_mllm_review . Models like LLaVA-Med ref_llava_med and Med-Gemma sellergren2025medgemma have shown the ability to process and reason about medical images, engaging in complex dialogues. These models present an opportunity to bridge the gap between prediction accuracy and interpretability. However, none of these models were applied to PMA estimation. In this paper, we propose a novel approach to predict PMA at scan from multi-channel 2D MRI projections using a state-of-the-art MLLM, Qwen2.5-VL ref_qwen . Our primary contributions are: • We adapt a general-purpose multimodal large language model (MLLM) to a specialized medical regression task—predicting postmenstrual age (PMA) at scan from four MRI-derived modalities—by employing a parameter-efficient fine-tuning (PEFT) strategy based on Low-Rank Adaptation (LoRA) ref_lora . • We propose a instruction tuning strategy that decouples training and inference objectives, allowing the model to accurately predict postmenstrual age during training and generate zero-shot, clinically grounded explanations at inference based on developmental features extracted from MRI-derived images. • We demonstrate that our approach achieves near state-of-the-art accuracy in postmenstrual age prediction while providing plausible, interpretable clinical explanations, thereby enhancing transparency and building trust in MLLM-based medical decision support for neonatal brain assessment. This is further supported by a user study involving clinical practitioners, confirming the plausibility and utility of the model’s explanations. 2 Methods 2.1 Model Architecture Figure 1: Overview of the proposed framework for postmenstrual age prediction from neonatal brain MRI using parameter-efficient fine-tuning of a vision-language model. 2.1.1 Base Model: Qwen2.5-VL We selected Qwen2.5-VL-7B-Instruct as our base model. It is a powerful MLLM with strong vision and language capabilities, built upon a 7-billion-parameter language model and a sophisticated Vision Transformer (ViT). The model consists of a 32-layer vision transformer encoder, a vision-language merger that projects image features to the LLM input space, and an LLM decoder with 28 transformer layers. The base model is first pre-trained with curated multimodal data, then post-trained with multi-stage instruction fine-tuning. We hence selected Qwen2.5-VL over other MLLMs given its fine-grained multimodal reasoning and strong instruction-following ability. For instance, comparing to LLaVA-Med’s CLIP visual encoder and LLaVA backbone, Qwen2.5-VL’s visual encoder has higher resolution and its language backbone is trained with higher quality and multi-turn data, leading to more precise and coherent responses when following instructions which is critical to our task. 2.1.2 Parameter-Efficient Fine-Tuning with LoRA Fine-tuning a 7-billion-parameter model on the full set of weights is computationally prohibitive and prone to catastrophic forgetting. We employ Parameter-Efficient Fine-Tuning (PEFT) using the Low-Rank Adaptation (LoRA) technique ref_lora . LoRA works by freezing the pre-trained model weights and injecting trainable rank-decomposition matrices into specified layers of the Transformer architecture. For a pre-trained weight matrix W_{0}\in\mathbb{R}^{d\times k} , its update is represented by a low-rank decomposition \Delta W=BA , where B\in\mathbb{R}^{d\times r} , A\in\mathbb{R}^{r\times k} , and the rank r\ll\min(d,k) . During training, only A and B are updated, substantially reducing the number of trainable parameters. The modified forward pass becomes h=W_{0}x+BAx . 2.2 Instruction Tuning for Training and Inference A key innovation of our work is the strategic use of different prompts for training and inference. This allows the model to learn the core regression task efficiently while being able to generate complex explanatory text during evaluation without having seen such explanations during training. 2.2.1 Training Prompt Each training sample is multi-modal and consists of four images and a direct question as input, as well as the ground truth PMA scalar at scan as the "assistant’s" response. The structure is as follows: ⬇ System : You are an expert radiologist . Your task is to predict postmenstrual age at scan . User : < Image 1>< Image 2>< Image 3>< Image 4> Based on these four images , predict the postmenstrual age at scan in weeks . Provide only the numerical value , for example , ’38.5’. Assistant : 41.2 The model’s loss is calculated only on the tokens corresponding to the assistant’s answer (e.g., "41.2"). All preceding tokens from the system and user prompts are masked out and do not contribute to the gradient update. This focuses the learning process entirely on the numerical prediction task. 2.2.2 Inference and Explanation Prompt During validation and inference, we can query the model with a different, more complex prompt. To elicit an explanation, we modify the user’s request: ⬇ System : You are an expert radiologist interpreting neonatal brain MRI scans . User : < Image 1>< Image 2>< Image 3>< Image 4> Based on the provided 2 D projection map ..., please first predict the postmenstrual age at scan ... ( e . g ., ’38.5’). Then , on a new line , provide the primary reason for your age prediction ... Please use the following format for your answer : Predicted Postmenstrual Age at Scan : [ Value ] Explanation : [ Your explanation ] Because the model has been fine-tuned on its instruction-following capabilities (a core strength of the base Qwen model), it can generalize to this new format at inference time. It correctly performs the regression task it was trained for and

Read the complete text