Dementia-R1: Reinforced Pretraining and Reasoning from Unstructured Clinical Notes for Real-World Dementia Prognosis

Choonghan Kim, Hyunmin Hwang, Hangeol Chang, Jaemin Kim, Jinse Park, Jae-Sung Lim, Jong Chul Ye · 2026

Read Dementia-R1: Reinforced Pretraining and Reasoning from Unstructured Clinical Notes for Real-World Dementia Prognosis by Choonghan Kim, Hyunmin Hwang, Hangeol Chang, Jaemin Kim, Jinse Park, Jae-Sung Lim, Jong Chul Ye (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03018.txt.

Introduction

Choonghan Kim and six co-authors build Dementia-R1, a language model system that forecasts dementia from unstructured clinical notes. Predicting decline is hard because symptoms unfold unevenly across many visits, and plain supervised training has no labels for how symptoms evolve. Direct reinforcement learning also struggles, since its reward is a sparse yes-or-no outcome.

The framework first pre-trains the model to predict checkable clinical indices pulled from patient histories, a cold start that teaches it to reason about disease progression. Only then does it learn to decide the final clinical status. On a real-world hospital cohort the system beat models up to ten times larger, and it also generalized to Parkinson's disease dementia in a separate hospital's data.

Catalog record

CREATORChoonghan Kim, Hyunmin Hwang, Hangeol Chang, Jaemin Kim, Jinse Park, Jae-Sung Lim, Jong Chul Ye
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-03018

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dementia-R1: Reinforced Pretraining and Reasoning from Unstructured Clinical Notes for Real-World Dementia Prognosis Choonghan Kim, Hyunmin Hwang, Hangeol Chang, Jaemin Kim, Jinse Park, Jae-Sung Lim, Jong Chul Ye Abstract While Large Language Models (LLMs) have shown strong performance on clinical text understanding, they struggle with longitudinal prediction tasks such as dementia prognosis, which require reasoning over complex, non-monotonic symptom trajectories across multiple visits. Standard supervised training lacks explicit annotations for symptom evolution, while direct Reinforcement Learning (RL) is hindered by sparse binary rewards. To address this challenge, we introduce Dementia-R1 , an RL-based framework for longitudinal dementia prognosis from unstructured clinical notes. Our approach adopts a Cold-Start RL strategy that pre-trains the model to predict verifiable clinical indices extracted from patient histories, enhancing the capability to reason about disease progression before determining the final clinical status. Extensive experiments demonstrate that Dementia-R1 achieves an F1 score of 77.03% on real-world unstructured clinical datasets. Notably, on the ADNI benchmark, our 7B model rivals GPT-4o, effectively capturing fluctuating cognitive trajectories. Code is available at https://anonymous.4open.science/r/dementiar1-CDB5 . 1 Introduction Figure 1: Multi-dimensional Performance Profile. Dementia-R1 demonstrates a consistent and balanced performance gain across all dimensions, including intermediate clinical reasoning tasks (e.g., MMSE, CDR-SB, ADAS-Cog) and the final dementia prognosis (F1-score) The digitalization of healthcare and the widespread adoption of Electronic Health Records (EHRs) have resulted in massive amounts of longitudinal patient data that capture individuals’ clinical histories across months or years. However, approximately 80% of EHR data is recorded as unstructured text, including physician notes and imaging reports 14 ; 9 . These narratives contain rich descriptions of symptom evolution and clinical assessments, yet temporal changes are often documented implicitly rather than in structured form. Since many clinical outcomes are defined retrospectively based on how a patient’s condition evolves over time, effective modeling requires longitudinal analysis rather than reliance on information from a single visit. Despite this need, most existing longitudinal disease modeling frameworks are designed for structured data representations and therefore struggle to systematically incorporate unstructured clinical narratives 27 ; 24 ; 21 . Recent advances in Large Language Models (LLMs) have demonstrated strong capabilities in understanding unstructured medical text for clinical decision support 26 ; 22 . In particular, LLM-based methods achieve impressive performance on static, snapshot-style benchmarks such as MedQA 11 , where inputs represent isolated clinical scenarios 23 . However, such benchmarks largely ignore longitudinal disease progression. This limitation is critical for diseases characterized by slow and cumulative progression, such as dementia, where diagnosis requires integrating evidence of cognitive and functional decline across multiple clinical encounters 7 ; 1 ; 13 . Crucially, these trajectories are often non-monotonic; clinical status may fluctuate or temporarily improve, necessitating a holistic evaluation of the patient’s condition rather than simple onset detection. In real-world practice, these longitudinal signals are predominantly documented in unstructured clinical notes rather than standardized fields, making dementia a particularly challenging testbed for longitudinal reasoning over clinical text 15 . To address this challenge, we introduce Dementia-R1 , a framework designed for longitudinal reasoning using LLMs through Reinforcement Learning (RL). We focus on dementia prognosis as a representative task of complex longitudinal disease progression. Unlike acute diseases, dementia diagnosis requires tracking longitudinal cognitive and functional changes over months or years. These signals are described in clinical narratives, yet they are difficult to quantify explicitly 1 ; 13 . While standard Supervised Fine-Tuning (SFT) optimizes models to directly predict final labels, RL-based fine-tuning enables the model to learn reasoning processes before making a prediction 4 ; 20 , making it a natural fit for longitudinal clinical inference. However, directly applying RL to a high-level binary prognosis task (e.g., Dementia vs. Non-Dementia) is challenging due to the sparsity of the reward signal and the implicit nature of the underlying reasoning. We address this issue through a Cold-Start RL strategy with verifiable clinical rewards. Prior work typically relies on SFT to introduce step-wise rationales explicitly 2 ; 4 . However, in the context of dementia prognosis, constructing rational trajectories is particularly challenging. Longitudinal reasoning requires temporally consistent analysis across multiple visits and substantial effort from clinical experts to validate them 15 . To mitigate these challenges, we adopt an RL-based pre-training stage using clinically established indices as reward signals rather than explicit reasoning annotations. Specifically, we train the model to predict scores measured at each visit, such as the Mini-Mental State Examination (MMSE) 5 , Global Deterioration Scale (GDS) 19 , and Clinical Dementia Rating (CDR) 18 . By inferring these indices from longitudinal unstructured notes, the model autonomously acquires essential reasoning primitives, which are subsequently refined in a second stage for the final dementia prediction task. We validate our approach on both real-world unstructured clinical notes from the Asan Medical Center (AMC) real-world cohort and the structured benchmark (ADNI) 8 . As illustrated in Figure 1 , our model demonstrates comprehensive multi-dimensional reasoning capabilities compared to baselines. Our contributions are as follows: • We propose Dementia-R1, an RL-based framework that enables explicit temporal reasoning on unstructured clinical notes to predict dementia prognosis. • We introduce a Cold-Start RL method using verifiable rewards, demonstrating that learning to estimate intermediate clinical scores is crucial for an accurate dementia prognosis. • We validate our approach on both private real-world unstructured datasets and a public structured benchmark, demonstrating consistent improvements over the strong baselines, including general-purpose LLMs and medical-specialized reasoning models. Figure 2: Overview of the Dementia-R1 Framework. The pipeline consists of two phases: Stage 1: Cold-Start Pre-training , where the base model learns longitudinal reasoning via GRPO on forecasting tasks; and Stage 2: Task Fine-tuning , where the reasoning-aligned model is adapted for the final dementia prediction task. 2 Related Work Longitudinal Clinical Modeling. Traditional approaches for longitudinal disease modeling have primarily focused on structured electronic health records (EHRs), utilizing Recurrent Neural Networks (RNNs) to process temporal sequences of medical codes 3 . Recent Transformer-based models have advanced longitudinal forecasting by leveraging large-scale structured records for tasks such as time-to-events prediction 24 , disease trajectory modeling 21 , and medical events modeling 27 . While these models show effectiveness for structured data, they fail to capture the nuanced behavioral and symptomatic descriptions found in unstructured clinical notes, which constitute the majority of EHR data. Recent works such as NYUTron 10 and CARE-AD 17 have demonstrated the potential of LLMs for longitudinal prediction using unstructured clinical text. However, these approaches primarily optimize for final clinical outcomes and do not explicitly train models to reason over intermediate disease trajectories or temporal progression patterns. As a result, current frameworks for unstructured clinical text still lack mechanisms for explicit longitudinal reasoning 16 , motivating our approach. Reasoning Capabilities of Medical LLMs. The reasoning capabilities of LLMs in the medical domain have been largely enhanced through Chain-of-Thought (CoT) prompting, which encourages models to generate intermediate rationales 28 . HuatuoGPT-o1 2 further improves medical reasoning by combining Supervised Fine-Tuning (SFT) on reasoning trajectories with Reinforcement Learning (RL). In the general domain, recent advances have shifted from SFT to RL with Verifiable Rewards (RLVR), demonstrating that models can learn reasoning when the reward is easily verifiable 4 . However, applying this paradigm to clinical tasks remains challenging due to the sparsity of the

Read the complete text