Uncertainty-Guided Latent Diagnostic Trajectory Learning for Sequential Clinical Diagnosis

Xuyang Shen, Haoran Liu, Dongjin Song, Martin Renqiang Min · 2026

Read Uncertainty-Guided Latent Diagnostic Trajectory Learning for Sequential Clinical Diagnosis by Xuyang Shen, Haoran Liu, Dongjin Song, Martin Renqiang Min (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05116.txt.

Introduction

Shen and three co-authors formulate clinical diagnosis as latent path learning under uncertainty. Diagnosis requires evidence collection. Yet most systems assume observed patient information and do not model how evidence should be acquired over time. Even when it is framed as a decision process, learning trajectories stays challenging. The space of paths is large, while clinical datasets rarely provide clear guidance for good paths. Their framework uses a language-model agent and a choice model to learn trajectories that gather evidence before committing to an answer.

Catalog record

CREATORXuyang Shen, Haoran Liu, Dongjin Song, Martin Renqiang Min
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43336
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.05116

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Uncertainty-Guided Latent Diagnostic Trajectory Learning for Sequential Clinical Diagnosis Xuyang Shen, Haoran Liu, Dongjin Song, Martin Renqiang Min Abstract Clinical diagnosis requires sequential evidence acquisition under uncertainty. However, most Large Language Model (LLM) based diagnostic systems assume fully observed patient information and therefore do not explicitly model how clinical evidence should be sequentially acquired over time. Even when diagnosis is formulated as a sequential decision process, it is still challenging to learn effective diagnostic trajectories. This is because the space of possible evidence-acquisition paths is relatively large, while clinical datasets rarely provide explicit supervision information for desirable diagnostic paths. To this end, we formulate sequential diagnosis as a Latent Diagnostic Trajectory Learning (LDTL) framework based on a planning LLM agent and a diagnostic LLM agent. For the diagnostic LLM agent, diagnostic action sequences are treated as latent paths and we introduce a posterior distribution that prioritizes trajectories providing more diagnostic information. The planning LLM agent is then trained to follow this distribution, encouraging coherent diagnostic trajectories that progressively reduce uncertainty. Experiments on the MIMIC-CDM benchmark demonstrate that our proposed LDTL framework outperforms existing baselines in diagnostic accuracy under a sequential clinical diagnosis setting, while requiring fewer diagnostic tests. Furthermore, ablation studies highlight the critical role of trajectory-level posterior alignment in achieving these improvements. 1 Introduction Accurate and timely diagnosis is a fundamental and sequential process in clinical practice. In real-world clinical settings, when a patient was admitted to a hospital, clinicians seldom can obtain all necessary patient information at once. Instead, they typically start with partially observed information such as symptoms and medical history, and sequentially decide which examinations, laboratory tests, or imaging studies to order in the next step. Each newly acquired result will help refine the clinicians’ hypothesis and progressively reduces uncertainty until sufficient confidence is reached for a final diagnosis decision. A concrete real-world example of the sequential clinical diagnosis system is shown in Figure 1 . Throughout this process, physicians must balance diagnostic accuracy with constraints of time, cost, and patient burden, making test selection a key part of clinical decision-making ( 28 ) . Figure 1: An real-world example of the sequential clinical diagnosis system. Recent advances in LLMs have demonstrated their strong capabilities in medical reasoning and diagnosis ( 23 ; 6 ; 1 ; 36 ) . However, most existing approaches assume a full information setting in which all structured and unstructured patient data (including test results) are available and accessible beforehand ( 35 ; 12 ; 1 ) . This assumption, however, is impractical due to the aforementioned real-world sequential clinical diagnosis process in which clinicians need to determine which tests to be ordered before making a confident diagnosis. Recent benchmarks such as MIMIC-CDM ( 16 ) and interactive diagnostic frameworks like MediQ ( 20 ) begin to model stepwise evidence acquisition, but LLM-based systems still struggle to faithfully reflect practical diagnostic paths without explicit modeling the test-selection process. A natural solution is to frame diagnosis as an iterative agentic process, where a model sequentially selects diagnostic actions and updates its predictions. This perspective is aligned with recent LLM agent frameworks that enable multi-step reasoning and action selection ( 43 ; 34 ; 41 ; 30 ; 42 ; 40 ) . While reinforcement learning has been explored for cost-sensitive test selection ( 44 ; 37 ; 31 ) and hypothesis-driven clinical agents ( 4 ) , reward-driven optimization alone does not provide explicit control over the structure of diagnostic trajectories. In particular, learning purely from terminal rewards does not regulate how diagnostic paths are distributed in the latent reasoning space, and can be unstable in settings where only limited clinical trajectories are available for training. To this end, we present a Latent Diagnostic Trajectory Learning (LDTL) framework for sequential clinical diagnosis. Instead of directly optimizing test-selection policies solely via reward signals, we treat diagnostic test paths as latent variables and explicitly model their role in reducing diagnostic uncertainty. Our proposed LDTL framework consists of two key components: a planning LLM agent that selects the next clinical action based on the current information, and a diagnostic LLM agent that predicts the disease label and produces a calibrated confidence estimate after each step. Diagnosis can terminate early once sufficient confidence is reached. In summary, the main contributions include: • We develop a sequential diagnosis system in which a planning LLM agent selects diagnostic actions while a diagnostic LLM agent continuously updates the predicted label and confidence, enabling adaptive evidence acquisition and early termination once sufficient certainty is reached. This design improves diagnostic efficiency by avoiding unnecessary tests while maintaining predictive accuracy. • We formulate diagnostic test selection as a Latent Diagnostic Trajectory Learning (LDTL) problem and leverage information gain to construct supervision signals based on diagnostic improvement, guiding the planning LLM agent to pursue information-efficient diagnostic paths. • Based on the real-world abdominal diagnosis benchmark MIMIC-CDM ( 16 ) , our proposed LDTL framework outperform existing baselines while substantially reducing the number of required tests. 2 Related Work Recent work has increasingly recognized that evaluating medical language models under full information settings fails to capture the sequential nature of real-world diagnosis. ( 16 ) introduce MIMIC-CDM, a benchmark that simulates stepwise evidence acquisition in abdominal diagnosis. ( 20 ) propose MediQ, framing clinical reasoning as interactive question asking under incomplete information. Other efforts explore multi-agent or consultation style systems for clinical decision-making ( 21 ; 7 ) , emphasizing sequential reasoning and structured collaboration. While these approaches model diagnosis as an interactive process, they do not explicitly regularize the distribution of diagnostic trajectories. In parallel, medical test selection has been studied as a cost sensitive sequential decision problem. Classical reinforcement learning methods ( 24 ) have been applied to optimize diagnostic performance under resource constraints ( 19 ; 44 ; 37 ) , and more recent works investigate RL-based confidence calibration and hypothesis-driven clinical agents ( 3 ; 4 ) . These methods primarily rely on reward optimization or cost and accuracy trade-offs, without imposing structural constraints over latent diagnostic paths. More broadly, general LLM agent frameworks such as ReAct ( 43 ) , Reflexion ( 34 ) , and Chain-of-Thought prompting ( 41 ) demonstrate the effectiveness of multi-step reasoning and tool use ( 30 ; 42 ) . However, these approaches focus on improving reasoning capability rather than modeling how uncertainty influences test selection in clinical workflows 15 ; 10 ; 11 . Finally, variational latent variable modeling ( 18 ; 29 ; 5 ) provides principled tools for structured latent representations, but has not been explicitly connected to sequential diagnostic planning 8 . 3 Methodology 3.1 Problem Statement We formulate this clinical diagnosis as a sequential decision-making problem under partially observed information. For each patient, the initial observation is an incomplete clinical history h_{0} , including symptoms and background information. At each step, the model may select a diagnostic action a_{t}\in\mathcal{A} , where \mathcal{A} denotes the set of available tests or examinations. Executing a_{t} reveals new clinical evidence, which is incorporated into the patient state h_{t+1} , consisting of the initial history together with all acquired test results until t diagnostic steps. The process terminates at a patient-specific stopping time

Read the complete text