PRISM: A Transformer-based Language Model of Structured Clinical Event Data

Lionel Levine MS, Dr. John Santerre, Dr. Alex S. Young MD, Dr. T. Barry Levine MD, Dr. Francis Campion MD, Dr. Majid Sarrafzadeh · 2025

Read PRISM: A Transformer-based Language Model of Structured Clinical Event Data by Lionel Levine MS, Dr. John Santerre, Dr. Alex S. Young MD, Dr. T. Barry Levine MD, Dr. Francis Campion MD, Dr. Majid Sarrafzadeh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-11082.txt.

Introduction

Lionel Levine and co-authors built a language model for health care in 2025 that reads a patient's care as a chain of events. Most tools judge one test or one diagnosis at a time, apart from the full course of care.

Their model, called PRISM, turns tests, lab results, and diagnoses into a sequence of tokens and learns to predict the next step. It beat random baselines by a wide margin on next step prediction. The paths it produced looked like real clinical paths, with tests and orders in a sensible order. The authors see uses in decision support, training, and practice runs for students learning how care unfolds.

Catalog record

CREATORLionel Levine MS, Dr. John Santerre, Dr. Alex S. Young MD, Dr. T. Barry Levine MD, Dr. Francis Campion MD, Dr. Majid Sarrafzadeh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-11082

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PRISM: A Transformer-based Language Model of Structured Clinical Event Data Lionel Levine MS, Dr. John Santerre, Dr. Alex S. Young MD, Dr. T. Barry Levine MD, Dr. Francis Campion MD, Dr. Majid Sarrafzadeh Abstract We introduce PRISM (Predictive Reasoning in Sequential Medicine), a transformer-based architecture designed to model the sequential progression of clinical decision-making processes. Unlike traditional approaches that rely on isolated diagnostic classification, PRISM frames clinical trajectories as tokenized sequences of events — including diagnostic tests, laboratory results, and diagnoses — and learns to predict the most probable next steps in the patient diagnostic journey. Leveraging a large custom clinical vocabulary and an autoregressive training objective, PRISM demonstrates the ability to capture complex dependencies across longitudinal patient timelines. Experimental results show substantial improvements over random baselines in next-token prediction tasks, with generated sequences reflecting realistic diagnostic pathways, laboratory result progressions, and clinician ordering behaviors. These findings highlight the feasibility of applying generative language modeling techniques to structured medical event data, enabling applications in clinical decision support, simulation, and education. PRISM establishes a foundation for future advancements in sequence-based healthcare modeling, bridging the gap between machine learning architectures and real-world diagnostic reasoning. I Introduction Accurate and timely clinical decision-making is fundamental to high-quality patient care. Traditionally, efforts to model diagnostic processes have relied on static classification frameworks, treating patient data as unordered feature sets aimed at predicting singular outcomes. However, real-world clinical reasoning unfolds dynamically: tests are ordered, results are evaluated, and diagnoses are formed through sequential, context-dependent decision-making processes. [ 8 ] To better capture this inherent structure, we propose PRISM (Predictive Reasoning in Sequential Medicine), a transformer-based framework that models clinical workups as tokenized sequences of events. Inspired by autoregressive language modeling, PRISM learns to predict the next likely diagnostic clinical action — whether a diagnostic test, laboratory result, or diagnosis — based on the evolving context of a patient’s diagnostic timeline. By framing medical decision-making as a sequential generation problem, PRISM moves beyond outcome classification to simulate the dynamic reasoning patterns exhibited by clinicians. Leveraging a customized clinical vocabulary and training on structured event data, PRISM demonstrates the ability to internalize complex patterns in diagnostic workflows. Early experimental results indicate that PRISM can accurately predict future clinical events across diverse patient trajectories, suggesting potential applications in clinical decision support, anomaly detection, workflow optimization, and medical education. This work establishes a foundational step toward generative modeling of healthcare processes, highlighting the power of modern transformer architectures to emulate aspects of clinical reasoning at scale. II Background II-A Limits of Probabilistic Diagnostic Testing While Bayesian methods provide a mathematically rigorous framework for updating disease probabilities based on diagnostic tests, they (BLANK: struggle with higher order correlations between tests and the specific diagnoses.) often rely on pairwise likelihoods—probabilities that relate specific tests individually to specific diagnoses. Although individually these probabilities can be empirically accurate and useful, real-world diagnostic situations frequently involve multiple overlapping comorbidities, complex interactions between test outcomes, and numerous patient-specific confounding variables and specific histories. Early computerized diagnostic aids such as QMR‑DT relied on expert rules and Bayesian reasoning, but they covered fewer than 600 diseases and required years of manual curation. [ 6 ] . Yet even painstakingly curated models like the QMR-DT, their performance degrades when the model is deployed in a new hospital whose disease prevalence and practice patterns differ from the original cohort. [ 9 ] Moreover, classical Bayesian networks are brittle at run time: they do not adapt gracefully when previously unseen evidence types or updated laboratory ranges are introduced. More fundamentally, when multiple factors coexist, the assumption of conditional independence—often a critical prerequisite for practical Bayesian calculations—breaks down. The intricate interdependencies among symptoms, test results, and diseases in an individual patient’s unique clinical context make it computationally infeasible, and often conceptually inaccurate, to comprehensively enumerate and correctly weigh all conditional probabilities. Consequently, Bayesian approaches become limited in their ability to faithfully represent realistic uncertainty, since accurately calculating a truly reflective posterior probability distribution across all potential combinations of conditions and outcomes quickly becomes impossible. Therefore, relying solely on Bayesian statistical modeling to drive diagnostic decision-making risks oversimplifying patient-level complexity. II-B Elaborating the Analogy Between Diagnostic Systems and LLM Token Prediction In language models (LLMs), each token—representing a word or sub-word unit—has clear pairwise probabilities relative to other tokens. For example, given a token such as ”New,” the subsequent token might have high probability for ”York,” ”Zealand,” or ”Jersey.” Individually, these pairwise probabilities are straightforward. However, as the sequence of tokens expands—considering an entire preceding sentence or paragraph—the combinatorial complexity and contextual dependencies make it impossible to precisely calculate probabilities using first order correlations alone. Hence, deep learning and attention mechanisms in transformer architectures (like GPT) approximate these complex conditional dependencies, capturing long-range contexts and intricate relationships between tokens. By analogy, diagnostic medicine faces a similar complexity. Individual diagnostic tests may exhibit well-defined pairwise probabilities for specific diseases—just as pairwise token probabilities can be well-established. However, when attempting to predict the next best test or disease diagnosis given the entire preceding sequence (the patient’s complete history, including medical tests, symptoms, prior diagnoses, lifestyle factors, and comorbidities), the scenario becomes profoundly more complex. The interactions between these elements are intricate, context-dependent, and frequently nonlinear, making exact probabilistic inference practically infeasible. Thus, Bayesian statistical approaches quickly reach limitations. Transformer-based diagnostic models, analogous to language models, can approximate the complex contextual dependencies inherent in patient histories, making them potentially more capable of accurately predicting subsequent medical events (tests, results, or diagnoses). These models implicitly learn from data to reflect patient-level complexity more naturally, offering both predictive capability and interpretable attention scores to highlight influential factors in diagnostic reasoning. II-C Prior Work in Transformer and Deep Learning Models for Sequential Clinical Diagnosis In contrast to high-level summations of pre-existing efforts, which are considerable and highly varied in nature, the authors here opt to focus in on prior work of immediate relevance to our proposed approach, by zeroing in on a methodology-specific approaches that have informed our own experimental design, and serve as a basis for which our work attempts to build on. II-C 1 Tokenization and Representation of Medical Data The first step in adapting transformer models to diagnostic-sequence prediction is to convert a patient’s richly structured history into a sequence of discrete tokens . Early work relied on standardised vocabularies such as ICD-9/ICD-10, CPT and Read codes, treating each code as an individual token [ 5 , 1 ] . A coarser alternative aggregates thousands of raw codes into a few hundred clinically coherent groups, reducing sequence length while retaining clinical meaning [ 5 ] . More granular pipelines tokenise free-text concepts, symptoms and history fragments extracted from clinical narratives [ 3 ] . The ETHOS framework extend this idea further by encompassing: admissions, diagnoses (ICD-10-CM), procedures (ICD-10-PCS), medications (ATC), laboratory results (LOINC) and even inter-event time gaps. Under the ETHOS framework, these events are mapped to 1–7 tokens each, then ordered chronologically into a patient-health timeline (PHT) [ 2 ] . Because multiple events can occur simultaneously during a visit, several authors represent a patient record as a sequence of sets , forcing the model to be order-invariant within each set. DPSS is the canonical

Read the complete text