PORTER: Language-Grounded Event Representations for Portable Structured EHR Foundation Models
Lin Lawrence Guo, Adam Paul Yan, Emily Vettese, Lillian Sung · 2026
Read PORTER: Language-Grounded Event Representations for Portable Structured EHR Foundation Models by Lin Lawrence Guo, Adam Paul Yan, Emily Vettese, Lillian Sung (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24102.txt.
Introduction
Guo and colleagues make prediction models for medicine portable between hospitals. Events are described in words instead of fixed codes. Most models for electronic health records encode each event as a token from a fixed vocabulary. An unseen diagnosis, or a new mix of traits, then cannot be represented at all. Their 2026 model, PORTER, frees event representation from any one hospital's code list.
Events enter through their text descriptions, encoded by a frozen language model. Numeric values travel a dedicated path. A temporal backbone, pretrained autoregressively over patient timelines, learns how conditions evolve. Across dozens of prediction tasks at a children's hospital, PORTER matches a fixed-vocabulary model with the same backbone. When timelines are rewritten with descriptions never seen in pretraining, PORTER transfers with no retraining. It recovers nearly all of the directly trained model's discrimination. That addresses a real barrier to sharing clinical AI between sites.
Catalog record
| CREATOR | Lin Lawrence Guo, Adam Paul Yan, Emily Vettese, Lillian Sung |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.24102
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PORTER: Language-Grounded Event Representations for Portable Structured EHR Foundation Models Lin Lawrence Guo, Adam Paul Yan, Emily Vettese, Lillian Sung Abstract Most electronic health record (EHR) foundation models encode clinical events as discrete event tokens from a fixed vocabulary and therefore cannot directly represent events containing unseen concepts or new combinations of concepts and attributes such as numeric values. This limits transfer across institutions and even across deployment pipelines within the same institution. We introduce PORTER (Portable EHR Representations), a language-grounded structured EHR foundation model that decouples event representation from this fixed vocabulary. PORTER represents events through their descriptions using a frozen text encoder, integrates numeric values through a dedicated pathway, and learns clinical dynamics over patient timelines with an autoregressively pretrained temporal backbone. Across 74 clinical prediction tasks at a pediatric hospital, PORTER matched the mean area-under-the-receiver-operating-characteristic curve (AUROC) of a fixed-vocabulary model with the same temporal backbone and pretraining objective. When the same patient timelines were rendered using event descriptions not seen during pretraining, PORTER transferred without retraining or vocabulary mapping, recovering 97.1% of the mean AUROC of a model trained directly on the target vocabulary. When transferred to MIMIC, PORTER outperformed the fixed-vocabulary model, which dropped 69% of events because their tokens were unseen. Mechanistic analyses showed cross-vocabulary transfer tracked preservation of patient-level representation geometry rather than the scale of the text encoder, and the numeric pathway improved sensitivity to magnitude without disrupting clinical concept identity. PORTER also achieved higher AUROC than a task-specific text serialization comparator, at 329-fold lower amortized compute. PORTER is a step toward vocabulary-independent EHR foundation models that reduce the need for vocabulary harmonization while preserving in-domain performance and enabling efficient cross-task reuse. 1 INTRODUCTION Structured electronic health record (EHR) foundation models learn reusable patient representations through self-supervised pretraining on longitudinal sequences of clinical events. [ 39 , 36 , 44 , 34 , 38 , 37 , 8 , 31 ] Each event is a timestamped occurrence of a clinical concept, such as a diagnosis or laboratory result, and may include structured attributes such as numeric values. These models have demonstrated robustness under temporal dataset shift [ 15 ] and transfer across populations [ 26 ] and institutions [ 14 ] , although such transfer generally assumes that evaluation data can be encoded using event-token representations learned during pretraining. In practice, the codes and descriptions used to represent clinical events vary across institutions, coding standards, and data pipelines. Most structured EHR foundation models convert each clinical event into a discrete event token from a fixed vocabulary learned during pretraining. [ 12 ] These tokens may represent a clinical concept alone or a composite of the clinical concept and structured attributes, such as a discretized numeric bin. [ 11 ] When deployment data include new clinical concepts, different local codes or names for the same concepts, or new concept-attribute combinations, those events produce tokens for which the model has no learned representation. Even within a single institution, models may be developed using retrospective datasets mapped to common data models such as the Observational Medical Outcomes Partnership Common Data Model (OMOP CDM), then deployed using production feeds with different local codes or naming conventions. Therefore, vocabulary shift can arise even when the patient population and clinical setting remain the same. A portable structured EHR foundation model must preserve the meaning of a clinical event even when that event is described using different codes or descriptions. Standard vocabularies and common data models reduce this heterogeneity, but mapping to them is labor-intensive, error-prone, and does not eliminate differences in concept coverage or local implementation. Numeric values introduce a second representation challenge. For measurement events, the clinical concept identifies what was measured, while the numeric value and reference range determine magnitude and abnormality. A portable model must therefore represent both concept semantics and numeric values without tying either to a fixed token vocabulary. Text-based representations have emerged as a way to reduce the dependence of structured EHR models on fixed vocabularies and manual harmonization. One line of work serializes patient timelines into natural language and uses a large language model or text encoder to produce patient-level representations. [ 7 , 17 , 9 ] This approach avoids a fixed event-token vocabulary, but requires the model to infer concept semantics, temporal relationships, and numeric meaning from the serialized text. [ 6 ] When serialization is task-specific, patient representations must also be recomputed for each downstream task. A second line of work operates at the code or event level by representing clinical concepts through their descriptions or by learning aligned code representations across sites. [ 25 , 20 , 48 , 2 , 21 , 19 ] These methods have shown that text-based code or event representations can improve portability across vocabularies, schemas, institutions, and languages. They differ in whether the text encoder is frozen or updated during training, which determines how much an event description's representation is shaped by the training vocabulary. A frozen pretrained encoder applies the same semantic mapping to descriptions from any vocabulary, including vocabularies not seen during training, without modifying model weights [ 25 ] . Some also use self-supervised objectives, but as initialization for supervised fine-tuning rather than to learn task-agnostic patient representations reused across downstream tasks. [ 21 ] Across existing frameworks, numeric values are commonly discarded, rendered as text, discretized, or represented through token-level schemes. Existing approaches therefore have not fully combined vocabulary-independent inputs, autoregressive pretraining for reusable task-agnostic patient representations, and explicit representation of numeric values within a single structured EHR foundation model (Supplementary Table S1). We introduce PORTER (Portable EHR Representations), a language-grounded structured EHR foundation model that separates concept semantics, numeric values, and temporal dynamics into distinct components. Rather than serializing full patient histories into text, PORTER applies language grounding at the clinical event level. Each event is paired with a natural-language description of its underlying clinical concept, which is processed by a frozen text encoder to provide vocabulary-independent concept representations. Because this text encoder is applied once per unique event description rather than repeatedly across patient histories, these representations can be cached and reused across patients and downstream tasks. For events containing numeric values, a separate learned pathway encodes numeric magnitude and relative abnormality directly, rather than rendering numeric values as text. Feature-wise linear modulation (FiLM) [ 33 ] then uses this numeric information to modulate the text-derived concept representation and produce the event input representation. Finally, a temporal backbone learns clinical dynamics from sequences of these event input representations through autoregressive pretraining. After pretraining, the backbone is frozen and produces reusable patient representations that downstream tasks use through linear probes. At inference, PORTER can represent clinical concepts from vocabularies not seen during pretraining without retraining or explicit vocabulary mapping, provided they can be rendered as interpretable event descriptions. We evaluate PORTER across three settings using a fixed-vocabulary EHR foundation model (Fixed-Vocab FM) matched on backbone architecture, pretraining objective, and training schedule as the primary comparator. First, we test whether PORTER matches Fixed-Vocab FM in-domain across 74 clinical prediction tasks. Second, we evaluate cross-vocabulary transfer within the same institution by applying pretrained PORTER to patient timelines where event descriptions are derived from institutional EHR terminology rather than