EPPC-OASIS: Ontology-Aware Adaptation and Structured Inference Refinement for Electronic Patient-Provider Communication Mining in Secure Messages
Samah Fodeh, Sreeraj Ramachandran, Elyas Irankhah, Muhammad Arif, Afshan Khan, Ganesh Puthiaraju, Linhai Ma, Srivani Talakokkul, Jordan Alpert, Sarah Schellhorn · 2026
Read EPPC-OASIS: Ontology-Aware Adaptation and Structured Inference Refinement for Electronic Patient-Provider Communication Mining in Secure Messages by Samah Fodeh, Sreeraj Ramachandran, Elyas Irankhah, Muhammad Arif, Afshan Khan, Ganesh Puthiaraju, Linhai Ma, Srivani Talakokkul, Jordan Alpert, Sarah Schellhorn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24172.txt.
Introduction
Fodeh and nine co-authors build EPPC-OASIS for mining secure messages under the Electronic Patient-Provider Communication ontology. Codes must keep fine code and sub-code structure and stay grounded in message text. It pairs fine-tuning with Wasserstein alignment matching model to ontology groups, plus refinement through checks, hybrid fixes, and voting. On a masked corpus, the best pipeline reached about 77 percent Code-plus-Sub-code F1 and about 64 percent Triplet F1, modest gains, though outside checks must come first.
Catalog record
| CREATOR | Samah Fodeh, Sreeraj Ramachandran, Elyas Irankhah, Muhammad Arif, Afshan Khan, Ganesh Puthiaraju, Linhai Ma, Srivani Talakokkul, Jordan Alpert, Sarah Schellhorn |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83399 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.24172
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EPPC-OASIS: Ontology-Aware Adaptation and Structured Inference Refinement for Electronic Patient-Provider Communication Mining in Secure Messages Samah Fodeh, Sreeraj Ramachandran, Elyas Irankhah, Muhammad Arif, Afshan Khan, Ganesh Puthiaraju, Linhai Ma, Srivani Talakokkul, Jordan Alpert, Sarah Schellhorn Abstract Secure patient-provider messages contain clinically important communication behaviors that are difficult to characterize manually at scale. The Electronic Patient-Provider Communication (EPPC) framework provides an ontology for coding these behaviors, but automated extraction remains challenging because predictions must preserve fine-grained code/sub-code structure while grounding annotations in message text. We developed EPPC-OASIS, an ontology-aware adaptation approach for structured EPPC extraction, and combined it with deployable inference-refinement procedures designed to improve the coherence of final annotations. EPPC-OASIS augments supervised fine-tuning with a Wasserstein alignment objective that encourages alignment between model representation neighborhoods and EPPC ontology-derived neighborhoods, while inference refinement uses verification, self-consistency, hybrid correction, and selection or ensembling to address residual prediction errors. We evaluated the framework on a de-identified corpus of secure patient-provider messages against prompting, supervised fine-tuning, preference-based, and robustness-oriented baselines across multiple open-weight language models. Across model families, the best deployable pipeline achieved 77.13% Code+Sub-code F1 and 63.83% Triplet F1, corresponding to modest but consistent absolute gains of +1.39 and +2.12 F1 points over the strongest supervised fine-tuning baseline. These results suggest that ontology-aware adaptation with structured inference refinement can support scalable retrospective EPPC mining, although external validation is needed before operational use. keywords Electronic patient-provider communication ,Secure messaging ,Clinical natural language processing ,Large language models ,Ontology-aware learning ,Structured clinical information extraction † † corresponding: Corresponding author: Samah Fodeh, Yale University, New Haven, CT, USA. 1 Introduction Secure patient-provider messaging has become a routine part of outpatient care, creating a longitudinal record of clinical communication outside the traditional visit encounter [ 3 , 18 ] . These messages contain not only requests for information and clinician responses, but also evidence of care coordination, logistical barriers, emotional concerns, social needs, and shared decision-making [ 26 ] . The Electronic Patient-Provider Communication (EPPC) framework provides a structured way to characterize these communication behaviors [ 10 , 13 , 12 , 11 , 14 ] , but manual EPPC coding is difficult to scale across large message corpora. Reliable automated EPPC extraction could therefore support retrospective communication research, quality measurement, and cohort-level analysis of how patients and care teams exchange information over time [ 1 , 33 , 30 , 35 ] . Automated EPPC extraction is challenging because the task requires more than assigning a single label to a message [ 29 ] . Each prediction must identify the communication behaviors expressed in the text, map them to the appropriate high-level EPPC codes and sub-codes, and provide supporting evidence from the original message [ 8 , 1 ] . These requirements are difficult to satisfy jointly. EPPC labels are hierarchical, imbalanced, and often semantically adjacent, while individual message segments may contain multiple communication behaviors expressed in compact or informal language [ 37 ] . Consequently, model errors are often structured rather than random: a prediction may recover the general communicative intent but choose the wrong sub-code, miss a low-frequency behavior, or assign a correct label while grounding it in incomplete or mismatched evidence [ 16 , 2 ] . Recent work has established EPPC extraction as a benchmark task for evaluating large language models on structured patient-provider communication coding, showing that modern instruction-tuned models can recover clinically meaningful communication behaviors but still struggle with fine-grained labels and evidence grounding [ 10 ] . Related robustness-oriented work has further shown that performance is uneven across difficult or underrepresented portions of the EPPC label space [ 14 ] . Together, these studies motivate the use of LLMs for scalable EPPC mining, while also exposing two methodological gaps. First, standard prompting or supervised fine-tuning treats each target annotation largely as an output sequence, rather than using the EPPC ontology to shape how related examples and labels should be represented during adaptation. Second, inference is commonly treated as a single generation step, even though EPPC errors often separate into label-consistency failures and evidence-grounding failures that may benefit from different correction mechanisms. In this study, we develop and evaluate a two-stage approach for structured EPPC extraction from de-identified patient-provider messages. The first stage, EPPC-OASIS, augments supervised fine-tuning with ontology-aware Wasserstein alignment so that the model is trained not only to reproduce target annotations, but also to align learned representation neighborhoods with neighborhoods implied by the EPPC code and sub-code inventory [ 4 ] . The second stage applies deployable structured inference refinement, using verification, self-consistency, hybrid correction, and selection procedures to address residual errors in label assignment and evidence grounding [ 34 , 32 , 20 ] . We evaluate the approach using deployable Code/Sub-code and triplet-level extraction metrics, with the goal of improving ontology-consistent EPPC mining for retrospective clinical communication research. This study makes four contributions: 1. We introduce EPPC-OASIS, an ontology-aware adaptation method that uses the structure of the EPPC code and sub-code inventory to define a Wasserstein alignment objective during fine-tuning. 2. We develop a structured inference-refinement framework that combines self-verification, self-consistency, hybrid label correction, and deployable selection or ensembling to improve the final structured EPPC annotation set. 3. We evaluate the resulting pipelines against prompting, supervised fine-tuning, preference-based, and robustness-oriented baselines across multiple open-weight model families. 4. We provide ablations and diagnostics that separate the effects of ontology-aware training from inference-time refinement and distinguish deployable pipeline performance from component-wise diagnostic upper bounds. 2 Methods 2.1 Study Design and Setting This study was designed as a retrospective methodological evaluation of automated EPPC extraction from de-identified secure patient-provider messages. Within the EPPC framework, each annotated message segment was treated as a structured communication-coding instance, allowing us to evaluate how well language-model methods could recover ontology-governed communication behaviors from previously coded data. All model development used fixed training data, and final performance was assessed on a held-out test split that was not used for model selection. The study therefore focused on method development and retrospective informatics use, rather than clinical decision support deployment or generation of patient-facing recommendations. Figure 1 presents the overall study workflow, including ontology-aware adaptation, structured inference refinement. 2.2 EPPC Annotation Schema and Prediction Target The present study builds on the EPPC annotation framework by treating each secure-message excerpt as a structured clinical communication coding task. For each instance, the model was given the relevant patient-provider message context and the sentence or message segment to be coded. The expected output was a JSON annotation listing any EPPC categories expressed in that segment. Each annotation included a high-level Code , a more specific Sub-code , and a supporting text Span copied from the original message. The Code and Sub-code identify the communication behavior, while the Span grounds that label in the source text. This formulation preserves the structure of manual EPPC coding while allowing the task to be evaluated as automated structured extraction. To make model outputs comparable with manual annotations, all predictions were evaluated against a common structured schema. A valid response was defined as a JSON object with a results field containing a list of annotations, where each annotation included a Code , Sub-code , and Span . The Code and Sub-code were required to come