Imitation learning for clinical decision support in pediatric ECMO

Fateme Golivand Darvishvand, Michael Skinner, Saurabh Mathur, Ameet Soni, Phillip Reeder, Kristian Kersting, Lakshmi Raman, Sriraam Natarajan · 2026

Read Imitation learning for clinical decision support in pediatric ECMO by Fateme Golivand Darvishvand, Michael Skinner, Saurabh Mathur, Ameet Soni, Phillip Reeder, Kristian Kersting, Lakshmi Raman, Sriraam Natarajan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16175.txt.

Introduction

Golivand and seven colleagues use imitation learning for decision help in pediatric ECMO care, a high-stakes setting with tangled, scarce data. They frame the task as learning action models from seen patient paths, even though the actions themselves are not directly seen. TabPFN, a transformer for tabular data, beat XGBoost and multilayer perceptron baselines on real pediatric ECMO data in every test. It thus offers a strong clinician-behaviour baseline for ECMO decision help.

Catalog record

CREATORFateme Golivand Darvishvand, Michael Skinner, Saurabh Mathur, Ameet Soni, Phillip Reeder, Kristian Kersting, Lakshmi Raman, Sriraam Natarajan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24570
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16175

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Imitation learning for clinical decision support in pediatric ECMO Thanks: We acknowledge support from NIH award R01NS133142 Fateme Golivand Darvishvand, Michael Skinner, Saurabh Mathur, Ameet Soni, Phillip Reeder, Kristian Kersting, Lakshmi Raman, Sriraam Natarajan Abstract Pediatric critical care is a dynamic, high-stakes process involving constant monitoring and adjustments in life-saving treatments. Modeling these interventions is crucial for effective decision support. To address the challenges of high complexity and data scarcity in pediatric Extracorporeal Membrane Oxygenation (ECMO), we frame clinical decision-making as learning to act from trajectories, i.e., imitation learning that learns action models from observational data, with a key feature that actions are not directly observed. We consider TabPFN, a recent transformer-based approach for tabular data, and traditional baselines including XGBoost and Multi-Layer Perceptrons (MLPs) on real-world pediatric ECMO data to learn the action models. We find that the TabPFN-based approach consistently outperforms these classical baselines, supporting its use as a strong clinician-behavior baseline for pediatric ECMO decision support. 1 Introduction Generative AI has made significant progress in the past few years and has been widely adopted for prediction tasks [ 11 , 13 ] . While previously it was acknowledged that these methods do not handle tabular data such as EHRs well, recent work in this direction has made crucial progress [ 5 ] . However, their use in modeling policies, such as choosing a sequence of actions, remains relatively unexplored. In high-stakes settings such as ICUs, there is a need to make decisions sequentially and continuously. We explore the problem of “learning to act” by observing physicians in a pediatric Extracorporeal Membrane Oxygenation (ECMO) unit. This problem is particularly challenging for several reasons – (1) The time between actions is irregular; (2) The action space is concurrent as several parameters could be changed simultaneously; (3) A large action space; (4) A large number of observations (actions) for a small number of patients, i.e., imbalance of the features vs examples; (5) Finally, there is no explicit reward signal and one has to infer the success of a trajectory based on the patient outcome. To address these challenges, we model the learning to act problem as “imitation learning” where the AI agent observes a sequence of events and learns a policy (a mapping from observations to actions). While imitation learning has been extensively researched [ 6 , 9 ] , it has not been considered for learning to act in pediatric ECMO treatment or similar contexts, posing the challenges outlined above. We consider three different types of learners -- multilayer perceptron, gradient-boosting, and the more recent tabular foundation model. We evaluate these models as Imitation Learning baselines for sequential clinical decision support from offline trajectories, and empirically find the tabular foundation model to be a particularly strong clinician-behavior model in this setting. Our empirical evaluation demonstrates that imitation learning holds promise for this challenging data as a tool for clinical decision support 1 1 1 Code is available at https://github.com/fateme-gd/ImitationLearning_ECMO.git . The rest of the paper is organized as follows: after presenting the necessary background on the problem and the data, we outline our key contribution of imitation learning when learning to act in pediatric ECMO. We present details of the proposed framework before performing qualitative and quantitative evaluations on ECMO data. Finally, we conclude by discussing the findings and outlining areas of future research. 2 Extracorporeal Membrane Oxygenation (ECMO) Extracorporeal Membrane Oxygenation (ECMO) [ 7 ] is a method for supporting severely ill patients with cardiac or respiratory failure. Managing an ECMO circuit requires clinicians to make continuous, high-stakes adjustments to machine parameters like gas flow and oxygen concentration. Moreover, these decisions must be made based on rapidly shifting physiological signals. Despite the critical nature of these decisions, there is a lack of automated decision support tools for this domain, especially for pediatric patients. Developing effective decision support in this domain is challenging due to several factors in addition to the ones mentioned above. First, the lack of complete and formalized knowledge about pediatric ECMO limits the efficacy of model construction. Second, gaps in domain knowledge cannot be filled through the gold standard of hypothesis testing since evaluating new strategies directly on live patients is ethically and practically unfeasible in a critical care setting. In the next section, we present our approach to take the first step in building a decision support system for this challenging task. 3 Learning to act in Pediatric ECMO We now present our framework for learning treatment policies by identifying patterns in expert behavior from historical data. At a high level, we formalize this task as follows: Given: An observational dataset of pediatric ECMO patient trajectories. Task: Obtain a distribution over a treatment plan (i.e., a policy) that imitates clinician behavior. We solve the problem using the framework of Imitation Learning (IL) [ 6 ] . Unlike standard reinforcement learning [ 12 ] , which requires active environmental interaction, a process that is ethically and practically impossible in a pediatric ICU, offline IL allows us to exploit expert demonstrations already present in historical clinical records. We first formalize the problem by defining the trajectory as a sequence of patient states and clinician actions . A state is, formally, a snapshot of the world – the current observations on the ECMO machine, i.e., the values of the parameters that are being monitored along with the general state of the patient. As mentioned earlier, interventions are not explicitly timestamped in the raw dataset. Hence, it is necessary to infer them from observations. As illustrated in Figure 1 , we define actions in terms of special control variables as a change exceeding a physician-defined threshold. For example, if we find that over a time interval the patient exhibits an increase in arterial P \text{O}_{2} from 50mmHg to 100mmHg, we infer that the clinician has acted to effect this observed physiologic change. Finally, we consider three different methods for learning action models. In addition to the classical methods, we consider a new transformer-based Prior-Data Fitted Network (TabPFN [ 5 , 3 , 4 ] ) method. Figure 1 : Pipeline for Learning Clinical Behavior from Unlabeled ECMO Trajectories. (Left) Raw physiologic telemetry is processed into discrete action labels using physician-defined thresholds (e.g., \Delta SpO_{2}>5\% ). (Right) These discovered actions formulate an imitation learning task: predicting clinician “knob” adjustments from patient state. 3.1 Defining States and Actions We formalize the observational trajectories as a sequence of tuples (s_{t},a_{t}). Modeling of pediatric ECMO interventions requires a high-dimensional representation of both the patient’s condition (the state) and the clinician’s response (the action). Physicians monitor multiple clinical features of the patient, providing critical indicators of their health. These physiological features include hemodynamics, gas exchange metrics, and laboratory test results. These values describe the overall physiological state at time t and are represented as s_{t}=(s_{t}^{1},\dots,s_{t}^{N}) . In addition to monitoring, physicians adjust several treatment components to maintain stability. We refer to these as actionable features , detailed in Table 1 . As a result, the intervention at time t is multi-dimensional a_{t}=(a_{t}^{1},\dots,a_{t}^{M}) , where each a_{t}^{k} corresponds to an adjustment on one specific component (a “knob”). Since raw clinical records do not contain explicit labels for these multi-dimensional interventions, we derive them using

Read the complete text