A Bayesian Model for Multi-stage Censoring Thanks: Co-last Shuvom Sadhuka, Sophia Lin, Bonnie Berger, Emma Pierson Abstract Many sequential decision settings in healthcare feature funnel structures characterized by a series of stages, such as screenings or evaluations, where the number of patients who advance to each stage progressively decreases and decisions become increasingly costly. For example, an oncologist may first conduct a breast exam, followed by a mammogram for patients with concerning exams, followed by a biopsy for patients with concerning mammograms. A key challenge is that the ground truth outcome, such as the biopsy result, is only revealed at the end of this funnel. The selective censoring of the ground truth can introduce statistical biases in risk estimation, especially in underserved patient groups, whose outcomes are more frequently censored. We develop a Bayesian model for funnel decision structures, drawing from prior work on selective labels and censoring. We first show in synthetic settings that our model is able to recover the true parameters and predict outcomes for censored patients more accurately than baselines. We then apply our model to a dataset of emergency department visits, where in-hospital mortality is observed only for those who are admitted to either the hospital or ICU. We find that there are gender-based differences in hospital and ICU admissions. In particular, our model estimates that the mortality risk threshold to admit women to the ICU is higher for women (5.1%) than for men (4.5%). † † volume: 297 † † year: 2025 † † workshop: Machine Learning for Health (ML4H) 2025 keywords Bayesian modeling, selective labels Data and Code Availability The data used in this study is sourced from the MIMIC-IV database, which requires credentialed access, which is granted after the completion of a data use agreement and required training on data security and patient privacy. Further details on accessing the MIMIC-IV database can be found at this link . We release the code for our Stan model and preprocessing scripts at this link . Institutional Review Board (IRB) Our research does not require IRB approval, as MIMIC contains de-identified patient records. 1 Introduction Many important sequential decision-making settings follow a funnel structure, where each successive stage involves fewer candidates or items yet brings additional information ( 12 ) . For instance, in healthcare, a clinician trying to diagnose a breast cancer may (1) conduct a breast exam, then (2) order a mammogram if the breast exam is concerning, then finally (3) order a biopsy if the mammogram is concerning ( 15 ) . Crucially, fewer patients progress through each successive stage, and the ground truth outcome (biopsy result) is only observed at the final stage of this decision pipeline. Funnel structures are a variant of the selective labels problem. The selective labels problem describes settings in which ground truth outcomes (e.g., disease diagnosis) are censored for a subset of the population as a result of a human decision (e.g., whether to test the patient for the disease). This selective censoring has been studied in healthcare ( 20 ) , lending ( 8 ; 10 ) , and other high-stakes domains ( 17 ) . Figure 1: Mechanics of the model. (Left) At each stage, the decision-maker estimates the mortality risk of a patient, given some covariates (e.g., blood pressure, or BP). If the drawn risk is larger than the threshold to hospitalize (or admit to ICU), the decision-maker moves them onto the appropriate stage. New variables, such as X-rays, may be collected at later stages, which are used to update the decision-maker’s risk estimate. The ground truth is only observed for patients who are admitted to the hospital or ICU. (Right) A graphical representation of the patient flows. At each stage, X represents the set of covariates available (e.g., BP and X-ray), while D is the decision made for that patient at a particular stage (e.g., D_{ED} could be discharge, admit to hospital, or admit to ICU). Y is unobserved for patients discharged from the ED. There are risks in failing to account for this selective censoring. Any models fit only on patients whose ground truth outcomes are observed (e.g., disease diagnosis) may be statistically biased and fail to generalize to the population as a whole. Biases in early decisions — such as which patients are tested for a disease — can propagate throughout the care pipeline, producing systemic under-diagnoses in underserved populations, which may go undetected unless the selective censoring is modeled. While the selective labels problem has been studied in settings with single decisions, we generalize this setup to sequences of nested (“funnel”) decisions in the presence of unobserved covariates that affect both the human decision and the label (e.g., patient’s visible discomfort). Additional examples of funnel structures outside healthcare include hiring, where a candidate must pass progressively harder interviews to be hired ( 25 ) , lending, where an applicant must pass through several screenings to be approved for a loan ( 4 ) , and drug discovery, where a candidate molecule must pass through several phases of trials before FDA approval. We introduce a Bayesian model for such decision funnels . Our model jointly learns to predict both the ground truth outcomes and the human decisions (which selectively censor the ground truth). We generalize prior work on threshold tests ( 23 ; 26 ) , originally developed in the context of policing, which explicitly account for unobserved covariates that influence both the human decisions (to censor a label) and the ground truth outcome. Specifically, threshold tests model the decision to test a patient (e.g., to administer a biopsy) as a function of some estimated risk (e.g., risk of actually having a cancer). If the estimated risk exceeds a decision threshold, the label is observed. We extend this test to funnel structures, where censoring occurs at multiple stages. We first validate our model on synthetic data. We demonstrate, across a wide range of parameter settings, that our model is able to estimate the true parameters more accurately than binary classification baselines. In addition, our model estimates risk more accurately on the entire population (both censored and uncensored) than other binary classification baselines that do not account for multi-stage censoring. We then apply this model to analyze real-world emergency department visits in MIMIC-IV, a Boston-area electronic medical record database. In particular, we focus on two critical emergency department decisions: (1) admitting a patient to the hospital, and (2) admitting a patient to the ICU. We consider in-hospital mortality to be the ground truth outcome of interest, which is only observed if the patient is admitted to the hospital or ICU. In contrast, if the patient is discharged from the ED, their ground truth is censored. At each stage of this funnel, patients are prioritized according to the urgency of care. We find that (1) men are admitted to the hospital and ICU at lower mortality risk thresholds than are women, and (2) men are assigned more severe triage acuities (assigned by a clinician) at the same estimated mortality risk than women, a finding that agrees with prior work on gender disparities in emergency and intensive care medicine ( 28 ; 21 ) . We emphasize, however, that our model cannot explain the source of these gender-based disparities, and that the disparities, though statistically significant, are small in magnitude. Overall, our contributions are as follows: 1. We generalize the selective labels setting to a general setting with multi-stage censoring in the presence of unobserved covariates that influence both the human decisions and the label itself. We introduce a model to study multi-stage censoring in the presence of such unobservables by jointly modeling the true label and the human decisions. 2. We show, in synthetic simulations, that our model outperforms baselines which do not account for this multi-stage censoring. 3. We apply our model to real-world emergency department data from MIMIC-IV. We find that there are gender-based differences in hospital and ICU admissions decisions. Our model estimates that female patients must have a higher mortality risk (5.1%) to be admitted to the ICU than male patients (4.5%). 2 Related Work Several prior works learn decision policies for sequential decision tasks, including funnel-like structures ( 14 ) . At its core, funnel structures are a multi-stage extension of the selective labels problem ( 18 ) . In funnel structures, patients are given a label only if they pass several decision stages. 13 attempts to learn funnel decision policies which satisfy group fairness (i.e. some notion of parity is achieved at each stage). 9 discusses the heterogeneity across decision makers in funnel structures and its relation to racial bias in pretrial detentions. 29 develops a method for learning from sparse and noisy feedback from funnel structures in consumer recommender systems. Unlike our work, these works do not account for unobserved covariates that influence both the intermediate decisions and the label. Other works have focused on developing models for sequential decision making more broadly. Within the context of healthcare, prior works have separately analyzed ED to hospitalization admissions ( 2 ) and ICU admissions ( 24 ) . Some works have focused on other, non-funnel sequential decision pathways in healthcare, including chronic disease management ( 6 ) and surgery planning ( 11 ) . Emergency department visits and decisions, in particular, are also valuable for other analyses. Prior literature has used ED data to monitor disease outbreaks ( 30 ) , evaluate health risks ( 22 ) , assessed the expertise that doctors can provide over algorithms ( 1 ) , and assessed racial disparities in algorithmic performance ( 19 ) . 3 Methods 3.1 Setup For concreteness, we describe our model in the setting of ED decision-making, but our approach can be applied to other funnel settings such as cancer screening or hiring. Let there be N patients and K decision stages. For example, if the funnel is ED \rightarrow hospital \rightarrow ICU, then K=3 . For each patient i who makes it to stage k\in\{1,2,\ldots,K\} , the decision-maker observes a covariate set X_{i,k} , where covariates at earlier stages are (non-strict) subsets of covariates at deeper stages, i.e., X_{i,1}\subseteq X_{i,2}\cdots X_{i,K} . Let s_{i} be the deepest stage patient i progresses to. If s_{i}\geq S for some pre-determined stage S (e.g. hospital stage), the binary ground truth y (e.g., in-hospital mortality) is revealed. Otherwise, y is unobserved. Patients need not progress through every stage sequentially. For instance, a patient with severe complications in the ED might be directly admitted to the ICU, bypassing hospitalization. Observed data. Consider a particular patient i progressing through different stages of a hospital stay (e.g., ED \rightarrow hospital admission \rightarrow ICU). At each stage k , the clinician decides to move the patient on to a later stage or to discharge. We define the admission decision at stage k for patient i as D_{i,k} , which takes on values in \{\text{discharge},k+1,k+2,\ldots,K\} . Note that D_{i,k} can take on values larger than k+1 , as the clinician can move the patient onto any later stage. We additionally observe the patient’s mortality Y_{i}\in\{0,1\} at discharge if the stage k>S . If the patient is discharged before stage S , Y_{i} is unobserved in our data. Our observed data for each patient i consists of a sequence of covariates X_{i,k} , admissions decisions D_{i,k} , and mortality Y_{i} if the patient makes it past stage S . Otherwise, Y_{i} is unobserved. 3.2 Generative Model Model. We propose a generative model that extends prior work on threshold tests ( 26 ; 23 ) , originally developed to model censored outcomes in policing settings, to funnel settings with arbitrary numbers of decision stages. Our generative model, also shown in Figure 1 , is as follows. Consider the patient i progressing through the stages of a hospital stay. At each stage k , the clinician estimates some mortality risk p_{i,k}=\text{Pr}(y_{i}=1) . We model p_{i,k} as a draw from a distribution to reflect the fact that the clinician may have access to unobservables that are informative about mortality risk, and relevant to the clinician’s decision, but are not recorded in the data (e.g., whether a patient’s speech is slurred). A shape parameter \delta_{k} modulates the uncertainty in R , i.e., p_{i,k}\sim R(\phi_{i,k},\delta_{k}) , where \phi_{i,k} and \delta_{k} are the mean and shape parameters of R , respectively. The mean of this distribution, \phi_{i,k} , is a learned function of the covariates available at stage k , i.e. \phi_{i,k}=f_{\beta}(X_{i,k}) , where \beta denotes the learnable parameters. The parameters \beta may be (partially or fully) shared from stage to stage, or learned separately at each stage. In this paper, we instantiate f_{\beta} as a logistic model, i.e. \phi(X)=f_{\beta}(X)=\text{sigmoid}(\alpha+X^{T}\beta) , where \alpha is also learnable. The clinician then makes a decision on where to send the patient based on the patient’s assessed mortality risk p_{i,k} . If p_{i,k} exceeds a decision threshold t_{k}\in[0,1] , the clinician admits the patient to the next stage (e.g., the hospital). If it is smaller than this threshold, the patient is discharged. Patients can skip stages if the estimated mortality risk is sufficiently large; for instance, if p_{i,k} exceeds t_{k+1} , the subsequent threshold, the clinician may directly admit the patient to a later stage (e.g., ICU), skipping the earlier stage (hospital). Let D_{i,k} be the decision on where to send patient i after stage k , as defined in the observed quantities section. Then, we define the decision rule as D_{i,k}=\begin{cases}\text{discharge},&p_{i,k}k (i.e., the rate at which they’re sent to that stage) as: \displaystyle A_{i,k\rightarrow m}=Pr(t_{m-1}\leq p_{i,k}S) , we additionally model the mortality rate as: \displaystyle M_{i,k}=E(Y_{i}|p_{i,k}t) and E_{p\sim R}[p|p>t] and associated derivatives if R is a beta distribution ( 3 ) . Discriminant distributions, as introduced in ( 23 ) , offer a scalable workaround. Let Y\sim\text{Bern}(p) . We assume the distribution of some signal X (e.g., a learned function of the features) is distributed X|Y=0\sim\mathcal{N}(0,\sigma) and X|Y=1\sim\mathcal{N}(\mu,\sigma) . Define g(x)=Pr(Y=1|X=x) . Prior work ( 23 ) shows that g is a monotonic function of x . If we define \delta=\frac{\mu}{\sigma} , then it is possible to parameterize R in terms of \phi , the mean parameter, and \delta , a shape parameter, alone. Moreover: \displaystyle g(x)=\frac{1}{1+\frac{1-\phi}{\phi}\exp(-\delta x+\delta^{2}/2)} (4) This yields exact analytic expressions for the admit and mortality rates. In particular: \displaystyle Pr(p>t) \displaystyle=(1-\phi)(1-\Phi(g^{-1}(t);0,1)) \displaystyle+\phi(1-\Phi(g^{-1}(t);\delta,1)) \displaystyle E[Y|p>t] \displaystyle=\frac{\phi(1-\Phi(g^{-1}(t);\delta,1))}{Pr(p>t)} where \Phi is the normal CDF. We parameterize \phi as a learned (logistic) function of covariates. In particular, we set \phi_{i,k}=f_{\beta}(X_{i,k}) , for the i th individual at stage k , and f_{\beta}(X)=\text{sigmoid}(\alpha+X^{T}\beta) , where the intercept \alpha is also a learnable parameter. Although we parameterize this with a logistic function, other parameterizations are also possible. For instance, one could set f_{\beta} to a small neural network. A.2 List of MIMIC pathways and corresponding likelihood contributions There are four possible pathways a patient may take in this MIMIC setup: (1) discharged from ED, (2) admitted from ED to hospital to ICU, (3) admitted from ED to hospital, then discharged, (4) admitted from ED to ICU. We write out the likelihood contributions for each of these four. ED discharge If the patient is discharged from the ED, their only likelihood contribution is via the admit rate: A_{i,ED\rightarrow discharge}=Pr(p_{i,ED}t_{ICU}) ED, hosp, discharge The admit rate from the ED to the hospital is computed the same as above. We update the patient’s risk in the hospital to p_{i,hosp} based on the covariates collected in the hospital. The admit rate for the discharge is: A_{i,hosp\rightarrow discharge}=Pr(p_{i,hosp}t_{1} , then patient i passes stage 1 (i.e., admitted to the hospital) and three more features X_{4},X_{5},X_{6} are revealed. We then repeat: \phi_{i,2}=\text{sigmoid}(\alpha+\beta_{1:6}^{T}X_{1:6}) . If the sampled p_{i,2}>t_{2} , the patient makes it to the last stage (i.e., admitted to ICU), and the true label y is sampled as y\sim Bern(p_{i,2}) , where p_{i,2}\sim R(\phi_{i,2},\delta_{2}) . For each simulation, we ensure that the distribution of stages and outcomes is reasonable (e.g., avoiding pathological cases such as all patients end up in ICU). In particular, we only keep simulations where at least ten patients are observed in each pathway. B.2 Baseline details We compare against three sets of baselines, explained in 4.1 . For the logistic regression baselines, we train on model y\sim X only on the population where y and X is observed. We additionally include another baseline ICU\sim X , which enables us to use all the samples, at the cost of mis-specifying the target ( ICU instead of y ). Lastly, we train a model y\sim X where we impute y=0 for the missing population. Figure 4 shows that calibration of the first two baselines’ fitted coefficients across several simulations. We additionally plot our model’s fitted coefficients in this plot. Appendix C Additional results C.1 Posterior predictive checks Using posterior predictive checks (i.e., inferred quantities from posterior), we additionally validate that our model is able to recover the admit and mortality rates in MIMIC, which we show in Figure 5 . Figure 5: Our model is able to recover the true admit and mortality rates in MIMIC data. C.2 Racial subgroup results We additionally apply our model separately to each coarse race subgroup in MIMIC ( 19 ) . We omit “Native American” as a racial category due to small sample size and “Other” due to lack of specificity. Table 4 shows the fitted thresholds by race. In general, we observe that Asian patients have the highest mortality risk thresholds for both hospital and ICU admission. This aligns with observations that their mortality rates in the ICU and hospital are higher than any other group, despite having comparable admit rates. Figure 6 further examines race-specific coefficients in MIMIC. Race Hospitalization Threshold ICU Threshold Hospital Mortality ICU Mortality Rate Hospital Admit Rate ICU Admit Rate Asian 0.008 [0.006, 0.010] 0.064 [0.055, 0.073] 0.007 0.146 0.394 0.054 Black/African 0.003 [0.003, 0.004] 0.039 [0.036, 0.042] 0.004 0.097 0.395 0.043 White 0.003 [0.003, 0.004] 0.047 [0.045, 0.049] 0.006 0.121 0.536 0.074 Hispanic/Latino 0.004 [0.003, 0.005] 0.037 [0.031, 0.043] 0.003 0.084 0.363 0.037 Table 4: Race-specific decision thresholds and outcome rates. Hospitalization and ICU thresholds are estimates from our model (95% CIs in brackets). The mortality and admission rates are both empirically calculated on the MIMIC data. Figure 6: The fitted coefficients in MIMIC for each race. Appendix D MIMIC details D.1 Data details The MIMIC database contains several hundreds of thousands of patients. Each patient is given a unique subject ID. Within each stay at the ED, the patient is given a unique stay ID. Patients are triaged upon arrival at the ED, providing nine common covariates: temperature (°F), heart rate (bpm), respiratory rate (bpm), oxygen saturation (%), systolic blood pressure (mmHg), diastolic blood pressure (mmHg), chief complaint, pain, and acuity, which is measured according to the Emergency Severity Index (ESI) Five Level triage system and assigned by a registered nurse. We omit acuity as a predictor in our model, as we use it to correlate our model’s estimated mortality risk to the triage acuity. Missing values are replaced by the average of the non-missing values. Pain, which is right-skewed, is self-reported by the patient on a scale of 0-10 . Values deviating outside the range 0-10 were replaced with the average. In general, for values outside the range of plausible values, such as body temperatures above 200F and oxygen saturation above 100  we impute the mean. We z -scored all numeric variables to better compare effect sizes. We additionally included a quadratic term, z^{2} for these variables, as the mortality risk was often non-monotone in the observed value. For instance, very low and very high heart rates are both concerning. We additionally one-hot encoded chief complaint into one of ten possible complaints. Age is collected upon admission to the hospital (or ICU), along with language and marital status. We include age as a predictor in our experiments but omit language and marital status. We define ICU wards as any hospital ward identified as some sort of “ICU” or “Intensive Care Unit.” We consider the universe of all patients who were admitted to the BIDMC through the ED. This leaves 425,087 patients. Of these patients, 182,803 are admitted to the (non-ICU wards of the) hospital, and 20,213 are admitted directly to the ICU. An additional 8,368 patients are admitted from the hospital to the ICU. Feature Type First available at Description intercept Intercept (constant) ED Constant 1. temperature numeric, Z -scored ED Triage body temperature ( ∘ F). heartrate numeric, Z -scored ED Heart rate (bpm). resprate numeric, Z -scored ED Respiratory rate (breaths/min). o2sat numeric, Z -scored ED Pulse oximetry SpO 2 (%). sbp numeric, Z -scored ED Systolic blood pressure (mmHg). dbp numeric, Z -scored ED Diastolic blood pressure (mmHg). pain numeric, Z -scored ED Pain score (0–10). temperature_sq numeric, Z -scored then squared ED Square of Z -scored temperature. heartrate_sq numeric, Z -scored then squared ED Square of Z -scored heart rate. resprate_sq numeric, Z -scored then squared ED Square of Z -scored respiratory rate. o2sat_sq numeric, Z -scored then squared ED Square of Z -scored SpO 2 . sbp_sq numeric, Z -scored then squared ED Square of Z -scored systolic BP. dbp_sq numeric, Z -scored then squared ED Square of Z -scored diastolic BP. pain_sq numeric, Z -scored then squared ED Square of Z -scored pain score. chiefcom_chest_pain one-hot ED Chief complaint: chest pain. chiefcom_abdominal_pain one-hot ED Chief complaint: abdominal pain. chiefcom_headache one-hot ED Chief complaint: headache. chiefcom_shortness_of_breath one-hot ED Chief complaint: shortness of breath. chiefcom_back_pain one-hot ED Chief complaint: back pain. chiefcom_cough one-hot ED Chief complaint: cough. chiefcom_nausea_vomiting one-hot ED Chief complaint: nausea/vomiting. chiefcom_fever_chills one-hot ED Chief complaint: fever/chills. chiefcom_syncope one-hot ED Chief complaint: syncope. chiefcom_dizziness one-hot ED Chief complaint: dizziness. age numeric, Z -scored Hospital/ICU Age (years). Table 5: Feature dictionary for MIMIC predictors.