Sensitivity analysis for nonignorable missing values in blended analysis framework: a study on the effect of bariatric surgery via electronic health records
Jungwun Lee, Sebastien Haneuse, Rajarshi Mukherjee, Tanayott Thaweethai · 2025
Read Sensitivity analysis for nonignorable missing values in blended analysis framework: a study on the effect of bariatric surgery via electronic health records by Jungwun Lee, Sebastien Haneuse, Rajarshi Mukherjee, Tanayott Thaweethai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20935.txt.
Introduction
Health records are cheap and rich, but the holes in them are rarely random: sicker patients often have more missing values, which can bend results. Jungwun Lee and co-authors extend a blended analysis framework in this 2025 paper to handle data that may be missing not at random. The blended method splits how the data arose into steps, mixing weighting and imputation across them.
Their extension adds sensitivity analyses that ask how strongly the hidden missingness would have to misbehave before conclusions change. Simulations test the framework, and the authors apply it to a real dataset on long-term outcomes after weight-loss surgery. They close with practical advice on reading such sensitivity results.
Catalog record
| CREATOR | Jungwun Lee, Sebastien Haneuse, Rajarshi Mukherjee, Tanayott Thaweethai |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 101 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-20935
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Sensitivity analysis for nonignorable missing values in blended analysis framework: a study on the effect of bariatric surgery via electronic health records Jungwun Lee, Sebastien Haneuse, Rajarshi Mukherjee, Tanayott Thaweethai Abstract This paper establishes a series of sensitivity analyses to investigate the impact of missing values in the electronic health records (EHR) that are possibly missing not at random (MNAR). EHRs have gained tremendous interest due to their cost-effectiveness, but their employment for research involves numerous challenges, such as selection bias due to missing data. The blended analysis has been suggested to overcome such challenges, which decomposes the data provenance into a sequence of sub-mechanisms and uses a combination of inverse-probability weighting (IPW) and multiple imputation (MI) under missing at random assumption (MAR). In this paper, we expand the blended analysis under the MNAR assumption and present a sensitivity analysis framework to investigate the effect of MNAR missing values on the analysis results. We illustrate the performance of my proposed framework via numerical studies and conclude with strategies for interpreting the results of sensitivity analyses. In addition, we present an application of our framework to the DURABLE data set, an EHR from a study examining long-term outcomes of patients who underwent bariatric surgery. Keywords: Multiple imputation, Inverse probability weight, Missing not at random. 1 Introduction 1.1 Electronic health records and their challenges Electronic health records (EHR) consist of extensive patient-level information that is collected via encounters individuals have with healthcare systems, and include data regarding medical history, hospital/emergency room visits, and clinical measurements. Such information is recorded primarily for clinical management of patients and/or billing purposes. Because EHR are naturally collected during all healthcare interactions, they are promising cost-effective resources for observational studies in public health and medical research as an alternative to conventional randomized clinical trials, which may be expensive, time-consuming, or ethically unjustified ( Haneuse and Daniels, 2016 ) . Unfortunately, analyses using EHR are subject to challenges that may threaten the validity of conventional statistical analyses. As all EHR-based studies are inherently observational, patient-level treatments are not randomly assigned; thus, confounding bias can be a potential problem. In addition, not all clinical information relevant to a research question is routinely or consistently collected. For example, some patients may have missing baseline treatment, missing clinical information, missing laboratory measurements during follow-up, or have been disenrolled from the health plan before the end of the planned follow-up. Although not disenrolled, some patients may not have measurement histories in a certain period because they did not visit the healthcare system during that time. If such inconsistencies occur in variables of interest, records with missing values cannot be included in the analysis if the analysis usually requires complete records in all related variables. Such missing values may cause serious biases in standard statistical analysis if inappropriately treated. For example, the complete-case analysis (CCA), employs subjects with complete data for the variables in an analysis model only and excludes subjects with incomplete values. However, it is based on a strong assumption in that subjects with complete records are systemically homogeneous with those who are excluded, and thus, they properly represent a target population. Such an assumption can be violated if the distribution of a variable in the analysis model among complete cases is systemically different from that of excluded ones. In addition, in the EHR context, a subject being a complete case largely hinges on an analysis model of interest; some patients without heart rate measurement may still be considered complete if an analysis model focuses on associations between weight loss and the bariatric surgical type and does not require heart rate. Such a unique nature of EHR yields the occurrence of incomplete record more non-accidental, making the CCA even less plausible. Numerous alternatives have been proposed, including inverse probability weighting (IPW) ( Seaman et al., 2012 ) or multiple imputation (MI) ( Rubin, 2018 ) techniques. IPW employs subjects with complete subjects only while removing bias by weighting subjects with the inverse of their probability of being a complete case. MI is a simulation-based procedure which replaces each missing value with a set of plausible values, creating multiple imputed data sets. Analytic results are obtained by combining the results of standard complete-data analyses across the multiple imputed data sets. However, such conventional approaches hinges on an oversimplified assumption in that a single missing data mechanism can explain the missingness on a study sample, and thus may be insufficient to account for complex interplays between patients and decision makings that lead to a realization of a record ( Haneuse and Daniels, 2016 ) . The blended analysis framework was proposed to reflect the unique data-generating process of EHR on the analysis model and provide broader flexibilities in addressing missing value problems in EHR-based studies. ( Haneuse and Daniels, 2016 ) defined a term “modularization", which decomposes the data-generating mechanism of EHR into a sequence of binary random variables, where each random variable denotes “sub-mechanism" that describes an event that lead to a variable being “observed", or a decision making that may affect the following sub-mechanisms ( Haneuse and Daniels, 2016 ; Thaweethai, 2020 ) . The key idea is to decompose the data provenance into a sequence of multiple sub-mechanisms, where each sub-mechanism is a binary indicator that describes whether a specific decision or measurement of required data elements occurs. Such decomposition of the data provenance is referred to as “modularization" ( Haneuse and Daniels, 2016 ; Peskoe et al., 2021 ; Thaweethai, 2020 ) . For a given data set and an analysis model, a modularization yields a sequence of sub-mechanisms, and each sub-mechanism is modeled either IPW or MI, based on the analyst’s decision. After all sub-mechanisms are addressed, each imputed data set is weighted and analyzed, and the combination of results from multiple imputed data sets become the final analysis result ( Thaweethai, 2020 ) . 1.2 Sensitivity analysis on missing values Little and Rubin (2019) classified the missing data mechanism into three categories: missing completely at random (MCAR), missing at random (MAR), and missing not at random (MNAR). The missing data mechanism is MCAR if unobserved values on a variable are unrelated to the other observed variables and unobserved values themselves. Under MCAR, the sub-sample with complete data are statistically representative of the population from which they are derived, which is usually unrealistic in most settings. Under MAR, the missing data mechanism depends only upon the observed study variables. Under MAR, the probability of missingness does not depend on the missing data conditional on the observed variables. The missing data mechanism is MNAR if the missing data mechanism depends on the unobserved data, even after conditioning on the observed data. This paper is motivated by MNAR missing values in EHR. In EHR-based studies, the MAR assumption may not hold because missing values in EHR often appear in the complex interplays between patients, healthcare providers, and intractable factors. For example, some patients’ weight measurements may no longer be available if they are satisfied with their weight loss after the bariatric surgery and thus disenroll from the healthcare system. On the contrary, some patients’ weight measurements are not available because their condition worsens or they experience some side effects that