Robust inference for risk heterogeneity under group imbalance
Mengqi Xu, Subha Maity, Joel Dubin · 2026
Read Robust inference for risk heterogeneity under group imbalance by Mengqi Xu, Subha Maity, Joel Dubin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00797.txt.
Introduction
Xu, Maity, and Dubin build a safer way to spot risk gaps between groups in this 2026 paper. In health data, a risk tied to one trait can shift across ethnic or clinical groups. In intensive care, the death risk of a diagnosis may differ by group. Old tests for such gaps bend when the base model is off or when shrinkage bias creeps in.
Their frame rests on Neyman orthogonality. That trait makes the estimator shrug off small errors in side parameters it must still estimate. They prove the estimator is consistent and near normal in large samples. In simulations, it cuts bias and holds steady where standard likelihood methods wobble. On the eICU database, it finds clear ethnic gaps in how admission diagnoses link to death in hospital. Standard methods missed those gaps. The work speaks to fair, sound risk claims in medicine.
Catalog record
| CREATOR | Mengqi Xu, Subha Maity, Joel Dubin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00797
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Robust inference for risk heterogeneity under group imbalance Mengqi Xu, Subha Maity, Joel Dubin Abstract Population-level heterogeneity is ubiquitous in biomedical data, where differences across demographic or clinical subgroups can substantially alter risk patterns. For example, in intensive care unit (ICU) studies, the mortality risk associated with specific admission diagnoses can vary across ethnic groups. Existing approaches for detecting risk heterogeneity are often sensitive to baseline model misspecification and regularization bias, both of which commonly arise in practice. In this paper, we propose a robust framework for inferring risk heterogeneity between two populations using Neyman orthogonality, which yields estimators that are locally insensitive to nuisance parameter estimation error. The proposed estimator is consistent and asymptotically normal, and simulation studies demonstrate that in finite samples our method substantially reduces bias and improves inferential stability compared with standard likelihood-based approaches. In an application to the eICU Collaborative Research Database, our method reveals clinically meaningful ethnicity-specific heterogeneity in admission diagnoses for in-hospital mortality that standard likelihood-based methods fail to detect. Keywords: Population heterogeneity; risk prediction; Neyman orthogonality; statistical learning. 1 Introduction In many healthcare applications, demographic, environmental, and contextual factors drive significant disparities in patient outcomes across different subgroups. These observed disparities, however, are highly sensitive to the scale of analysis and can fluctuate between the aggregate population level and specific sub-cohorts. For example, the eICU Collaborative Research Database ( 18 ) indicates that the overall in-hospital mortality prevalence is slightly higher for “Caucasian” patients (9.77%) than for “Asian” patients (9.39%). Conversely, among patients whose primary admission diagnosis is cardiac arrest, this disparity reverses, with Asian patients facing a much higher mortality prevalence (40.74%) than Caucasian patients (21.29%) (Table I ). Covariates may also further influence such disparities between ethnicites across different diseases. Therefore, understanding and accounting for outcome heterogeneity at a granular, covariate-adjusted level is a fundamental prerequisite for building clinical models that are generalizable, interpretable, and precise. Table I : In-hospital mortality of Caucasian and Asian patients in the eICU dataset, overall and within the cardiac arrest subgroup. Prevalence is the percentage of expired patients within each ethnicity and subgroup. Overall Cardiac Arrest Status Caucasian Asian Caucasian Asian Alive 33427 473 2336 16 Expired 3616 49 632 11 Total 37043 522 2968 27 Prevalence (%) 9.77 9.39 21.29 40.74 Prior work has documented substantial mortality differences across ethnicities ( 15 ) , heterogeneous treatment effects in subgroup analyses ( 19 ) , and potential inequities in intensive care unit (ICU) interventions among diverse sociodemographic populations ( 11 ) . Simple test statistics such as z-scores, t-tests, or chi-squared tests ( 14 ) provide group comparisons but fail to adjust for multiple factors. While multivariable frameworks like ANCOVA ( 21 ) or baseline category logit models ( 12 ; 1 ) can adjust for covariates, they struggle with a large number of predictors and when one of the subgroups is underrepresented ( 2 ) . Moreover, they do not provide a flexible framework to account for any non-linear associations that may exist between the outcome and the covariates. Compared to prior work, we aim to develop an inference framework to understand the covariate-adjusted heterogeneity across subgroups that are amenable to a large number of covariates, with the potential underrepresentation of some subgroups, and can flexibly account for non-linear associations. For our framework, we consider the following example model: \mathrm{logit}\big\{\mathbf{P}(Y=1|\bm{X},\text{Asian})\big\}-\mathrm{logit}\big\{\mathbf{P}(Y=1|\bm{X},\text{Caucasian})\big\}=\alpha^{T}\bm{X}\,, (1) where Y represents binary in-hospital mortality and \bm{X} represents a covariate vector. Thus, in ( 2 ), heterogeneity is formulated as a linear function of \bm{X} . Such a model was considered by 13 to predict mortality for an ethnically underrepresented subgroup by leveraging information from a well-represented subgroup; hence, it is suited for dealing with subgroup underrepresentation. Although we posit the difference in the logits as a linear function of \bm{X} , the logits individually may be non-linear functions, thus allowing for non-linear associations between covariates and outcomes. Moreover, the model provides an interpretable way to compare subgroup-specific associations after covariate adjustment. For example, if the j th covariate is an indicator for cardiac arrest, then \alpha_{j} represents the marginal difference in log odds of mortality between Asians and Caucasians when an individual is admitted due to cardiac arrest, after adjusting for other covariates. To statistically verify whether this difference is significant, we want to perform inference on \alpha_{j} . Conducting reliable heterogeneity inference in modern healthcare studies is often hampered by two challenges. First, one of the subgroups may be severely underrepresented; e.g. in the eICU data, “Asian” ethnicity has only 522 samples. Moreover, the problem of underrepresentation can be further exacerbated by the large number of covariates. Second, existing methods for the model in Eq. ( 1 ), such as 13 , typically rely on regularized likelihood-based estimation, which yields estimators of \alpha_{j} that can be sensitive to baseline model mis-specification (in our case, the Caucasian model) and regularization bias under a high-dimensional setting. This is unsuitable for inferential purposes. To address these limitations, we draw inspiration from Neyman orthogonalization ( 5 ) , which allows for the construction of estimators that are robust to estimation errors in “nuisance” components of the model, such as the baseline model for the majority group \mathrm{logit}\big\{\mathbf{P}(Y=1|\bm{X},\text{Caucasian})\big\} and other auxiliary parameters. Neyman orthogonalization has been widely applied in causal inference ( 5 ; 17 ) and provides a successful tool for mitigating biases introduced by nuisance estimators. By leveraging this approach, we propose a flexible and robust inference framework that ensures reliable inference on the heterogeneities, even when the estimates of the baseline model and nuisance parameters are biased. The proposed framework offers several key contributions: (i) it provides an inference tool that can handle underrepresented subgroups; (ii) it accommodates a large number of covariates; (iii) it is highly flexible with respect to the choice of baseline model algorithm; and, finally, (iv) it extends beyond binary outcomes such as in-hospital mortality to a broad range of outcome types. The remainder of this paper is organized as follows. In Section 2 , we introduce the problem setup and our method. Specifically, in Section 2.2 , we propose the novel method by introducing a Neyman orthogonal score function, and in Section 2.3 , we establish the theoretical property of the proposed estimator. Then, in Section 3 , we present simulation results that illustrate the debiasing advantage of our method over standard linear adjustment approaches. In Section 4 , we apply the proposed framework to the eICU Collaborative Research Database ( 18 ) to infer ethnic heterogeneities in ICU admission diagnoses for in-hospital mortality prediction. Finally, in Section 5 , we conclude the paper with a discussion. 2 Methodology 2.1 Problem setup Here, we formalize the problem setup. We assume that the dataset \{(\bm{X}_{i},Y_{i},T_{i})\}_{i=1}^{N} is a random sample drawn from a probability distribution \mathbb{P} , where \bm{X}_{i}\in\mathcal{X}\subseteq\mathbb{R}^{d} and Y_{i}\in\mathcal{Y} are the predictors and outcomes of interest, and \mathcal{X} and \mathcal{Y} denote the spaces of the predictors and outcomes, respectively. Moreover, T_{i}\in\{0,1\} indicates the subpopulation label; where the well-represented group is denoted as T_{i}=1 and the under-represented group is denoted as T_{i}=0 . Consequently, \mathbb{P}(T_{i}=1)\geq\nicefrac{{1}}{{2}} , often closer to 1 in many applications. Recall that our primary goal is to perform statistical inference for the parameters defined