Orthogonal machine learning for conditional odds and risk ratios
Jiacheng Ge, Iván Díaz · 2026
Read Orthogonal machine learning for conditional odds and risk ratios by Jiacheng Ge, Iván Díaz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10412.txt.
Introduction
Ge and Díaz widen orthogonal machine learning to odds and risk ratios. Group wise effects guide who gains most from a treatment, yet odds and risk tools lagged behind. Their work extends DR-learner and R-learner methods with orthogonal risk forms for both ratios. The fake outcomes meet second order remainder rules like those for average effects. Trials across hundreds of simulated worlds favor the new tools in hard cases, and a NHANES study shows hidden group gaps.
Catalog record
| CREATOR | Jiacheng Ge, Iván Díaz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 118849 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10412
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Orthogonal machine learning for conditional odds and risk ratios Jiacheng Ge, Iván Díaz Abstract Conditional effects are commonly used measures for understanding how treatment effects vary across different groups, and are often used to target treatments/interventions to groups who benefit most. In this work we review existing methods and propose novel ones, focusing on the odds ratio (OR) and the risk ratio (RR). While estimation of the conditional average treatment effect (ATE) has been widely studied, estimators for the OR and RR lag behind, and cutting edge estimators such as those based on doubly robust transformations or orthogonal risk functions have not been generalized to these parameters. We propose such a generalization here, focusing on the DR-learner and the R-learner. We derive orthogonal risk functions for the OR and RR and show that the associated pseudo-outcomes satisfy second-order conditional-mean remainder properties analogous to the ATE case. We also evaluate estimators for the conditional ATE, OR, and RR in a comprehensive nonparametric Monte Carlo simulation study to compare them with common alternatives under hundreds of different data-generating distributions. Our numerical studies provide empirical guidance for choosing an estimator. For instance, they show that while parametric models are useful in very simple settings, the proposed nonparametric estimators significantly reduce bias and mean squared error in the more complex settings expected in the real world. We illustrate the methods in the analysis of physical activity and sleep trouble in U.S. adults using data from the National Health and Nutrition Examination Survey (NHANES) ( Pruim, 2014 ) . The results demonstrate that our estimators uncover substantial treatment effect heterogeneity that is obscured by traditional regression approaches and lead to improved treatment decision rules, highlighting the importance of data-adaptive methods for advancing precision health research. 1 Introduction Conditional effect metrics such as the risk difference, the odds ratio, and risk ratio measure how treatment effects vary across levels of covariates, enabling better mechanistic understanding and more tailored interventions. Compared to more common effect heterogeneity measures such as risk difference, the conditional odds ratios and risk ratios are sometimes more desirable. For example the conditional odds ratio can be recovered from studies with selection bias, such as case-control studies, even in settings where the ATE cannot ( Bareinboim and Pearl, 2012 ) , and it plays a fundamental role in identifiability of joint distributions under certain missing data models ( Malinsky et al., 2022 ) . Traditional statistics education and practice prescribe estimation of conditional effect metrics using simple parametric models. For instance, logistic regression is often promoted as the go-to tool for estimating odds ratios due to its purported advantages ( Hosmer Jr et al., 2013 ; Harrell, 2015 ; Doi et al., 2022 ; Mittinty and Lynch, 2023 ) . However, recent literature shows that reliance on inflexible parametric models can induce bias under misspecification and motivates nonparametric approaches that leverage modern machine learning ( Rudolph et al., 2023 , e.g.,) . Many of these recent nonparametric approaches are based on orthogonal pseudo-outcomes, including the doubly robust unbiased transformations that appear in the ATE literature: transformations of the data that depend on two or more nuisance parameters and whose conditional mean equals the target parameter up to a remainder that is second order in the nuisance errors. These constructions are closely related to and are often derived from so-called efficient influence functions ( Bickel et al., 1993 , EIFs,) . They were first proposed as a functional estimation tool by Rubin and van der Laan, 2007 in censored time-to-event settings to enable consistent nonparametric estimation of risk differences, and have been widely used in multiple statistical problems ranging from estimation of dose-response curves ( Kennedy et al., 2017 ) , estimation of causal effects in longitudinal settings ( Luedtke et al., 2017 ; Díaz et al., 2023 ) , and conditional effects in survival settings ( Díaz et al., 2018 ) . For conditional effects, Kennedy, 2023 reviews multiple estimators for the conditional average treatment effect, including the so-called DR-learner, which had been discussed in ( van der Laan, 2006 ; Luedtke and van der Laan, 2016 ) , among others. The R-learner ( Nie and Wager, 2021 ) is another popular estimator for conditional average treatment effects based on such an orthogonal pseudo-outcome. Recently, Morzywołek et al., 2025 presented theoretical developments unifying these two estimators in a general class of weighted orthogonal estimators. The estimators we use are also closely related to the literature on orthogonal statistical learning, where one studies empirical risk minimization problems involving nuisance functions and exploits so-called “Neyman orthogonality” to ensure that first-stage nuisance estimation error enters the target risk only at second order ( Chernozhukov et al., 2018 ; Foster and Syrgkanis, 2023 ) . From this perspective, DR- and R-learners can be viewed as instances of a broader strategy that combines orthogonalization, cross-fitting, and flexible regression learners to obtain robust estimation of heterogeneous effects without requiring correct parametric specification ( Hines et al., 2022 ; Morzywołek et al., 2025 ) . Existing DR- and R-learners allow for estimation of heterogeneous treatment effects, but the literature has almost exclusively focused on additive-scale heterogeneity (e.g., average treatment effect). By contrast, ratio-based parameters such as conditional odds and risk ratios have received less attention. A notable recent exception is the work of van der Laan et al., 2024 , who introduced EP-learning, a framework that combines the stability of plug-in estimators with the efficiency of doubly robust approaches for a general class of causal contrasts which includes conditional risk ratios. EP-learning can be viewed as an advanced plug-in learner. It enforces oracle efficiency by updating preliminary outcome regressions on the link scale using sieve fluctuations targeted to obtain risk estimators that are non-parametrically optimal. This combination guarantees bounded predictions and oracle efficiency, but at the cost of the further tuning necessary (choosing a sieve basis and dimension) and additional computation. Meanwhile, conditional OR and RR estimators based directly on the canonical recipe to create suitable pseudo-outcomes and then regress these on covariates using any machine learning methods have not been developed. This gap motivates our two main contributions. First, we propose novel estimators for conditional odds and risk ratios based on efficient-influence-function-derived orthogonal pseudo-outcomes. In the DR-learner, the efficient influence function of the marginal ATE is used to define the pseudo-outcome used in estimation of the conditional ATE. The estimators we propose extend the same principle to multiplicative contrasts, replacing the ATE efficient influence function with efficient influence functions for the average conditional OR and RR. We also develop R-learner variants for these ratio-scale parameters, which differ from the DR-learner only in the weighting of the second-stage regression. This extends results by Morzywołek et al., 2025 , who showed that in the CATE setting, the DR-learner and R-learner share the same pseudo-outcome and differ only by a propensity-score-based coefficient in the loss function. Second, we conduct a comprehensive simulation study to compare the DR- and R-learners for the conditional ATE, OR, and RR with plug-in estimators (i.e., the T-Learner and S-Learner ( Künzel et al., 2019 ) ) based on traditional logistic regression models and the SuperLearner van der Laan et al., 2007 , under a wide range of realistic