Improving RCT-Based Treatment Effect Estimation Under Covariate Mismatch via Calibrated Alignment

Amir Asiaee, Samhita Pal · 2026

Read Improving RCT-Based Treatment Effect Estimation Under Covariate Mismatch via Calibrated Alignment by Amir Asiaee, Samhita Pal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19186.txt.

Introduction

Asiaee and Pal tackle a snag in using large health studies to sharpen trial results. Trials are sound but small, while outside studies track partly different traits for each person. Their CALM method maps both sources into one shared space. It then moves outcome models into the trial space and tunes them on trial data. Bounds split the error into parts for mapping, model size, and tuning. On real data, the neural version gives the largest gains.

Catalog record

CREATORAmir Asiaee, Samhita Pal
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58323
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.19186

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Improving RCT-Based Treatment Effect Estimation Under Covariate Mismatch via Calibrated Alignment Amir Asiaee, Samhita Pal Abstract Randomized controlled trials (RCTs) are the gold standard for estimating heterogeneous treatment effects, yet they are often underpowered for detecting effect heterogeneity. Large observational studies (OS) can supplement RCTs for conditional average treatment effect (CATE) estimation, but a key barrier is covariate mismatch : the two sources measure different, only partially overlapping, covariates. We propose Calm ( C alibrated AL ignment under covariate M ismatch), which bypasses imputation by learning embeddings that map each source’s features into a common representation space. OS outcome models are transferred to the RCT embedding space and calibrated using trial data, preserving causal identification from randomization. Finite-sample risk bounds decompose into alignment error , outcome-model complexity , and calibration complexity terms, identifying when embedding alignment outperforms imputation. Under the calibration-based linear variant, the framework provides protection against negative transfer; the neural variant can be vulnerable under severe distributional shift. Under sparse linear models, the embedding approach strictly generalizes imputation. Simulations across 51 settings confirm that (i) calibration-based methods are equivalent for linear CATEs, and (ii) the neural embedding variant wins all 22 nonlinear-regime settings with large margins. 1 Introduction Heterogeneous treatment effects (HTEs) are central to precision medicine: understanding how individual patient characteristics modulate treatment response enables clinicians to tailor interventions for maximal benefit [ 29 ] . Randomized controlled trials remain the gold standard for causal inference, providing unconfounded treatment comparisons that support consistent estimation of the conditional average treatment effect, \tau^{r}(\bm{x})=\mathbb{E}\bigl[Y(1)-Y(-1)\mid\bm{X}=\bm{x},\,S=r\bigr], where Y(a) denotes the potential outcome under treatment a\in\{-1,1\} and S=r indicates the RCT population. In practice, however, most RCTs are powered for average effects rather than the fine-grained heterogeneity that guides individualized decisions [ 45 , 28 ] . At the same time, large-scale observational studies—electronic health records (EHRs), registries, and insurance claims—provide rich covariates and massive sample sizes, but are vulnerable to confounding. This asymmetry motivates the integration of OS data to improve the precision of within-trial CATE estimation. 2 formalize this \mathcal{O}\to\mathcal{R} direction by introducing the counterfactual mean outcome (CMO) as the variance-minimizing augmentation function for pseudo-outcome regression, and propose R-Oscar , a two-stage calibration procedure that learns outcome models from the OS, calibrates them to the RCT, and uses the calibrated predictions as an augmentation function. The key structural insight is that the OS enters only through the quality of the CMO estimate: better CMO estimation reduces both the irreducible variance and the estimation error of the CATE, while the causal identification remains anchored entirely in the randomized contrast. The covariate mismatch barrier. A major obstacle to RCT–OS integration is that the covariates collected in trials and observational sources rarely align—a problem we call covariate mismatch . The RCT may contain behavioral or survey-based variables absent from the OS, while the OS may contain laboratory or utilization features not recorded in the trial [ 39 ] . This differs fundamentally from covariate shift [ 43 ] , where the same variables are observed but follow different distributions. Under mismatch, the outcome models trained on OS features cannot be directly evaluated on RCT units, breaking the core transfer step in data-borrowing methods. Indeed, 10 show that imputing covariates that were never measured in the trial cannot recover the required identification, even under perfectly specified linear models. (This identification limitation concerns transportability when key effect modifiers are absent from the trial; our use of imputation in MR-Oscar serves only as augmentation for variance reduction, with causal identification anchored in RCT randomization.) Partitioning covariates into shared ( \bm{Z}\in\mathbb{R}^{p_{z}} ), RCT-only ( \bm{U}\in\mathbb{R}^{p_{u}} ), and OS-only ( \bm{V}\in\mathbb{R}^{p_{v}} ) blocks (formalized in Section 3 ), a natural approach is to address covariate mismatch within the R-Oscar framework by learning an imputation function \hat{g}:\mathbb{R}^{p_{z}}\to\mathbb{R}^{p_{v}} that predicts \bm{V} from \bm{Z} in the OS, and then using \hat{g} to fill in the structurally missing \bm{V} block in the RCT. We call this the mismatch-aware extension, MR-Oscar [ 37 ] , which inherits R-Oscar ’s calibration-based negative-transfer protection and comes with finite-sample risk bounds that include an explicit imputation error term L^{2}r_{\mathrm{im}}^{2} , where L is a Lipschitz constant and r_{\mathrm{im}}^{2} is the oracle imputation risk (see Section 3.3 ). Imputation is a harder problem than needed. The imputation approach requires reconstructing the entire \bm{V} vector in the RCT—a potentially high-dimensional regression problem whose difficulty scales with p_{v} and the complexity of P(\bm{V}\mid\bm{Z}) . Yet, for the purpose of CATE estimation, all that is needed is a representation that is sufficient for (i) predicting outcomes and (ii) estimating discrepancy functions. When the outcome-relevant information in \bm{V} lies on a low-dimensional manifold, the imputation approach pays an unnecessarily high price by attempting to recover the full \bm{V} rather than its outcome-relevant projection. Our contribution: embedding alignment. In this paper, we propose Calm , which replaces imputation with representation alignment . Instead of reconstructing missing covariates, we learn embedding functions \phi^{o}:\mathbb{R}^{p_{o}}\to\mathbb{R}^{d} and \phi^{r}:\mathbb{R}^{p_{r}}\to\mathbb{R}^{d} that map the heterogeneous feature spaces into a common d -dimensional representation space \mathcal{H} . Outcome models are trained in the OS embedding space and then transferred to the RCT embedding space, where they are calibrated and used for CATE estimation following the double-calibration pipeline of R-Oscar . Crucially, OS data only inform the pseudo-outcome used to reduce variance of the CATE estimate (see Figure 1 for an overview); causal identification rests entirely on randomization within the trial and remains intact. Our contributions are: 1. Embedding-alignment framework. We introduce Calm , which integrates representation learning into the R-Oscar calibration pipeline, replacing imputation with learned embeddings. The framework inherits double-calibration-based negative-transfer protection. 2. Finite-sample risk bounds. We derive non-asymptotic bounds that decompose into alignment error and outcome-model, calibration, and CATE-class complexity terms, making explicit when embedding outperforms imputation. Under linear Gaussian models, Calm strictly generalizes imputation-based approaches. 3. Extensive experiments. Linear and neural-network instantiations are validated across 51 simulation settings and an IHDP semi-synthetic benchmark. 2 Related Work CATE estimation uses meta-learners [ 30 , 27 , 35 ] , causal forests [ 3 ] , Bayesian methods [ 18 ] , and representation-learning approaches [ 25 , 41 , 47 , 42 , 20 ] . Most RCT–OS integration work targets the \mathcal{R}\to\mathcal{O} (generalizability) direction [ 11 , 14 , 13 ] ; in the \mathcal{O}\to\mathcal{R} direction, 8 adaptively weight CATE estimates from both sources, 36 study optimal biased–unbiased combinations, 26 provide worst-case guarantees, and the R-Oscar framework of 2 introduces a double-calibration procedure with non-asymptotic risk bounds; we extend it to the covariate-mismatch setting via two baselines ( MR-Oscar , SR-Oscar ) formalized in Section 3.3 and our main contribution Calm , which replaces imputation with representation alignment. In heterogeneous transfer learning, standard domain-adaptation methods [ 5 , 15 , 32 , 38 , 46 ] assume shared features; cross-domain approaches use CCA variants [ 19 , 1 ] or shared-private encoders [ 7 ] , and in the causal setting 6 propose HTCE-learners, which require unconfoundedness in both domains, lack calibration-based negative-transfer protection, and provide no finite-sample guarantees. Sufficient dimension reduction [ 12 , 31 , 33 , 16 ] also targets outcome-relevant projections but does not address cross-dataset covariate mismatch. Bayesian borrowing via power priors [

Read the complete text