Leveraging External Controls in Clinical Trials: Estimands, Estimation, Assumptions Volume: XX

Bo Liu 1,∗, Laine Thomas 2,∗∗, Rury R. Holman 3,∗∗∗, Fan Li 1,∗∗∗∗ 1 Department of Statistical Science, Duke University, Durham, North Carolina 27708, U.S.A. 2 Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina 27708, U.S.A 3 Radcliffe Department of Medicine, Oxf · 2025

Read Leveraging External Controls in Clinical Trials: Estimands, Estimation, Assumptions Volume: XX by Bo Liu 1,∗, Laine Thomas 2,∗∗, Rury R. Holman 3,∗∗∗, Fan Li 1,∗∗∗∗ 1 Department of Statistical Science, Duke University, Durham, North Carolina 27708, U.S.A. 2 Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina 27708, U.S.A 3 Radcliffe Department of Medicine, Oxf (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21081.txt.

Introduction

Liu, Thomas, Holman, and Li study the use of external controls in clinical trials in twenty twenty-five. Trials increasingly add control patients from outside data to judge a treatment. Older methods often rest on vague targets and strong assumptions. One common assumption, that outside and trial patients match on average, may not hold.

The authors define causal targets in a clear notation that separates sources of bias. They show the trial's own control arm is key to checking assumptions. Their estimator combines trial and external data without assuming the groups match on average. It corrects for the systematic gap between the two sources. Tests in simulations and in heart trials compare the method with older ones.

Catalog record

CREATORBo Liu 1,∗, Laine Thomas 2,∗∗, Rury R. Holman 3,∗∗∗, Fan Li 1,∗∗∗∗ 1 Department of Statistical Science, Duke University, Durham, North Carolina 27708, U.S.A. 2 Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina 27708, U.S.A 3 Radcliffe Department of Medicine, Oxf
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-21081

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Leveraging External Controls in Clinical Trials: Estimands, Estimation, Assumptions Volume: XX Bo Liu 1,∗, Laine Thomas 2,∗∗, Rury R. Holman 3,∗∗∗, Fan Li 1,∗∗∗∗ 1 Department of Statistical Science, Duke University, Durham, North Carolina 27708, U.S.A. 2 Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina 27708, U.S.A 3 Radcliffe Department of Medicine, Oxford University, Oxford, United Kingdom Abstract It is increasingly common to augment randomized controlled trial with external controls from observational data, to evaluate the treatment effect of an intervention. Traditional approaches to treatment effect estimation involve ambiguous estimands and unrealistic or strong assumptions, such as mean exchangeability. We introduce a double-indexed notation for potential outcomes to define causal estimands transparently and clarify distinct sources of implicit bias. We show that the concurrent control arm is critical in assessing the plausibility of assumptions and providing unbiased causal estimation. We derive a consistent and locally efficient estimator for a class of weighted average treatment effect estimands that combines concurrent and external data without assuming mean exchangeability. This estimator incorporates an estimate of the systematic difference in outcomes between the concurrent and external units, of which we propose a Frish-Waugh-Lovell style partial regression method to obtain. We compare the proposed methods with existing methods using extensive simulation and applied to cardiovascular clinical trials. \pagerange Leveraging External Controls in Clinical Trials: Estimands, Estimation, Assumptions – \artmonth XXX XXX keywords causal inference, estimand, external control, efficient influence function, propensity score, weighting 1 Introduction Randomized controlled trials (RCT) are the gold standard for evaluating the efficacy and safety of new treatments. But RCTs have numerous well-known limitations. For example, it is often challenging to recruit patients, particularly with a placebo control arm in trials targeting new treatment for rare diseases or severe diseases such as late-stage cancer. Moreover, recruiting patients into RCTs might take a long time, which complicates analyzing and interpreting results in fast-evolving diseases. In the face of these challenges, there is increasing interest in study designs that augment RCTs with external controls (EC) from observational data, such as electronic health records, past trials, and diseases registries, where the subjects had no access to the treatment of interest ( Baumfeld Andre et al. 2020 ) . Proper utilization of ECs can provide evidence of effectiveness and safety and accelerate development of new treatments. However, external data are generally different from RCT data. A key first step is to curate and harmonize the different data sources to align the definition and scale of outcomes, treatments and covariates ( Burcu et al. 2020 , e.g.) . Then the analyst must adopt proper statistical procedures to evaluate the treatment effects. Recent work on RCT and EC integration increasingly aligns with the estimand framework outlined in ICH E9 guideline on statistical principles for clinical trials ( ICH E9 (R1) 2020 ) . Estimands are particularly important in this context because the combination of samples from different populations introduces a variety of relevant estimands, each with distinct generalizability. But some earlier methods, e.g., the Bayesian dynamic pooling methods, were generally opaque on the definition of estimands ( Hobbs et al. 2012 ; Banbeta et al. 2019 ; Wang et al. 2022 , e.g.) . A stream of recent research adopts the potential outcome framework in causal inference to elucidate the estimands and assumptions for integrating RCTs and EC data ( Cheng et al. 2023 ; Li et al. 2023 ; Gao et al. 2023 ; Colnet et al. 2024 ; Guo et al. 2024 , e.g.) . These works commonly assume mean exchangeability (ME) of the potential outcomes, namely, conditional on observed covariates, there is no difference in the potential outcomes in the absence of the treatment between the units in the concurrent and external study. However, ME is often implausible in practice, leading to biased treatment effect estimates. Moreover, as we shall show later, the conventional single-index notation of potential outcomes blurs treatment and the source of data (concurrent versus external). Single-index notation obscures the strength of the assumption of ME on which recent literature relies ( Li et al. 2023 ; Gao et al. 2023 ; Colnet et al. 2024 ) . In this paper, we first introduce a double-indexed notation for potential outcomes, based on which we define a new average treatment effect estimand (Section 2 ). Similar notation has been proposed recently in the context of the generalizability of clinical trials ( Dahabreh et al. 2019 ; Ung et al. 2024 ) . We clarify that the concurrent control arm is critical in assessing the plausibility of ME. We provide a weaker version of ME for identifying the causal estimands (Section 3 ) and further provide estimation strategies when ME is violated (Section 4 ). In particular, we derive a consistent and locally efficient semiparametric estimator that combines concurrent and external data without assuming ME. This estimator requires an estimate of the systematic difference in the outcomes between the concurrent and external units, which we propose a novel two-step Frish-Waugh-Lovell type partial regression method to obtain. We further extend the method to a class of weighted average treatment effects estimands (Section 5 ). Finally, we conduct simulations to examine the performance of the proposed method and compare it with existing methods (Section 6 ), and apply the method to a cardiovascular clinical trial (Section 7 ). 2 Double-indexed potential outcomes and estimands Consider a clinical trial that targets the effect of a treatment on an outcome. Such a clinical trial (referred to as concurrent trial hereafter) may be designed to be: (i) a randomized controlled trial with an active treatment arm and a, possibly small, control arm; or (ii) a single-arm trial, where all units are assigned to the active treatment. Under both settings, it may be desirable to augment the small (or non-existing) control arm by external data. We will show it is critical to have a control arm in the concurrent trial, regardless of the sample size, to identify and estimate the treatment effect. 2.1 Notation and Consistency Suppose we have two distinct samples and for each subject i , let Z_{i} denote the data source: Z_{i}=1 and Z_{i}=0 indicate being in the concurrent and external sample, respectively. If the former has N_{1} patients and the latter N_{0} , the combined data has N=N_{1}+N_{0} total patients labeled by i=1,2,\dots,N . Let A_{i} denote the treatment status: A_{i}=1 and A_{i}=0 indicate receiving the active treatment and the control, respectively. In this context, the paired data ( Z , A ) have three possible combinations (1,1), (1,0), and (0,0) because external data are used only for controls and (0,1) can not occur. Under the single-arm trial setting, A_{i}=Z_{i} , so only (1,1) and (0,0) can occur. For each unit, we observe a vector of pre-treatment covariates X_{i} , and an outcome Y_{i} . We use potential outcomes to define causal estimands. The existing literature commonly adopts a single-indexed notation Y_{i}(a) to denote the potential outcome under one of two treatment levels a=0,1 , along with the assumption of consistency, Y_{i}=Y_{i}(1)A_{i}+Y_{i}(0)(1-A_{i}) ( Cole and Frangakis 2009 ; Li et al. 2023 ; Colnet et al. 2024 ) . Consistency is a sub-assumption of the SUTVA ( Rubin 1980 ) and means that

Read the complete text