Estimating the Complier Average Causal Effect in Randomised Controlled Trials with Non-Compliance: A Comparative Simulation Study of the Instrumental Variables and Per-Protocol Analyses

Theodosios Papazoglou, Ed Waddingham, Alastair Young · 2025

Read Estimating the Complier Average Causal Effect in Randomised Controlled Trials with Non-Compliance: A Comparative Simulation Study of the Instrumental Variables and Per-Protocol Analyses by Theodosios Papazoglou, Ed Waddingham, Alastair Young (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17692.txt.

Introduction

Theodosios Papazoglou, Ed Waddingham, and Alastair Young present a 2025 statistics paper on measuring a treatment's effect among patients who actually follow it. In trials, some patients stray from their assigned treatment, and the average effect then blurs the answer. The effect among compliers is often the fairer measure of how well a treatment can work.

Two common routes to that measure are compared: a per-protocol analysis, which keeps only followers, and an instrumental variables analysis, which uses the random assignment itself as a lever. The team simulated trials modelled on a real study to see which route is less biased and more precise. Their findings guide analysts facing non-compliance.

Catalog record

CREATORTheodosios Papazoglou, Ed Waddingham, Alastair Young
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-17692

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Estimating the Complier Average Causal Effect in Randomised Controlled Trials with Non-Compliance: A Comparative Simulation Study of the Instrumental Variables and Per-Protocol Analyses Theodosios Papazoglou, Ed Waddingham, Alastair Young Abstract Objective: Randomised controlled trials (RCTs) are widely considered as gold standard for assessing the effectiveness of new health interventions. When treatment non-compliance is present in RCTs, the treatment effect in the subgroup of participants who complied with their original treatment allocation, the Complier Average Causal Effect (CACE), is a more representative measure of treatment efficacy than the average treatment effect. Through simulation we aim to compare the two most common methods employed in practice to estimate CACE. Methods: We considered the Per-Protocol and Instrumental Variables (IV) analyses. Based on a real study, we simulated hypothetical trials by varying factors related to non-compliance and compared the two methods by the bias of the estimate, mean squared error and 95 % 95\% coverage of the true value. Results: For binary compliance, the IV estimator was always unbiased for CACE, while the Per-Protocol estimator was unbiased for random non-compliance or when participants with good or bad conditions always received the treatment. For partial compliance, the IV estimator was less biased when participants with better conditions always received the treatment and those with worse conditions always received the control or vice versa, while the Per-Protocol estimator was less biased when participants with good or bad conditions never received the treatment. August 24, 2026 K eywords Randomised Controlled Trial \cdot CACE \cdot Instrumental Variables \cdot Per-Protocol \cdot Compliance \cdot CPAP \cdot Simulation 1 Introduction Randomised controlled trials (RCTs) are widely considered as gold standard for evaluating the effectiveness of an intervention and can establish a causal relationship between the intervention and an improved disease outcome ( Tripepi et al., 2020 ) . In RCTs, participants are randomly assigned to either a treatment or a control group, where in the latter, participants may either receive an existing standard treatment or a placebo. The statistical framework for causal inference in RCTs is based on the potential outcomes framework which was first introduced by Neyman (1923) for randomised experiments and was later extended by Rubin (1974) for randomised and non-randomised experiments, hence it is usually referred to as Rubin’s Causal Model (RCM). In this framework, each participant is assumed to have a pair of potential outcomes which are sometimes called counterfactual outcomes; an outcome that would have been observed under the active treatment and an outcome that would have been observed under the control treatment. A causal effect, for an individual, is defined as the difference between these two outcomes. In reality, however, only one of the two outcomes can be observed and thus causal inference cannot be made at an individual level. Instead, a causal effect can be defined at the population level by considering the difference of the average value of the potential outcomes when all participants are assigned to the active treatment and the average value of the potential outcomes when all participants are assigned to the control treatment. This is usually referred to as the Average Treatment Effect (ATE) and is the primary estimand of interest in an RCT. The main analysis employed to estimate the ATE is an Intention-to-Treat (ITT) analysis. The ITT analysis compares the outcomes of participants based on their treatment assignment regardless of the actual receipt of treatment ( Tripepi et al., 2020 ) . However, in RCTs, treatment compliance is rarely perfect ( Kamper, 2021 ) . Common examples of non-compliance are treatment crossover, failure to comply with the original treatment allocation and administrative error to name a few. The presence of non-compliance makes inference for causal effects more complicated ( Little and Rubin, 2000 ) . In the presence of non-compliance, the ATE is a representative measure of treatment effectiveness and not of treatment efficacy; the effect of actually receiving the treatment, which might be of interest to investigators ( McNamee, 2009 ) . A more meaningful measure of treatment efficacy is the treatment effect in the subgroup of participants who complied with the original treatment allocation, which is called the Complier Average Causal Effect (CACE) or the Local Average Treatment Effect (LATE) and was first introduced by Imbens and Angrist (1994) and later extended by Angrist et al. (1996) . Imbens and Angrist stratified participants into four different strata based on their potential treatment receipt under assignment of treatment and control. The four different strata are the compliers, who would receive the treatment if assigned to it and would not receive the treatment if assigned to the control, the never-takers, who would never receive the treatment regardless of their assignment, the always-takers, who would always receive the treatment regardless of assignment and the defiers, who would always do the opposite of what they were assigned to. In practice, we can only observe the treatment receipt for one of the two assigned treatments. The stratification into the four different strata based on the potential receipt of treatment creates a conceptual definition of compliers that is different to the observed compliers and should not be confused. Specifically, we can only observe never-takers in the treatment group but not in the control group and similarly, we can observe always-takers in the control group but not in the treatment group. Provided that certain assumptions hold ( Angrist et al., 1996 ) , we can estimate the proportions of true compliers, never-takers and always-takers using the observed data. Additionally, under these assumptions, CACE is a well-defined causal effect and is an example of a principal stratum estimand, as it compares the potential outcomes under standard versus new treatment within the same subgroup of participants, the compliers stratum ( Frangakis and Rubin, 2002 ) . Two methods are usually employed in practice to estimate CACE, the Per-Protocol analysis and the Instrumental Variables (IV) analysis; although the Per-Protocol analysis is usually criticised in the literature as a method that can estimate neither CACE nor any other meaningful causal effect ( Little and Rubin, 2000 ) , ( Bang and Davis, 2007 ) . A Per-Protocol analysis excludes participants who did not comply with the study protocol and compares participants who adopted their original assigned treatments based on the study protocol. By doing so, participants in the Per-Protocol analysis may no longer be comparable for known or unknown confounding characteristics that are related to compliance and results tend to be biased ( Kamper, 2021 ) . An alternative method is the IV analysis which was first introduced as a method to estimate CACE in ( Imbens and Angrist, 1994 ) and extended in ( Angrist et al., 1996 ) , ( Imbens and Rubin, 1997 ) and ( Little and Yau, 1998 ) . An IV analysis, uses the treatment assignment as an instrument and estimates CACE using a two-stage least squares regression. The IV method requires strong assumptions hold which are not always easily verifiable in practice, however it overcomes the main limitation of the Per-Protocol analysis by preserving randomisation therefore it is expected to provide unbiased results. In the past, several studies have employed simulation analyses in order to compare statistical methods that account for non-compliance in RCTs ( Abell et al., 2023

Read the complete text