Improving causal inference in interrupted time series analysis: the triple difference design

Ariel Linden, DrPH · 2026

Read Improving causal inference in interrupted time series analysis: the triple difference design by Ariel Linden, DrPH (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17281.txt.

Introduction

Linden formalizes a triple difference design for interrupted time series analysis, a tool used to judge health policies. Adding a control group sharpens causal claims, but unmeasured shifting factors can still confound. The triple difference design adds a second control group to strip out more bias. Linden specifies the regression model and defines the key parameters for level and trend effects. A worked example studies California's Proposition 99 cigarette tax. There, the design found a significant yearly drop in per capita cigarette sales.

Catalog record

CREATORAriel Linden, DrPH
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25516
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.17281

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Improving causal inference in interrupted time series analysis: the triple difference design Ariel Linden, DrPH Abstract Background: Interrupted time series analysis (ITSA) is a valuable quasi-experimental design for evaluating health policy and intervention effects. While multiple-group ITSA (MG-ITSA) strengthens causal inference by incorporating a control group, residual confounding from unmeasured time-varying factors may persist. The triple-difference interrupted time series (DDD-ITSA) design extends this framework by adding a second control group to further isolate treatment effects, yet the design remains underutilized and lacks formal methodological guidance. Methods: This paper formalizes the DDD-ITSA design for health research. We specify the underlying regression model, define the key coefficients for estimating level and trend effects, and clarify the interpretation of the triple-difference estimand. We also illustrate application of the design using a worked example evaluating the effect of California’s Proposition 99 cigarette tax increase on per-capita cigarette sales. Results: The DDD-ITSA model provides clear parameterization for assessing baseline balance across groups and estimating differential treatment effects. In the stylized Proposition 99 example, all groups demonstrated balance on pre-intervention level and trend. The triple-difference estimand revealed a statistically significant annual net reduction of -1.76 per-capita cigarette packs in California relative to the secondary control (P = 0.020; 95% CI: -3.24, -0.28), consistent with the treatment effect observed against the primary control. The difference-in-differences between the two control groups was non-significant, supporting the validity of the comparison. Conclusions: The DDD-ITSA design offers a robust approach for strengthening causal inferences when two-group comparisons may be confounded. By leveraging an additional control group, researchers can difference out remaining biases and assess effect heterogeneity across subgroups. The updated itsa package for Stata facilitates implementation, making this design accessible for routine application in health policy research. Careful attention to control group selection, baseline balance, and autocorrelation remains essential for valid interpretation. Keywords difference-in-difference-in-differences, triple differences, interrupted time series analysis, controlled interrupted time series analysis, multiple-group interrupted time series analysis 1 Background Interrupted time series analysis (ITSA) is widely used in healthcare research to estimate the causal effects of interventions, policy changes, and natural events when randomized designs are infeasible. The approach relies on sequential outcome measurements collected at equally spaced intervals, typically aggregated at the unit level (e.g., hospitals, regions, or populations) and summarized as rates, counts, or mean expenditures. In its canonical form, a single unit is exposed to an intervention that is hypothesized to generate a structural change (“interruption”) in the level and/or slope of the outcome process at a known point in time [ 4 , 24 ] . Identification in this framework is achieved by using the pre-intervention segment of the series to extrapolate the counterfactual post-intervention trajectory under the assumption that, absent the intervention, the underlying data-generating process would have continued unchanged. The use of multiple pre-intervention observations partially addresses threats such as regression to the mean and improves internal validity relative to simpler before–after comparisons [ 4 , 24 , 13 ] . Despite these strengths, single-group ITSA (SG-ITSA) rests on the strong identifying assumption that no unmeasured, time-varying confounders or coincident events affect the outcome at the time of intervention. When this assumption is violated (such as in the presence of secular trends, anticipatory behavior, or concurrent policy changes), SG-ITSA may produce biased estimates of the intervention effect. Empirical evidence indicates that SG-ITSA can yield misleading inferences when pre-intervention trends already exhibit directional change or when external influences evolve contemporaneously with the intervention [ 12 , 16 , 17 ] . Multiple-group or controlled ITSA (MG-ITSA) addresses these threats by introducing control units that were not exposed to the intervention but share similar baseline levels, pre-intervention trends, and observed characteristics with the treated unit [ 14 , 1 , 18 ] . By differencing outcomes between treated and control series over time, MG-ITSA relaxes the strong assumption of stable counterfactual trends within a single unit and instead relies on a parallel-trends-type assumption across groups [ 14 , 18 ] . Under this framework, causal effects are identified by removing secular trends and common shocks that affect all units similarly, aligning MG-ITSA conceptually with difference-in-differences estimators [ 23 ] . However, when treatment effects are expected to vary across an additional dimension, such as subpopulations, exposure intensity, or policy eligibility, standard MG-ITSA may remain insufficient to isolate the causal effect of interest. A triple-difference interrupted time series (DDD-ITSA) design extends the logic of the MG-ITSA by adding a second control group for comparison. This approach mirrors the difference-in-differences-in-differences (DDD) framework in the econometrics literature, where an additional difference is used to remove remaining confounding that may persist after a standard two-group comparison [ 21 ] . In the ITSA context, the triple-difference estimator captures whether the post-intervention change in level and/or trend for the treated group is larger (or smaller) for the subgroup of interest than would be expected based on concurrent changes in control groups and comparison subgroups. By differencing across time, groups, and subgroups simultaneously, the DDD-ITSA design strengthens causal identification under assumptions analogous to those in the difference-in-differences (DiD) literature, namely that, absent the intervention, these differences would have evolved similarly over time [ 23 ] . Applications that explicitly implement a DDD-ITSA framework remain relatively uncommon in the literature. One applied example is the evaluation of Maryland’s global budget revenue (GBR) model, where researchers used an interrupted time-series design with difference-in-differences comparisons and a triple differences analysis to assess changes in emergency department utilization, admissions, and revisits following GBR implementation, including how these trends varied across racial/ethnic and payer groups [ 7 ] . In this study, the triple-difference component helped identify differential effects of the policy on emergency department return outcomes across subpopulations beyond general statewide trends and group-level effects. Another example is research on the effects of the Affordable Care Act (ACA) on health insurance coverage among Latino subgroups, which combined ITSA with triple-difference models to evaluate heterogeneous changes in uninsured rates associated with the ACA and Medicaid expansion across multiple Latino ethnic groups [ 8 ] . This paper formalizes the DDD-ITSA framework for applied health research. We describe the design, detail the underlying statistical model, clarify the interpretation of the key coefficients that identify level and trend effects, and present a worked empirical example to illustrate implementation and interpretation. We also provide practical guidance regarding identification assumptions, model specification, and appropriate use cases for the design. To facilitate applied use, the itsa package for Stata [ 14 ] has been updated to estimate DDD-ITSA models, enabling researchers to easily implement the approach using their data. 2 Methods 2.1 The DDD-ITSA design The DDD-ITSA design is an extension of the MG-ITSA design to an additional control group that is either geographically distant from the treatment and primary control groups, or comprises a different demographic that still allows for comparison (e.g., type of insurance coverage, different medical condition, ethnicity, etc.). This second control group may be thought of as adding a “doubly robustness” property to the analysis, in that it provides a second opportunity to get the causal inference correct if the treatment versus primary control is confounded. Figure 1 illustrates four of the many potential outcome scenarios that we could anticipate in the DDD-ITSA design when emphasizing

Read the complete text