Unifying regression-based and design-based causal inference in time-series experiments
Zhexiao Lin and Peng Ding · 2025
Read Unifying regression-based and design-based causal inference in time-series experiments by Zhexiao Lin and Peng Ding (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22864.txt.
Introduction
Time series experiments switch treatments back and forth over time. Zhexiao Lin and Peng Ding unify two inference views in 2025. One view is regression based. The other is design based, using only design randomness. Switchback trials and N-of-1 trials are examples.
They study design based traits of regression methods. Treatment effects can be estimated by ordinary least squares. That needs a suitable working model and transformed regressors. Many effects can be estimated at once. Even a diverging number is allowed. Estimators stay consistent and asymptotically normal. Variance estimators stay conservative under their results. Model misspecification does not break the design based logic.
Catalog record
| CREATOR | Zhexiao Lin and Peng Ding |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 150 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-22864
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Unifying regression-based and design-based causal inference in time-series experiments Zhexiao Lin and Peng Ding Abstract Time-series experiments, also called switchback experiments or N-of-1 trials, play increasingly important roles in modern applications in medical and industrial areas. Under the potential outcomes framework, recent research has studied time-series experiments from the design-based perspective, relying solely on the randomness in the design to drive the statistical inference. Focusing on simpler statistical methods, we examine the design-based properties of regression-based methods for estimating treatment effects in time-series experiments. We demonstrate that the treatment effects of interest can be consistently estimated using ordinary least squares with an appropriately specified working model and transformed regressors. Our analysis allows for estimating a diverging number of treatment effects simultaneously, and establishes the consistency and asymptotic normality of the regression-based estimators. Additionally, we show that asymptotically, the heteroskedasticity and autocorrelation consistent variance estimators provide conservative estimates of the true, design-based variances. Importantly, although our approach relies on regression, our design-based framework allows for misspecification of the regression model. Keywords : carryover effect, randomization inference, robust standard error, switchback experiment. 1 Introduction to time-series experiments Time-series experiments, also referred to as switchback experiments or N-of-1 trials, have attracted increasing attention across a variety of domains, including clinical trials ( Lillie et al., 2011 ) , online platforms ( Bojinov et al., 2023 ) , and other applied settings ( Gabler et al., 2011 ; Mirza et al., 2017 ; Hawksworth et al., 2024 ) . Unlike traditional randomized controlled trials, which assign treatments at the unit level and maintain a fixed assignment throughout the study, time-series experiments repeatedly randomize treatment assignments over time for the same, single experimental unit. Time-series experiments are closely related to longitudinal experiments ( Robins, 1986 ) , but focus on dynamic treatment effects on the same unit rather than average effects over a population. This experiment design allows for capturing dynamic causal effects in environments where both treatments and outcomes evolve over time and where treatment effects vary across time periods. Such designs are particularly attractive in modern applications where repeated interventions are feasible, the number of experimental units is limited, and the research interest is to estimate time-varying or lagged treatment effects. Bojinov and Shephard, 2019 provided a concrete example of a time-series experiment conducted at AHL Partners LLP, a quantitative hedge fund that randomly assigned large trading orders to either human traders or computer algorithms to compare execution performance. Their example is a time-series experiment with sequential treatment assignments, where the outcome of interest is the relative performance across 10 equity-index futures markets over the course of a year. Despite the wide applications of time-series experiments, the statistical analysis presents challenges, mainly due to the temporal dependence of outcomes and the risk of model misspecification. In time-series experiments, the treatment effects may persist beyond the period of assignment, inducing the dependence of the observed outcomes on past treatments. Consequently, the methods for analyzing traditional randomized experiments is not applicable. The design-based perspective offers a principled way to avoid strong assumptions on the outcome model. By viewing the treatment assignment as the sole source of randomness, we propose treatment effect estimates with desirable properties without strong model assumptions. This perspective builds on a rich literature on design-based analysis for various experimental settings, including regression analysis for completely randomized experiments ( Lin, 2013 ) , matched-pairs experiments ( Fogarty, 2018 ) , split-plot designs ( Zhao and Ding, 2022 ; Mukerjee and Dasgupta, 2022 ) , cluster-randomized experiments ( Middleton and Aronow, 2015 ; Su and Ding, 2021 ) , and network experiments ( Aronow and Samii, 2017 ; Leung, 2022 ; Gao and Ding, 2023 ) . Recent comprehensive reviews are available in Shi and Li, 2024 and Ding, 2025 . However, the design-based analysis of regression-based estimators in time-series experiments remains under explored. In this paper, we develop a unified design-based framework for analyzing regression-based estimators in time-series experiments. We show that regressing the observed outcomes on current and past treatments using an appropriately specified working model and transformed regressors yields estimates of the lagged treatment effects of interest, even when the number of regressors diverges with the length of the time series. A key feature of our working model is the centering and scaling of treatment indicators, which ensures the regression coefficients to recover the causal estimands of interest. We establish the consistency and asymptotic normality of the ordinary least squares (OLS) and show that heteroskedasticity and autocorrelation consistent (HAC) variance estimators provide conservative variance estimates. Our results do not require the regression model to be correctly specified, reflecting the robustness inherent to the design-based analysis. Our work is related to Bojinov and Shephard, 2019 and Liang and Recht, 2025 , who also develop design-based analyses for time-series experiments. However, our paper differs from theirs at two levels. First, at the level of estimands, we focus on treatment effects defined independently of the realized treatment path and outcome model assumptions. Second, at the level of estimators, we focus on simpler, regression-based point and variance estimators. We will provide a detailed comparison in the next section. The remainder of the paper is organized as follows. Section 2 introduces the setup of the time-series experiment, defines the causal estimand of interest, and presents our regression-based estimator. Section 3 develops the asymptotic theory, establishing consistency, asymptotic normality, and variance estimation. Section 4 discusses the extension to the continuous treatment. Section 5 presents empirical studies, including simulation evidence and an application to the trading experiment data previously analyzed by Bojinov and Shephard, 2019 . Section 6 concludes with a discussion of possible directions for future research. The online supplementary materials contain extensions to the regression with interaction terms and general exposure mapping, as well as the technical details. Notation. For a vector a=(a_{1},\ldots,a_{d})^{\top}\in\mathbb{R}^{d} , let \lVert a\rVert_{1}=\sum_{i=1}^{d}\lvert a_{i}\rvert , and \lVert a\rVert_{2}=(\sum_{i=1}^{d}a_{i}^{2})^{1/2} . For a matrix A=(a_{ij})\in\mathbb{R}^{m\times n} , let \|A\|_{\mathrm{F}}=(\sum_{i=1}^{m}\sum_{j=1}^{n}a_{ij}^{2})^{1/2} denote the Frobenius norm, and \lVert A\rVert_{2} denote the spectral norm. Following the R syntax, we use \textbf{lm}(Y\sim X) to denote the linear regression model with outcome Y and regressors X . 2 Setup, estimand and estimator 2.1 Setup Consider a time-series experiment with a binary treatment and a single unit repeatedly measured at T time points. At each time point t=1,\ldots,T , we apply Z_{t}=0 for the control and Z_{t}=1 for the treatment. For each time point t , define the treatment history up to t as z_{t:1}=(z_{t},z_{t-1},\ldots,z_{1}) . Let \{Y_{t}(z_{T},\ldots,z_{1}):z_{T},\ldots,z_{1}=0\text{ or }1\}_{t=1}^{T} denote the potential outcomes, which can depend on the whole treatment history. We first simplify the potential outcomes by imposing the no-anticipation assumption below. Assumption 2.1 (No-anticipation) . For every possible treatment path (z_{1},\ldots,z_{T}) , the potential outcome at time t depends only on the treatment history up to and including time t , but does not depend on any future treatments z_{t+1},\ldots,z_{T} : Y_{t}(z_{T},\ldots,z_{t+1},z_{t},\ldots,z_{1})=Y_{t}(z_{t},\ldots,z_{1}),~\text{for all}~t=1,\ldots,T. Under the no-anticipation assumption (Assumption 2.1 ), the observed outcome simplifies to Y_{t}=Y_{t}(z_{t:1}) , where z_{t:1}=(z_{t},\ldots,z_{1}) represents the treatment history up to and including time t , following the notation in Bojinov and Shephard, 2019 . The no-anticipation assumption holds when treatments are rapidly randomized (e.g., online experiments), or treatments are administered sequentially (e.g., clinical