Experimental Design When N Equals One
Wenxuan Guo, Tengyuan Liang · 2026
Read Experimental Design When N Equals One by Wenxuan Guo, Tengyuan Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28200.txt.
Introduction
Wenxuan Guo and Tengyuan Liang study experiments with a sample size of one. In N-of-1 trials, a single person or platform is observed over time and treatments are switched on and off, a design common in clinical research and online testing. Which switching pattern estimates many treatment effects best was unclear.
Guo and Liang model the assignment process as a Markov chain, where today's treatment depends on yesterday's through transition probabilities they can design. Their framework contains many existing designs. Focusing on random-switch and cycle-switch patterns, they build a complete large-sample theory for the optimal versions of both. One reassuring result justifies simple coin-flip designs as robust. They also show how the best design shifts with the target, whether cumulative effects or effects at specific delays.
Catalog record
| CREATOR | Wenxuan Guo, Tengyuan Liang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28200
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Experimental Design When N Equals One Wenxuan Guo, Tengyuan Liang Abstract N-of-1 trials, or time-series experiments, are widely used in clinical research and online platforms. Yet the theoretically optimal design for estimating many treatment effects remains unclear. We propose a simple Markovian framework for experimental design in which the treatment assignment process is governed by possibly time-varying transition matrices. This formulation encompasses many existing N-of-1 designs and provides a principled way to control temporal dependence in treatment assignment through Markov transition probabilities. Under a finite-order impulse-response model, we formulate the design objective as minimizing the estimation error of ordinary least squares estimators for target treatment effects, and propose practical design optimization procedures. To characterize the optimal temporal structure, we focus on two structured design classes, random-switch and cycle-switch designs, and establish a complete large- T T asymptotic theory for the optimal designs in both classes. Our results justify the robustness of i.i.d. Bernoulli designs in N-of-1 trials and quantify how the optimal design depends on the target estimand, including cumulative and lag-specific treatment effects. Simulations demonstrate the effectiveness and robustness of the proposed designs across multiple scenarios. Keywords— causal inference, Markov chain, experimental design, time series. 1 Introduction N-of-1 trials, also referred to as time-series experiments, have been widely applied in clinical research ( 25 ) , online platforms ( 7 ) , and other domains ( 28 ; 18 ) . In such trials, treatment assignment is repeatedly randomized over time for a single experimental unit. N-of-1 trials allow treatment assignments and outcomes to evolve over time, making them particularly attractive in modern applications where repeated interventions are feasible, experimental units are limited, and the scientific objective is to estimate cumulative or lagged treatment effects. Moreover, N-of-1 trials are naturally suited for individualized treatment evaluation, allowing investigators to assess treatment effects at the level of a single experimental unit ( 5 ; 24 ) . Despite their growing popularity, the choice of optimal design in N-of-1 experiments remains to be elucidated. A central difficulty is that different target effects favor different forms of temporal dependence in the treatment assignment path. For example, independent Bernoulli assignment is commonly used for estimating lag-specific treatment effects ( 26 ; 24 ) , whereas switchback designs, which hold treatment fixed over consecutive time windows, are often used for estimating cumulative or carryover effects. These examples suggest that design should be tailored to the target estimand, but they do not provide a general principle on experimental design. In particular, with a few exceptions ( 7 ; 10 ) , optimal designs for a given estimand remain poorly characterized. The problem becomes even less clear when the target is a class of estimands, such as multiple lag-specific effects or cumulative effects over different time windows. Thus, there is a need for a general design framework that can flexibly target different treatment effects while providing optimality guarantees. In this paper, we adopt a Markovian viewpoint and model the design of N-of-1 trials through Markov transition matrices. Specifically, we model the treatment assignment path Z_{1},\dots,Z_{T} as a Markov chain, with the transition from Z_{t} to Z_{t+1} governed by P_{t}=\begin{bmatrix}1-\rho_{t}&\rho_{t}\\ \gamma_{t}&1-\gamma_{t}\\ \end{bmatrix}\;,\hskip 9.24994pt\rho_{t},\gamma_{t}\in[0,1]\;. The two states of the Markov chain correspond to control and treatment, respectively. The Markovian viewpoint provides a characterization of the treatment assignment distribution, and encompasses the existing designs as special cases. For instance, by setting \rho_{t}+\gamma_{t}=1 , we recover the independent time-series experiments in 24 and 26 (Example 2.2 ). By enforcing a periodic structure on P_{t} , we recover the switchback experiments in 7 ; 10 (Example 2.3 ). To define the design objective and search for the optimal design, we follow the literature on dynamic treatment effects and temporal interference ( 15 ; 40 ; 24 ) and adopt a finite-order impulse-response model. Specifically, we assume that outcomes depend additively on the current and past treatment assignments through Y_{t}=\alpha+\sum_{k=1}^{K}\beta_{k}Z_{t-k+1}+\epsilon_{t}\;. (1.1) Here, \{y_{t}\}_{t=K}^{T} are the (potentially detrended) outcomes, \{\epsilon_{t}\}_{t=K}^{T} are i.i.d. errors, and \beta_{k} captures the effect of a treatment assignment after k-1 periods. The impulse-response model enables the estimation of a large class of treatment effects from linear combinations. For a given estimand vector w=(w_{1},\dots,w_{K})^{\top}\in\mathbb{R}^{K} , we define the target treatment effect and its estimator as \tau_{w}=\sum_{k=1}^{K}w_{k}\beta_{k}\;,\hskip 18.49988pt\widehat{\tau}_{w}=\sum_{k=1}^{K}w_{k}\widehat{\beta}_{k}\;. Here, \widehat{\beta}_{k} , k=1,\dots,K are ordinary least squares (OLS) estimates from Model ( 1.1 ). Then, our goal is to find the optimal design under the Markovian modeling that minimizes the estimation error \var(\widehat{\tau}_{w}) . The Markovian framework, combined with the impulse-response model, offers several advantages for addressing the experimental design problem in N-of-1 trials. First, it allows experimenters to evaluate the estimation error—namely, \var(\widehat{\tau}_{w}) —of candidate designs before running the experiment. Second, by imposing structured restrictions on the candidate design class, the design problem can be formulated as an optimization problem over Markov parameters, yielding a tractable approach to design selection. Last, when the experimenter is interested in multiple treatment effects (through multiple w ), the design selection procedure can be naturally extended to control multiple estimation variances through a minimax optimization criterion. We illustrate the three advantages through a visualization of the design selection procedure. In Figure 1 , each row represents a candidate design parameterized by \{(\rho_{t},\gamma_{t})\}_{t=1}^{T-1} , and each column represents a target effect. The color of each cell indicates the estimation error for the corresponding design-target pair, with the smallest error in each column marked by a red circle. The final column aggregates the target-specific errors by their worst-case value, following the minimax design perspective ( 2 ; 11 ) . effect 1 effect 2 effect 3 \cdots effect J\!-\!1 effect J worst-case design 1 \cdots design 2 \cdots design 3 \cdots design 4 \cdots design 5 \cdots Figure 1: Illustration of minimax design optimization. Each row represents a candidate design and each column represents an estimand. The omitted middle estimands are indicated by dots. To gain insight into the temporal dependence structure of the optimal design, we further study the theoretical behavior of the optimal design parameters. Specifically, we focus on two structured classes of designs and examine optimal temporal dependence through two complementary features: the switching probabilities over time and the lengths of persistent treatment and control periods. 1. Optimal design theory for switching probabilities (Section 4 ): We consider a structured class of random-switch designs with a constant Markov transition matrix, that is, \rho_{t}=\rho and \gamma_{t}=\gamma . Under such designs, the temporal treatment dependence is fully characterized by the switching probabilities \rho and \gamma . We analyze the behavior of optimal design parameters \rho^{\star} and \gamma^{\star} for a variety of target treatment effects. 2. Optimal design theory for persistent treatment cycles (Section 5 ): We consider another structured class of cycle-switch designs as deterministic treatment assignment processes in which the treatment status switches every l time points. We characterize the optimal block length l^{\star} for different target effects. Based on the theoretical analysis, Table 1 summarizes several preferred design patterns in terms of switching probabilities and block lengths. From the switching-probability perspective, the optimal switching probability is 1/2 for estimating lag-specific treatment effects and for constructing robust designs, which corresponds to the i.i.d. Bernoulli(1/2) randomization. By contrast, for cumulative treatment effects, the optimal switching probability moves