Finite Population Inference for Factorial Designs and Panel Experiments with Imperfect Compliance

Pedro Picchetti · 2026

Read Finite Population Inference for Factorial Designs and Panel Experiments with Imperfect Compliance by Pedro Picchetti (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16749.txt.

Introduction

Pedro Picchetti builds a clean frame for cause work in two hard trial types. Some trials give each unit a mix of more than one cure. Others track the same units through time in steps. In both, some units skip their set cure. Their 2026 preprint sets out cause marks for such trials as fixed pools.

Fixed-pool marks treat the test crowd as the whole world. No vast unseen crowd sits in the back. The marks gauge how cure chains stack up. Which chain works best is the core ask. Clean marks help drug and policy trials read right. They curb claims that reach past the test crowd.

Catalog record

CREATORPedro Picchetti
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE99 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-16749

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Finite Population Inference for Factorial Designs and Panel Experiments with Imperfect Compliance Pedro Picchetti Abstract This paper develops a finite population framework for analyzing causal effects in settings with imperfect compliance where multiple treatments affect the outcome of interest. Two prominent examples are factorial designs and panel experiments with imperfect compliance. I define finite population causal effects that capture the relative effectiveness of alternative treatment sequences. I provide nonparametric estimators for a rich class of factorial and dynamic causal effects and derive their finite population distributions as the sample size increases. Monte Carlo simulations illustrate the desirable properties of the estimators. Finally, I use the estimator for causal effects in factorial designs to revisit a famous voter mobilization experiment that analyzes the effects of voting encouragement through phone calls on turnout. Keywords: Causal Inference, Factorial Designs, Dynamic Causal Effects, Finite Population, Nonparametric. 1 Introduction In a seminal paper, 9 showed that the instrumental variables (IV) estimand in cross-sectional settings with a binary treatment and a binary instrument can be interpreted as the Local Average Treatment Effect (LATE), defined as the average treatment effect for the subpopulation that has its treatment status shifted by an excluded instrument, the so-called compliers. However, several applications of IV methods deviate from the canonical setting. For instance, it is common to see researchers using IV methods in settings which the outcome depends on multiple treatments. Prominent examples are factorial designs ( 8 , 13 ) and panel experiments ( 19 ) with imperfect compliance. In such settings, it is well known that standard IV methods can lead to misleading conclusions regarding causal effects. In this paper, I develop a novel nonparametric identification approach for causal effects in factorial designs and panel experiments. Using standard instrumental variables assumptions along with a exclusion restriction for treatments, I show that causal effects associated to sequences of treatments (a vector of factors of interest, or the path of treatments taken through time), can be identified by exploiting variations in the sequence of assignments associated to such treatments. The intuition behind this result is simple: under the treatment exclusion restriction, if we are interested in the effect of a single treatment, we identify its causal effects for compliers of its assignment by exploiting variations in that assignment. If we are interested in the causal effects of a sequence of two treatments, we identify causal effects by exploiting variations in the four possible assignments in a difference-in-differences format. In the case of a sequence of three treatments causal effects are identified using triple-differences, and so on. My approach takes a purely design-based perspective on uncertainty, which allows for potential outcomes models to remain unspecified. I propose nonparametric estimators for causal effects which are consistent over the randomization distribution and derive their finite population asymptotic distributions. I use the results to propose valid inference procedures, which are potentially conservative in the presence of heterogeneous causal effects. I conduct Monte Carlo simulation studies to analyze the properties of these estimators. The results show that the estimators exhibit desirable performance in terms of bias and confidence interval coverage, both in the factorial design and the panel experiment settings. Finally, I revisit the work of 13 and apply the estimators in a real life famous factorial experiment from the political science literature, which studies the effects of voting encouragements through phone calls in turnout. This paper contributes to several strands of the causal inference literature. First, to the literature on factorial designs with imperfect compliance ( 7 , 2 , 18 , 1 ) . More specifically, I rely on the same assumptions as 2 and 1 , but define a new, rich class of causal effects and provide a new nonparametric estimator. Second, to the literature on dynamic causal effects in the tradition of 15 , 16 and 12 , where potential outcomes in a given period depend on the path of treatments taken until that period. I focus on the case of imperfect compliance and the identification of lag- p dynamic causal effects, defined by 5 . I extend the results of 4 to the case of panel experiments with imperfect compliance. I motivate my approach for the identification of dynamic causal effects by showing that standard IV estimands in general do not have a straightforward causal interpretation in the presence of dynamic causal effects even in the case where the exclusion restriction for treatments hold. See Appendix C for a causal decomposition of the Wald estimand in a setting with two time periods. Finally, the paper relates to the literature on design-based inference in IV settings ( 10 ; 11 ; 14 , 6 ). While these papers focus solely on estimators for IV settings with a single treatment and a single instrument, I focus on settings with multiple treatments and instruments. While Blackwell 2023 also provides finite population inference procedures, this is the first paper that studies design-based inference in panel experiments with imperfect compliance, to the best of my knowledge. The paper is organized as follows. In Section 2 I introduce the framework for factorial designs and provide the identification results, estimators and its asymptotic properties for this setting. In section 3 I proceed similarly, but focus on the case of panel experiments. In Section 4 I conduct Monte Carlo simulations to analyze the properties of the estimators introduced previously, and in Section 5 I apply the techniques developed in Section 2 to the voter mobilization empirical application. Section 6 concludes. The supplemental appendix contains the proofs of the theorems presented in this paper and the auxiliary lemmas. 2 Factorial Designs 2.1 Framework and Target Parameters Consider a setting in which N units are part of an experiment with K binary factors with levels \left\{0,1\right\} , where 0 denote the untreated level and 1 denote the treated level. Let Z_{i,k} be an indicator for units assigned to the treated level for factor k and D_{i,k} denote an indicator for units that uptake treatment in factor k . Index sets are compactly written as [N]:=\left\{1,...,N\right\} and [K]:=\left\{1,...,K\right\} . Imperfect compliance arises from the fact that not all units assigned to treatment in factor k actually take treatment, and not all units assigned to control remain untreated, that is, for all k\in[K] , D_{i,k}\neq Z_{i,k} for some i\in[N] . For an individual i , I denote the vectors of treatment and assignments up to factor k respectively as D_{i,1:k} and Z_{i,1:k} . Vectors of treatments and assignments that do not contain elements for factors k-p to k are defined as D_{i,-(k-p:k)} and Z_{i,-(k-p:k)} . For a given factor k , I denote the cross-section of treatments and assignments respectively as D_{1:N,k} and Z_{1:N,k} . Collections over individuals and factors are denoted by D_{1:N,1:K} and Z_{1:N,1:K} . Without further restrictions, potential outcomes of unit i are a function of the full sequence of treatments and assignments, Y_{i}(d_{1:N,1:K},z_{1:N,1:K}) , and potential treatments are a function of the full sequence of assignments, D_{i,k}(z_{1:N,1:K}) . The next assumptions are invoked for identification. Assumption 1 (No-Spillovers Across Units): For all i\in[N] and k\in[K] , \displaystyle Y_{i}=\sum_{(d_{1:K},z_{1:K})\in\left\{0,1\right\}^{K\times K}}\mathbf{1}\left\{D_{i,1:K}=d_{1:K},Z_{i,1:K}=z_{1:K}\right\}Y_{i}(d_{1:K},z_{1:K}), \displaystyle D_{i,k}=\sum_{(z_{1:K})\in\left\{0,1\right\}^{K}}\mathbf{1}\left\{Z_{i,1:K}=z_{1:K}\right\}D_{i,k}(z_{1:K}) Assumption 1 imposes that the potential outcome of unit i depends only on the treatments and assignments of

Read the complete text