Permutation Inference under Multi-way Clustering and Missing Data

Wenxuan Guo, Panos Toulis, Yuhao Wang · 2026

Read Permutation Inference under Multi-way Clustering and Missing Data by Wenxuan Guo, Panos Toulis, Yuhao Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08610.txt.

Introduction

Wenxuan Guo, Panos Toulis, and Yuhao Wang develop permutation inference for regressions with multi-way clustering. Their 2026 arXiv paper notes that such applications often have few effective clusters or heavy-tailed data. Standard cluster-robust and bootstrap inference then prove unreliable in finite samples. Missing data add a further complication in the same settings. The authors build finite-sample valid permutation inference under conditional exchangeability of errors. Economists with clustered panel data gain tests whose stated error rates can be trusted at real sample sizes.

Catalog record

CREATORWenxuan Guo, Panos Toulis, Yuhao Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE109 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-08610

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Permutation Inference under Multi-way Clustering and Missing Data Wenxuan Guo, Panos Toulis, Yuhao Wang Abstract Econometric applications with multi-way clustering often feature a small number of effective clusters or heavy-tailed data, making standard cluster-robust and bootstrap inference unreliable in finite samples. In this paper, we develop a framework for finite-sample valid permutation inference in linear regression with multi-way clustering under an assumption of conditional exchangeability of the errors. Our assumption is closely related to the notion of separate exchangeability studied in earlier work, but can be more realistic in many economic settings as it imposes minimal restrictions on the covariate distribution. We construct permutation tests of significance that are valid in finite samples and establish theoretical power guarantees, in contrast to existing methods that are justified only asymptotically. We also extend our methodology to settings with missing data and derive power results that reveal phase transitions in detectability. Through simulation studies, we demonstrate that the proposed tests maintain correct size and competitive power, while standard cluster-robust and bootstrap procedures can exhibit substantial size distortions. 1 Introduction Cluster-robust standard errors are ubiquitous in applied econometrics and statistics whenever data exhibit within-cluster dependence. In many empirical settings, clustering occurs along more than one dimension, such as importer–exporter country pairs in international trade. This leads to dyadic (or multi-way) regression specifications, where standard one-way cluster-robust standard errors ( 26 ; 1 ; 34 ) are no longer sufficient. To address this issue, 4 proposed a multi-way extension of standard cluster-robust variance estimators that is relatively simple to implement and has since become standard practice. However, as pointed out by 29 , the multi-way variance formulas of 4 are largely heuristic: they lack formal proofs of validity and can even yield non-positive definite variance matrices. Such numerical issues tend to arise precisely in settings where robust inference is needed, such as when clusters are few, small, or unbalanced. Building on this literature, 29 provided formal justifications for multi-way cluster-robust inference. Their analysis follows the theoretical framework of separately exchangeable arrays developed by 8 ; 32 , which treats the data as drawn from a two-dimensional array. One clustering dimension corresponds to the rows and the other to the columns of this array, with each “cell” containing the data from the corresponding cluster pair. Within this setup, 29 proved the asymptotic validity of t -statistics based on multi-way cluster-robust standard errors and proposed a wild cluster bootstrap procedure that performs well in simulations. While elegant, the analysis of 29 relies on several assumptions inherited from the separately exchangeable framework: (i) the number of rows and columns must grow without bound, (ii) covariates and errors are jointly exchangeable in the two dimensions, (iii) data are independent across distinct rows and across distinct columns, and (iv) cell sizes are positive in expectation. These conditions are analytically convenient but can exclude many empirically relevant settings. For instance, in international trade data, importer–exporter pairs are finite, exhibit geographic dependence, and covariates are typically nonexchangeable. Such features are common in real data and violate the assumptions in earlier work. In this paper, we develop an alternative framework for inference under multi-way clustering that replaces all four assumptions above with a single assumption of conditional separate exchangeability of the errors given covariates. Under this symmetry, we construct a permutation test of significance that is valid in finite samples and comes with theoretical power guarantees under plausible alternatives. To our knowledge, this is the first test to deliver finite-sample validity for regression models with multi-way clustered errors. The key restriction, relative to existing work, is that our exchangeability condition applies to the finite sample rather than to the population. See Section 2 for a detailed comparison. Owing to its construction, our permutation test is conceptually simple and straightforward to implement, especially when compared to multi-way wild cluster bootstrap procedures. Our tests also accommodate a finite number of clusters and impose no assumptions on the covariate distribution, thus allowing for irregular and heavy-tailed data. The extension to missing data can be handled naturally within our framework, with the permutation test performed on a carefully chosen subset of the data consisting of fully observed cells—that is, a clique in graph-theoretic terms. This novel connection to graph theory facilitates the analysis of power properties under Erdös–Rényi-type missingness. In summary, a key contribution of our paper is to show that a small modification of the separate exchangeability condition in earlier work can lead to finite-sample valid inference via permutation tests and can provide a potentially valuable addition to the standard econometric toolkit. 2 Main Idea and Overview of Results To illustrate the main idea, consider the following regression model: y_{ij}=x_{ij}^{\top}\gamma+d_{ij}^{\top}\beta+\varepsilon_{ij}\;,\quad i,j=1,\dots,n\;, (1) where y_{ij}\in\mathbb{R} are the outcomes, d_{ij}\in\mathbb{R}^{d} are the covariates of interest, and x_{ij}\in\mathbb{R}^{p} are auxiliary covariates; \varepsilon_{ij} are the unobserved errors. The parameter \beta is of primary interest, while \gamma is a nuisance parameter. Equation ( 1 ) describes a dyadic regression specification ( 19 ) , such as trade data between importer country i and exporter country j . In the array representation of ( 1 ), index i is the “row cluster”, j is the “column cluster”, and there is a single observation per cell (i,j) . We will consider extensions in Section 6 . Our goal is to test the null hypothesis H_{0}:\beta=0 and perform inference via test inversion. Throughout the paper, our main assumption is the conditional exchangeability of the errors: (\varepsilon_{ij})_{i,j=1}^{n}\stackrel{{\scriptstyle\mathrm{d}}}{{=}}(\varepsilon_{\pi(i)\sigma(j)})_{i,j=1}^{n}\mid\{x_{ij},d_{ij}\}_{i,j=1}^{n}~,~\text{for all permutations $\pi,\sigma$ on $\{1,\dots,n\}$.} (2) That is, the error disturbances have an importer–exporter “random effects” structure conditional on the covariates. Relative to earlier work, this assumption is weaker in that it imposes no restrictions on the covariate distribution, but stronger in that it holds in finite samples rather than the population. We give a detailed comparison in the following section. Under this invariance assumption, we propose a finite-sample valid permutation test for H_{0} . The procedure, detailed in Section 3 , consists of the following three steps: 1. ( Partialling-out. ) We construct a group \mathcal{G} of two-way permutations and matrices V_{g} for each (\pi,\sigma)\coloneqq g\in\mathcal{G} such that V_{g}^{\top}\mathbf{X}=0\;,~\text{and}~V_{g}^{\top}\mathbf{X}^{g}=0\;, (3) where \mathbf{X}=[x_{ij}]\in\mathbb{R}^{n^{2}\times p} are the auxiliary covariates in matrix form, and \mathbf{X}^{g} is obtained from \mathbf{X} after permuting the rows according to \pi and the columns according to \sigma . Similarly, define \mathbf{y} and \boldsymbol{\varepsilon} as outcome and error vectors in \mathbb{R}^{n^{2}} , respectively, following the same stacking operation as for \mathbf{X} . This step constructs the matrices \{V_{g}\}_{g\in\mathcal{G}} , which act as orthonormal projections to partial out nuisance effects, similar to the Frisch–Waugh–Lovell theorem ( 17 ; 28 ) . Section 3 provides simple conditions under which such matrices exist. 2. ( Minorized statistics. ) We consider test statistics s(\mathbf{y},V) that depend on \mathbf{y} only through V\mathbf{y} . Following from Equation ( 3 ) and the linear model ( 1 ), we can thus write s(\mathbf{y}^{g},V_{g})=f(V_{g}\boldsymbol{\varepsilon}^{g}) under the null hypothesis, for some known function f . Next, define the statistic’s minorized version as s^{*}(\mathbf{y})=\min_{g\in\mathcal{G}}s(\mathbf{y},V_{g}) . Then, under the null hypothesis, we have s^{*}(\mathbf{y})=\min_{g\in\mathcal{G}}f(V_{g}\boldsymbol{\varepsilon}):=f^{*}(\boldsymbol{\varepsilon})\;. (4) Thus, minorization provides an explicit function of the unobserved errors. 3. ( Permutation test. ) We compare s^{*}(\mathbf{y}) with the values \{s(\mathbf{y}^{g},V_{g})\}_{g\in\mathcal{G}} , i.e., the randomization distribution constructed from two-way permutations \mathcal{G}

Read the complete text