Conditional Triple Difference-in-Differences
Dor Leventer · 2025
Read Conditional Triple Difference-in-Differences by Dor Leventer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-16126.txt.
Introduction
Dor Leventer examines a workhorse causal method in economics and policy research in a 2025 paper. The method, triple difference-in-differences, compares changes across three splits at once, such as before and after, treated and untreated, eligible and ineligible. Most studies using it also add control variables, following standard habit.
Leventer shows that habit is generally biased when the groups being compared differ in their control variable mix. The fix is to define the target effect for one fixed covariate profile, that of a chosen group, rather than letting each group keep its own mix. A doubly robust estimator follows, which stays right if either of two working models is right. A classic policy example illustrates the repair. The paper is a warning that routine controls can quietly bend causal answers.
Catalog record
| CREATOR | Dor Leventer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-16126
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Conditional Triple Difference-in-Differences Dor Leventer Abstract Triple difference-in-differences designs are widely used to estimate causal effects in empirical work. Surveying the literature, we find that most applications include controls. We show that this standard practice is generally biased for the target causal estimand when covariate distributions differ across groups. To address this, we propose identifying a causal estimand by fixing the covariate distribution to that of one group. We then develop a double-robust estimator and illustrate its application in a canonical policy setting. JEL codes: C21, C23 Keywords: Triple difference, controls, causal inference Triple difference-in-differences (TDID) designs are widely used to estimate causal effects, yet their theoretical foundations remain underdeveloped. In a survey of 66 well-cited TDID applications in top journals (see appendix for details), we find that over 70% include control variables, typically in a linear regression with a three-way interaction. While motivated by standard econometrics textbooks (e.g., Angrist & Pischke, 2009a ; Cunningham, 2021a ) , this practice lacks formal justification. This paper provides the first theoretical analysis of TDID with controls, highlighting potential biases and proposing a theoretically grounded framework. We begin by developing a TDID identification framework which incorporates controls for identification. 1 1 1 Adding controls for precision is discussed in the conclusion. Our approach synthesizes two strands of the literature. The first, the unconditional TDID framework of Olden & Møen (2022a) , assumes that biases in unconditional parallel trends are invariant across two groups, denoted A and B. The second, the DID framework with controls of Callaway & Sant’Anna (2021a) ; Sant’Anna & Zhao (2020a) , requires that parallel trends hold conditional on covariates. Combining the two, the new identification assumption is that biases in conditional parallel trends are invariant across two groups. We also consider TDID under two scenarios for the treatment assignment mechanism: one in which only eligible units in group A are treated, and another in which eligible units are treated in both groups. We derive two main identification results. First, we show that the standard approach, estimating a DID with controls separately for each group and differencing the results, fails to recover the target causal estimand when covariate distributions differ across groups. The target estimand, either the average treatment effect on the treated (ATT) for group A or the difference in ATTs between groups A and B, is determined by the treatment assignment mechanism. The intuition is straightforward: each group’s ATT equals its DID plus the average bias in conditional parallel trends. If covariates are distributed differently, the plausible case in most applications, the averaged bias terms do not cancel out, and the (triple) difference in DID no longer identifies the causal estimand. Second, we show that an alternative approach, taking the difference in conditional DIDs under group A’s covariate distribution, identifies a causal estimand. Depending on the treatment assignment, this target is either the ATT of group A or the expected difference in conditional ATTs between groups A and B, evaluated at group A’s covariate distribution. While the estimand can be viewed as a practical adjustment—identifying what is feasible, it can also be motivated economically, as differences in treatment effects holding the covariate distribution constant may be the estimand of interest in many applications. For estimation, we develop a double-robust (DR) procedure that extends both parametric and semi-parametric DID methods to the TDID-with-controls setting ( Sant’Anna & Zhao, 2020a ; Chang, 2020a ) . The estimator reweights group B’s DID using the covariate distribution of group A, following the identification result. We illustrate this framework using the canonical minimum wage study by Card & Krueger (1993a) . To fix ideas, consider the following examples. A first example is Muralidharan & Prakash (2017a) , who study the impact of a bicycle program on girls’ 9th grade enrollment by comparing younger and older cohorts (first difference), boys and girls (second difference), and across two Indian states (third difference). The policy was implemented in only one state and targeted only girls. In our framework, TDID assumes that the bias in parallel trends between genders across cohorts, under the counterfactual without the policy, is equal across states conditional on covariates, such as caste, religion, or access to infrastructure. The standard approach computes a DID within each state and differences the two. This equals the ATT plus a bias term capturing differences in average conditional-trend bias across states. This bias is non-zero when covariate distributions differ across the two states. However, reweighting the control state’s DID to match the covariate distribution in the treated state identifies the ATT. Second, Kleven et al. (2019a) examine the impact of parenthood on earnings by comparing individuals before and after childbirth (first difference), early and late age at first birth (second difference), and across mothers and fathers (third difference). Both genders become parents after their first child is born, making both groups treated in the post-childbirth period. A TDID design assumes that the bias in parallel trends in earnings across age-at-first-birth groups, under the counterfactual without children, is equal across genders conditional on covariates, such as education. The standard approach computes a DID separately for mothers and fathers and differences the two, yielding the difference in ATTs between mothers and fathers plus a bias term reflecting differences in average conditional-trend bias between genders. However, reweighting the DID for fathers to match the covariate distribution of mothers identifies the difference in conditional ATTs, averaged over the mothers’ covariate distribution. This estimand is policy-relevant, as it isolates gender differences in the impact of parenthood while holding covariate distributions fixed. This paper contributes to the econometric literature on TDID and DID. We build on Olden & Møen (2022a) , who formalize TDID as a single bias-in-parallel-trends assumption, and extend recent work on conditional parallel trends in DID settings ( Zimmert, 2018a ; Chang, 2020a ; Sant’Anna & Zhao, 2020a ) . The paper makes four contributions. First, we lay the theoretical foundations for identification in TDID designs with covariates. Second, we show that the standard TDID empirical strategy is biased when covariate distributions differ across groups. Third, we develop a framework that identifies a causal target estimand, and we clarify this estimand is determined by the treatment assignment mechanism. Lastly, we develop estimators for the identifiable estimand. An accompanying R package for implementation code is available at tdid . The remainder of the paper is structured as follows. Section 1 introduces the notation and basic setup. Section 2 presents the identification framework and results. Section 3 discusses the estimation framework. Section 4 illustrates the results in an empirical application. Section 5 concludes. 1 Notation and Setup We consider a 2-by-2-by-2 TDID setup, where outcomes are observed across two time periods, for units in two treatment cohorts and two distinct groups. TDID designs differ in their treatment assignment mechanisms, which in turn determine the identified causal estimand (discussed below in Section 2 ). Returning to the examples above, in Muralidharan & Prakash (2017a) only units in one group were treated, while in Kleven et al. (2019a) units from both groups were treated. We now formalize a general framework that captures both cases by explicitly distinguishing between treatment assignment mechanisms. Let i\in\{1,\dots,n\} index individuals observed in periods t\in\{1,2\} . To allow for the