Inference under Staggered Adoption: Case Study of the Affordable Care Act

2024

Read Inference under Staggered Adoption: Case Study of the Affordable Care Act (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-09482.txt.

Introduction

Eric Xia, Yuling Yan, and Martin J Wainwright build confidence intervals for policies that switch on at different times in different places. Their 2024 paper works with panel data, where many units are tracked over time and treatment starts in a staggered way. Their tools extend a fast matrix-based estimator of treatment effects, and they return intervals not just for single effects but for combinations of them, with coverage guarantees.

The test case is large: the Medicaid expansion under the Affordable Care Act, adopted state by state. Their analysis finds that expansion substantially cut uninsurance rates and reduced infant mortality. It finds no significant effect on health care spending. The paper gives policy researchers a principled way to say how sure they are, in a setting where units adopt at scattered dates and simple comparisons mislead.

Catalog record

YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE117 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-09482

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Inference under Staggered Adoption: Case Study of the Affordable Care Act Abstract Panel data consists of a collection of N N units that are observed over T T units of time. A policy or treatment is subject to staggered adoption if different units take on treatment at different times and remains treated (or never at all). Assessing the effectiveness of such a policy requires estimating the treatment effect, corresponding to the difference between outcomes for treated versus untreated units. We develop inference procedures that build upon a computationally efficient matrix estimator for treatment effects in panel data. Our routines return confidence intervals (CIs) both for individual treatment effects, as well as for more general bilinear functionals of treatment effects, with prescribed coverage guarantees. We apply these inferential methods to analyze the effectiveness of Medicaid expansion portion of the Affordable Care Act. Based on our analysis, Medicaid expansion has led to substantial reductions in uninsurance rates, has reduced infant mortality rates, and has had no significant effects on healthcare expenditures. † † ⋆ Equal contribution. Eric Xia †,⋆ , Yuling Yan ∘,⋆ , and Martin J. Wainwright †,‡ EECS † and Mathematics ‡ Laboratory for Information and Decision Systems Statistics and Data Science Center Massachusetts Institute of Technology, Cambridge, MA Department of Statistics ∘ University of Wisconsin-Madison, Madison, WI August 24, 2026 1 Introduction Many datasets take the form of panel data, in which a collection of N units (e.g., individuals, cities, states, countries, companies etc.), are observed over T time periods. Panel data arises in a very wide variety of applications, and the associated methodological literature is rich (e.g., see the book [ Woo10 ] and references therein). It is frequently the case that some “treatment” is applied to a subset of the units. Here treatment should be understood, in a generic sense, as some form of intervention or policy that is applied. In the simplest case, the treatment is binary in nature (e.g., whether or not to vaccinate, or whether or not to join the EU). The framework of panel data with binary treatments has been used to study a plethora of problems, including—among many others—the effects of tax policy on smoking rates [ ADH10 ] ; the economic benefits of EU membership for a given country [ Kop+24 ] ; the effects of “right-to-carry” gun laws [ DAW19 ] ; and the effects of increases in minimum wage [ CK00 ] . A fundamental issue underlying analysis of such panel data is the manner in which the treatment is adopted. Most straightforward is the randomized controlled trial, in which a randomly chosen subset of the units are given treatment at a common time, with all other units remaining untreated throughout time. In contrast, the focus of this paper is a more challenging setting: each unit can choose whether or not to adopt the treatment, and moreover can choose a time at which to do so. Furthermore, when a unit adopts treatment, they continue to do so until the end of the panel time period. This set-up is known as staggered adoption . It leads to statistical inference problems that are challenging, both because of the observational nature of the data, and because of the differing adoption times. The Affordable Care Act (ACA) provides an archetypal example of panel data with staggered adoption. Here there are N=50 states in total, and we can measure various features of a given state over a period of T time units. States can choose whether or not to take on the expanded Medicaid eligibility provided by the ACA. From its inception in 2010 through 2024, forty states have chosen to expand Medicaid eligibility at different times; see Figure 1 for a graphical illustration, and Section 2.1 for additional background. On the methodological side, there are a wide variety of approaches to statistical inference with panel data under staggered adoption, including synthetic controls (e.g., [ AG03 , ADH15 , Li20 , DI16 , BMFR21a ] ); linear panel models or fixed effects regression (e.g., [ IK21 , AI06 ] ); and approaches based on matrix completion (e.g., [ Ath+21 , Aba+24 , YW24 ] ). We examine the latter class of methods in this paper. More specifically, this paper makes two primary contributions to the growing literature on panel data and staggered adoption. The first is methodological: building upon our recent work [ YW24 ] on a low-rank matrix-based estimator for treatment effects, we show how to use its outputs to construct confidence intervals. We develop inferential procedures that are sufficiently flexible to handle heteroskedastic noise, and applicable to both individual treatment effects (ITEs), as well as to a more general notion of treatment effect as defined by a bilinear function. Our second contribution is to apply these inferential procedures so as to evaluate the effectiveness of Medicaid expansion component of the the Affordable Care Act (ACA). In particular, we study its effect on a variety of outcomes, including uninsurance rates, infant mortality, and expenditures. Our inferential procedures allow for fine-grained probing of these effects at the individual state level over each time period. Finally, we have implemented a Python package of our method for practitioners; see https://github.com/Facta-Non-Verba/CAST_panel for a guide on its use, as well as code and data for replicating our results. The remainder of the paper is organized as follows. Section 2 provides some context on the ACA and its significance, and then lays out the framework of panel data with staggered adoption, including the treatment effects to be estimated. Section 3 reviews our matrix-based estimator of treatment effects, and provides simple schemes to compute confidence intervals; we state some informal guarantees on its coverage properties, with all mathematical details deferred to the Appendices. In Section 4 , we use these inferential routines to analyze the causal effects of the Medicaid expansion in the ACA. We summarize and discuss future avenues of research in Section 5 . 2 Background and problem formulation In this section, we provide some background as well as a more precise formulation of panel data with staggered adoption. More specifically, in Section 2.1 we provide relevant background on the Affordable Care Act and a brief overview of some related work. Section 2.2 is devoted to a more precise description of the framework of panel data with staggered adoption. 2.1 The Affordable Care Act Among all developed nations, residents of the United States are expected (on average) to live the shortest lives, endure the most number of chronic health conditions, and experience the highest rates of infant and maternal mortalities. All of these negative outcomes occur despite the US spending the highest proportion of its GDP on healthcare, and nearly double the average of OECD nations [ GGWI23 ] . A major contributing factor is lack of healthcare access due to an inability to pay. For instance, in 2024, roughly 21% of Americans reported that they skipped seeking treatment due to costs; moreover, this rate of those skipping care nearly triples to 61% among those who do not have insurance [ Lop+24 ] . In 2022, the US Census reported that nearly 26 million Americans lack health insurance [ TDD23 ] . Figure 1 : Adoption of Medicaid

Read the complete text