Nonparametric Bayesian Policy Learning
Haonan Ye · 2026
Read Nonparametric Bayesian Policy Learning by Haonan Ye (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17068.txt.
Introduction
Ye proposes a Bayesian method for picking treatments when the best policy is uncertain. He places a Dirichlet process prior over the outcome distribution and uses its posterior both to choose policies and to judge best achievable welfare. The approach needs only simple reweighting of the data, and its welfare loss shrinks at the best possible rate while policy-class selection stays consistent. Trials on job training and bednet subsidies favor simple decision-tree rules over linear ones.
Catalog record
| CREATOR | Haonan Ye |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 133536 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17068
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Nonparametric Bayesian Policy Learning Thanks: I am grateful to Chris Walker for his guidance on this project and for many insightful discussions. I also benefited from helpful comments from Matt Masten, Arnaud Maurel, Adam Rosen, and participants at the Duke Econometrics Seminar. I am especially grateful to my cat, Coconut, for his unwavering emotional support. All remaining errors are my own. Haonan Ye Abstract I propose Nonparametric Bayesian Policy Learning (NBPL) as a framework for uncertainty-aware treatment choice. I consider a decision-maker (DM) seeking to select an expected welfare-maximizing treatment rule using observable characteristics. A key observation is that, for a given welfare criterion and policy class, uncertainty about welfare-relevant objects is entirely induced by uncertainty about a reduced-form distribution. I assume the DM places a nonparametric Dirichlet process prior on this reduced-form parameter and uses the resulting posterior to conduct inference on optimal treatment assignments, optimal welfare, and comparisons across policy classes. The NBPL framework is flexible, and its implementation via the Bayesian bootstrap is highly tractable. I establish two main theoretical properties of NBPL. First, posterior welfare regret under NBPL converges at the minimax-optimal rate. Second, posterior model comparison across policy classes is pointwise consistent. I illustrate NBPL in two empirical applications: the bednet subsidy experiment of Bhattacharya and Dupas 2012 and the JTPA experiment studied by Kitagawa and Tetenov 2018 . Keywords: Bayesian bootstrap, Dirichlet process, program evaluation, risk bound, statistical treatment rules. JEL codes: C11, C44, D60. 1 Introduction 1.1 Overview In many economic settings, policymakers must allocate scarce interventions across heterogeneous populations. This motivates a growing literature on statistical treatment rules, or policy learning, pioneered by Manski 2004 , which studies how to design treatment rules using observable individual characteristics to maximize social welfare; see, for example, Hirano and Porter 2009 , Stoye 2009 , Bhattacharya and Dupas 2012 , Kitagawa and Tetenov 2018 , and Athey and Wager 2021 , among others. 1 1 1 Throughout the paper, I use the terms “treatment rule” and “policy” interchangeably. A growing empirical literature shows that such individualized rules can deliver substantial welfare gains across a wide range of settings, including labor market and education programs ( Athey et al. 2025b ; Goller et al. 2025 ) , anti-poverty interventions in developing countries ( Haushofer et al. 2025 ; Higbee 2025 ) , and health and precision medicine ( Kosorok and Laber 2019 ; Inoue et al. 2023 ; Athey et al. 2025a ) . In this paper, I consider a decision-maker (DM) seeking to select an expected welfare-maximizing treatment rule using observable characteristics. A key observation is that, for a given welfare criterion and policy class, the expected welfare function is fully determined by a reduced-form data distribution. Consequently, the sole source of statistical uncertainty in the DM’s problem is uncertainty about this distribution. This blends seamlessly with a Bayesian approach in which the DM assumes a nonparametric prior for the reduced-form parameter and uses the resulting posterior to conduct simultaneous inference on optimal treatment assignments, optimal welfare, and comparisons across policy classes. I call this framework Nonparametric Bayesian Policy Learning (NBPL). NBPL has several appealing features. First, it is grounded in a well-defined posterior, so uncertainty enters the decision problem explicitly. A growing literature shows that ignoring uncertainty in treatment or policy choice can lead to suboptimal decisions ( Dehejia 2005 ; Christensen et al. 2025 ; Moon 2026 , e.g.,) . Second, to the best of my knowledge, NBPL is the first unified inferential framework for optimal treatment assignments, optimal welfare, and comparisons across policy classes. The last component incorporates uncertainty about the policy class and is difficult to handle with frequentist methods. Third, NBPL is flexible: the prior for the reduced-form data distribution is a Dirichlet process ( Ferguson 1973 ) , which offers a level of flexibility similar to that of frequentist nonparametric approaches to policy learning ( Kitagawa and Tetenov 2018 , e.g., the important Empirical Welfare Maximization (EWM) framework of) . Fourth, posterior computation is highly tractable: the recommended Bayesian-bootstrap implementation ( Rubin 1981 ) simply reweights the data using standard exponential weights, reuses off-the-shelf welfare maximization algorithms, and is naturally parallelizable. I also establish three important theoretical properties of NBPL. First, I show that posterior welfare regret under NBPL converges to zero at the minimax-optimal rate (Theorem 1 ), matching the rate for EWM in Kitagawa and Tetenov 2018 . This shows that explicitly accounting for uncertainty in the decision problem does not slow the rate of learning; to the best of my knowledge, it is the first posterior welfare-regret guarantee for policy learning. Second, I establish pointwise consistency of posterior model comparison across policy classes (Theorem 2 ); in particular, when two classes are strictly separated at the truth, the posterior asymptotically assigns vanishing probability to the inferior class. Third, I show that EWM arises as a Bayes rule within the NBPL framework (Proposition 1 ). Specifically, EWM first averages welfare over posterior uncertainty and then optimizes, whereas decisions based on the posterior over optimal treatment assignments instead optimize first and then aggregate. The two procedures need not coincide. I illustrate the NBPL framework using two empirical applications: the Job Training Partnership Act (JTPA) experiment studied by Kitagawa and Tetenov 2018 and the anti-malaria bednet subsidy experiment analyzed by Bhattacharya and Dupas 2012 . In both applications, EWM welfare estimates tend to fall below the posterior median of welfare under NBPL. NBPL also yields credible intervals for welfare that are tighter than the corresponding EWM confidence intervals. In addition, the posterior model comparison procedure provides strong evidence that decision-tree rules achieve higher welfare than linear rules. 1.2 Literature This paper connects to three literatures in economics. The first is the literature on statistical treatment rules, or policy learning. A leading approach is the Empirical Welfare Maximization (EWM) framework of Kitagawa and Tetenov 2018 , which selects treatment rules as if the empirical distribution were the true data-generating process and achieves the minimax-optimal regret convergence rate. By contrast, NBPL places a Dirichlet process prior on the reduced-form data distribution, explicitly incorporates uncertainty into the decision problem through the posterior, and delivers the same minimax-optimal posterior regret rate. Chamberlain 2011 is closely related in spirit, using Dirichlet priors on outcome distributions to derive posterior-expected-utility treatment decisions in a limited-information Bayesian framework. NBPL builds on this approach by accommodating continuous distributions and constrained policy classes, while also delivering asymptotic regret guarantees. NBPL is also related to the broader literature on uncertainty-aware decision-making ( Dehejia 2005 ; Chernozhukov et al. 2025 ; Christensen et al. 2025 ; Moon 2026 , e.g.,) . Other contributions to policy learning include Hirano and Porter 2009 , Stoye 2009 , Bhattacharya and Dupas 2012 , Kallus and Zhou 2018 , Athey and Wager 2021 , Kitagawa and Tetenov 2021 , Mbakop and Tabord-Meehan 2021 , Zhou et al. 2023 , Adjaho and Christensen 2025 , Kitagawa et al. 2025 , Olea et al. 2025 , Viviano 2025 , and Ida et al. 2026 . Another related literature studies Bayesian inference through reduced-form parameters. In many economic models, an identifiable reduced-form parameter maps into a structural parameter of interest, so a posterior on the former induces a