Semiparametric Efficiency in Policy Learning with General Treatments
Yue Fang, Geert Ridder, Haitian Xie · 2025
Read Semiparametric Efficiency in Policy Learning with General Treatments by Yue Fang, Geert Ridder, Haitian Xie (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-19230.txt.
Introduction
Yue Fang, Geert Ridder, and Haitian Xie ask how to beat a fair lottery without throwing fairness away. Lotteries often hand out scarce chances, from school seats to program slots. Their rules estimate an assignment plan that raises welfare, while a penalty keeps it near the original randomization.
The framework spans discrete, continuous, and mixed treatments. Because regret grows with the square of estimation error, sloppy estimation costs real welfare, not just precision. Weighting by known lottery odds proves inefficient. Estimated-propensity and doubly robust criteria reach the efficient regret pattern instead. Simulations and a commitment-savings case measure the gains in practice.
Catalog record
| CREATOR | Yue Fang, Geert Ridder, Haitian Xie |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 149 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-19230
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semiparametric Efficiency in Policy Learning with General Treatments Thanks: Alphabetical ordering of authors: all authors contributed equally to this work. Yue Fang, Geert Ridder, Haitian Xie Abstract Recent literature on policy learning has primarily focused on regret bounds of the learned policy. We provide a new perspective by developing a unified semiparametric efficiency framework for policy learning, allowing for general treatments that are discrete, continuous, or mixed. We provide a characterization of the failure of pathwise differentiability for parameters arising from deterministic policies. We then establish efficiency bounds for pathwise differentiable parameters in randomized policies, both when the propensity score is known and when it must be estimated. Building on the convolution theorem, we introduce a notion of efficiency for the asymptotic distribution of welfare regret, showing that inefficient policy estimators not only inflate the variance of the asymptotic regret but also shift its mean upward. We derive the asymptotic theory of several common policy estimators, with a key contribution being a policy-learning analogue of the Hirano–Imbens–Ridder (HIR) phenomenon: the inverse propensity weighting estimator with an estimated propensity is efficient, whereas the same estimator using the true propensity is not. We illustrate the theoretical results with an empirically calibrated simulation study based on data from a job training program and an empirical application to a commitment savings program. Keywords: General Treatment, Policy Learning, Semiparametric Efficiency, Welfare Regret. 1 Introduction Policy learning has become a central topic in econometrics, statistics, and machine learning, offering a formal framework for designing data-driven decision rules in settings such as targeted social programs, pricing and revenue management, and personalized medicine. The primary objective is to construct a policy, understood as a mapping from individual characteristics to treatments, that maximizes expected welfare, typically defined as the population mean of the counterfactual outcomes induced by the policy. A widely used approach is empirical welfare maximization (EWM), which selects a policy from a specified class by maximizing an estimator of social welfare built from experimental or observational data under unconfoundedness; see, for example, 33 and 5 . The performance of the resulting policy is usually assessed by establishing bounds on its regret—the difference between optimal welfare and the welfare achieved by the learned policy. In this paper, we offer a new theoretical perspective on policy learning and evaluation that complements the predominant regret-bounding paradigm. Our approach develops a semiparametric efficiency framework for policy learning with general treatment variables, including discrete, continuous, and mixed cases, based on modern semiparametric estimation theory. We first show, building on recent work such as 22 , that deterministic policies, which assign treatments as deterministic functions of covariates, are not pathwise differentiable objects and therefore cannot be estimated at the root- n rate. This motivates our focus on randomized policies, which assign treatment probabilities rather than treatment levels. Beyond their statistical regularity, randomized policies also offer several practical advantages. They soften hard thresholds and often lead to greater acceptance among individuals who are subject to the policy. From the perspective of fairness, a randomized allocation rule ensures that individuals with similar characteristics are treated symmetrically rather than being separated by small or noisy differences in the data. Randomized outcomes also discourage gaming and strategic behavior, since the assignment is never fully predictable. Finally, randomization provides a simple and transparent mechanism for assigning scarce resources in settings where deterministic rules may raise legal and ethical concerns about the basis of the allocation. Due to these reasons, randomized policies have been a standard tool for resource allocation in practice. For example, the U.S. H-1B visa system incorporates a lottery in which groups of applicants face different selection probabilities depending on whether they hold an advanced degree ( 28 ) . Vehicle license allocation schemes in cities such as Beijing and Shanghai operate through weighted lotteries, where applicants receive higher or lower chances based on pre-specified criteria ( 36 ; 6 ) . Similar structured lotteries appear in public health policy, such as the Oregon Health Plan lottery, which granted Medicaid access through random selection among eligible low-income adults ( 26 ) . School admissions provide another example: many charter schools rely on admissions lotteries in which priority status or sibling preferences influence the probability of receiving an offer ( 1 ) . Housing policy in urban India also uses randomized allocation rules, where subsidized units are assigned through lotteries that incorporate eligibility categories and priority groups ( 35 ) . To study the statistical properties of randomized policies, we build on the literature on semiparametric efficiency for treatment effect estimation ( 29 ; 15 ; 3 ) and develop a semiparametric efficiency framework for policy parameters in the setting of randomized policies. Using the Hájek–Le Cam convolution theorem, we then introduce a notion of efficiency for the asymptotic distribution of welfare regret. Regret is nonnegative, and its efficient limiting distribution takes a \chi^{2} form. The analysis reveals an unexpected implication: an inefficient policy estimator not only increases the variance of the asymptotic regret but also shifts its mean upward. This provides a substantive motivation for pursuing efficient policy learning methods, as efficiency has a direct impact on the asymptotic mean of regret. We then derive the asymptotic behavior of several common policy estimators, which differ in how they estimate social welfare. These include inverse propensity weighting (IPW) with propensity score either known or estimated (through stabilized weights), as well as the doubly robust (DR) estimator. A central finding is a version of the 30 (HIR) phenomenon in the policy learning setting: the IPW policy estimator that uses an estimated propensity score attains efficient regret, whereas the counterpart that uses the true propensity score does not. This result is unexpected in light of the existing literature. In 33 and 38 , the regret bounds for EWM with estimated propensities in the binary-treatment deterministic-policy setting are dominated by the rate of convergence of the nuisance estimators. In contrast, we show that for randomized policies the regret can be sharpened to the root- n rate, and in fact becomes more efficient when the propensity score is estimated. Lastly, we show that the HIR phenomenon may extend beyond the class of randomized policies. In the existing literature, regret bounds for deterministic policies are typically obtained by applying a basic inequality that relates regret to the supremum loss of the welfare estimator ( 33 , e.g., equation (2.2) in) . Using Gaussian process theory, we demonstrate that this supremum welfare loss also exhibits an HIR phenomenon. The key step is to compare the covariance structures of the limiting Gaussian processes that characterize the welfare process under different estimators. This suggests that the HIR phenomenon is not tied to randomization per se, but reflects deeper efficiency issues for policy learning. The theoretical results have important implications for policy learning practice. In experimental settings where the propensity score is known, researchers may be inclined to use an IPW policy estimator that relies on the true propensity score when learning an optimal policy. Our findings indicate that this choice is not desirable. To achieve regret efficiency, one should instead use the IPW estimator with an estimated propensity score or the doubly robust estimator. Using an empirically calibrated simulation study based on the National Job