Empirically Understanding the Value of Prediction in Allocation Unai Fischer-Abaigar, Emily Aiken, Christoph Kern, Juan Carlos Perdomo Abstract Institutions increasingly use prediction to allocate scarce resources. From a design perspective, better predictions compete with other investments, such as expanding capacity or improving treatment quality. Here, the big question is not how to solve a specific allocation problem, but rather which problem to solve. In this work, we develop an empirical toolkit to help planners form principled answers to this question and quantify the bottom-line welfare impact of investments in prediction versus other policy levers such as expanding capacity and improving treatment quality. Applying our framework in two real-world case studies on German employment services and poverty targeting in Ethiopia, we illustrate how decision-makers can reliably derive context-specific conclusions about the relative value of prediction in their allocation problem. We make our software toolkit, rvp, and parts of our data available in order to enable future empirical work in this area. 1 Introduction Public institutions worldwide increasingly use predictive systems to guide the allocation of scarce social goods, in applications ranging from identifying students at risk of dropout for education-focused interventions, to allocating public housing units to unhoused families, to prioritizing vulnerable communities for early access to new vaccines. Prediction in these settings is not an end in itself, but a means to improve the targeting of limited resources and, ultimately, advance institutional goals and downstream social welfare. Historically, allocation problems have often been framed as optimizing a specified objective subject to given constraints, e.g. maximizing expected welfare subject to budget limits. A substantial literature addresses how to solve such problems once formulated: learning optimal treatment assignment rules through empirical welfare maximization [ Athey and Wager 2021 , Kitagawa and Tetenov 2018 ] , training constrained predictors that satisfy operational or fairness requirements [ Cotter et al. 2019 ] , or establishing calibration conditions under which simple post-processing leads to optimal downstream decisions [ Hu et al. 2023 ] . However, this previous work takes the problem definition—which features are observed, what institutional capacity exists, and the quality of allocated resources—as exogenously given. We argue a the central question is not how do we solve a specific allocation problem , but which allocation problem should we be solving? These meta-design choices (such as capacity constraints, data quality, feature selection, intervention intensity, and more) are themselves optimization variables—and they are just as, if not more consequential to overall success than the downstream algorithmic choices about how to solve the resulting optimization problem. Once these design choices are recognized as optimization variables themselves, the design space is vast: a planner might invest in better prediction for a demographic subgroup, expand program capacity, or improve service quality. How should practitioners navigate this space? Recent work has begun to study this design space from a theoretical perspective [ Perdomo 2024 , Fischer-Abaigar et al. 2025 , Shirali et al. 2024 ] . These mathematical frameworks provide valuable insights, characterizing, for instance, when prediction improvements dominate capacity expansion or vice versa. However, they typically focus on specific comparisons—for example, aggregate prediction improvements versus aggregate capacity expansion—under stylized distributional assumptions. Many practically relevant questions remain unexplored: When are prediction improvements for specific subgroups worthwhile? How do conclusions change under different welfare objectives? What about policy levers beyond prediction and capacity? Furthermore, practitioners may rightly question whether existing theoretical results apply to their particular domains, where the relevant comparisons, cost structures, distributions, and welfare objectives may differ substantially from those analyzed in theory. Here, we take an empirical approach to understanding the value of prediction in allocation problems. We conceptually map out the space of questions practitioners face when comparing policy levers, and develop a software toolkit rvp that enables them to answer these questions using data from their own programs. Rather than relying on theoretical results derived under stylized assumptions, planners can simulate concrete comparisons that apply to their specific domains. We demonstrate this toolkit on real-world data from German employment services and cash transfer distribution in Ethiopia, illustrating how to generate actionable insights on when and where prediction investments pay off. 2 Related Work A growing body of work examines machine learning systems that allocate scarce resources in public institutions. A recurring finding is that prediction, while often the focus of technical development, may not be the most consequential component of these systems. For example, Perdomo et al. 2025 study early warning systems in Wisconsin public schools and find that effective allocation of school resources may not require individual-level risk prediction. This observation motivates a line of theoretical work on the value of prediction in allocation systems. Casacuberta and Hardt 2026 show that the sample complexity of learning good allocations is far lower than for heterogeneous effect estimation. Shirali et al. 2024 show that individual targeting only outperforms aggregate targeting in high-budget regimes when inequality is low. Mashiat et al. 2025 find that prediction-based targeting of outreach to prevent eviction outperforms neighborhood-based approaches under a spatial cost structure. Perdomo 2024 and Fischer-Abaigar et al. 2025 develop formal frameworks for comparing prediction improvements against other policy interventions such as capacity expansion, introducing the prediction-access ratio to quantify these tradeoffs. Wilder and Welle 2025 examine balancing treating those in need against gathering information on treatment effectiveness; Jain et al. 2024 consider when to introduce randomization into allocation systems; Jain et al. 2025 show that many allocations achieve equal utility while selecting entirely different individuals. These contributions reveal a vast design space, but results are sensitive to problem-specific assumptions, and theoretical analyses necessarily focus on stylized settings. A related literature focuses on solving allocation problems once formulated. A common approach is to learn risk scores that rank individuals for allocation [ Liu et al. 2026 , Wang et al. 2024 ] , referred to as “prediction policy problems” by Kleinberg et al. 2015 . Recognizing the causal nature of these problems, counterfactual risk prediction models estimate outcomes under no intervention [ Coston et al. 2020 ] . Allocating to those who would benefit most requires estimating heterogeneous treatment effects, drawing on a vast literature on heterogeneous effect estimation [ Wager and Athey 2018 , Künzel et al. 2019 ] . A long history in causal inference focuses on learning optimal treatment rules [ Kitagawa and Tetenov 2018 , Athey and Wager 2021 , Manski 2004 , Kallus 2018 , Le et al. 2019 ] . Complementary work on decision-focused learning optimizes predictors to account for the downstream optimization problem they intend to solve [ Elmachtoub and Grigas 2022 , Ren et al. 2024 ] . Recent work attempts to clarify how these approaches relate, connecting estimation targets to utility under different problem formulations [ Sharma and Wilder 2025 , Liu et al. 2026 , Fischer-Abaigar et al. 2024 , Kern et al. 2025 ] . Our work is not primarily concerned with estimation or solving a given allocation problem, but rather with the meta-design of the allocation problem itself and the tradeoffs that arise from different design choices. 3 Prediction in Allocation We focus on allocation problems where a social planner assigns a scarce intervention to individuals in a population: Definition 3.1 (Allocation Problem) . Let {\cal D} be a distribution over pairs (x,w)\in\mathcal{X}\times{\cal W} and let \alpha\in(0,1) denote a capacity constraint. Fix a utility function u:{\cal W}\times\{0,1\}\rightarrow\mathbb{R} . We define \mathsf{Alloc}({\cal D},u,\alpha) to be the value of the optimal policy \pi\colon\mathcal{X}\to\{0,1\} with respect to ({\cal D},u,\alpha) , \displaystyle\mathsf{Alloc}({\cal D},u,\alpha):= \displaystyle\underset{\pi\colon\mathcal{X}\to\{0,1\}}{\max}\;\mathbb{E}_{{\cal D}}\left[u(w,\pi(x))\right] \displaystyle\quad\text{s.t.}\;\mathbb{E}_{{\cal D}_{x}}\left[\pi(x)\right]\leqslant\alpha The allocation problem is defined based on three primitives; the utility function u , distribution {\cal D} , and the capacity constraint \alpha . Prior work largely treats them as exogenous. We instead consider them as design parameters that a policymaker decides on, opening up the optimization space beyond the choice of decision rule \pi . The outcome w and the utility function u together encode the social planner’s objective. In applications, w may take different forms. For example, w may represent an outcome y (e.g., probability of disease occurrence), a baseline outcome under no treatment w=y(0) (e.g., dropout risk without intervention), or a treatment effect w=y(1)-y(0) (e.g., program efficacy for that individual) 1 1 1 For instance, if one sets w=y(0) (baseline risk), the utility may encode a constant known effect \tau as u(w,1)=w+\tau . Alternatively, one could set w=y(1)-y(0) with simpler utility u(w,1)=w . The conceptual difference is that w will need to be estimated, whereas we treat u as a known function. . When the net utility \Delta u=u(w,1)-u(w,0) is affine in w , individuals can be optimally ranked by \E\left[w\mid x\right] , and the optimal solution takes a simple form: allocate to the top-ranked individuals, while respecting the budget constraint, \displaystyle\pi^{*}(x)=\mathbf{1}\{\E\left[w\mid x\right]\geqslant t_{\alpha}\}. Here, t_{\alpha} is chosen such that \mathrm{Pr}(\E\left[w\mid x\right]\geqslant t_{\alpha})=\alpha , allocating to top-ranked individuals, provided expected net-utility is positive. In practice, \E\left[w\mid x\right] is unknown and must be approximated from historical data. We restrict our focus to policies that threshold a scalar predictor p(x)\approx\E\left[w\mid x\right] . Such policies are the default choice among practitioners and theoretically optimal in some cases (e.g., Perdomo 2024 , Fischer-Abaigar et al. 2025 ). 4 Policy Levers From a planner’s perspective, there are multiple ways to redefine the allocation problem. Following Perdomo 2024 and Fischer-Abaigar et al. 2025 , we call these policy levers . Although our work does not contain formal theorems, we define these formally for the sake of conceptual clarity. Definition 4.1 (Policy Lever) . A policy lever is an intervention that modifies one or more components of the allocation problem. Formally, for a given allocation problem, a policy lever induces a mapping \ell:({\cal D},u,\alpha)\rightarrow({\cal D}^{\prime},u^{\prime},\alpha^{\prime}) , together with associated investment cost 2 2 2 An important dimension is the time horizon over which costs are incurred. One-time investments (e.g., developing a new data system) should be evaluated differently than recurring costs (e.g., ongoing data collection or expanded capacity). We abstract from this by assuming all comparisons occur over the same time horizon, with recurring costs included in the total investment amount c(\ell) over that period. c(\ell)\geqslant 0 . Here, \mathsf{Alloc}({\cal D}^{\prime},u^{\prime},\alpha^{\prime})-\mathsf{Alloc}({\cal D},u,\alpha) denotes the optimal welfare gain after applying the policy lever. This definition is intentionally general. A planner might consider dropping an expensive-to-collect feature set, investing in program capacity at a local office, improving service quality for a subpopulation, or enhancing data collection throughout. All of these can be represented as changes to the distribution, constraint, or utility. Furthermore, policy levers can often be parameterized by a single quantity \theta\geqslant 0 that controls the magnitude of intervention with associated costs \theta\mapsto c(\theta) . We discuss three instantiations of such parameterized policy levers. Expanding (Local) Capacity Relaxing the constraint \alpha\to\alpha+\Delta\alpha allows serving a larger fraction of the population. Capacity expansions can also be locally targeted. For example, increasing capacity at specific regional offices or for particular subgroups. This can be easily represented by adding additional constraints to the allocation problem. Improving Treatment Improving the treatment effectiveness can be represented as a change in utility u . For instance, in a cash transfer program, increasing the cash transfer amount from b to b+\Delta b increases the welfare gain from allocating to a household; a direct change to u(a,w) . Improving Prediction Prediction improvements can be represented as changes to the joint distribution {\cal D} that make available features x more informative about outcomes w . In practice, many mechanisms could improve prediction: collecting additional features, expanding data coverage to unobserved populations, or improving data quality. 4.1 rvp Toolkit: Comparing Policy Levers Given the broad space of possible policy levers, the central question is: which lever delivers the greatest welfare gain for a given level of investment? We conceptually map out the space of questions practitioners face when making such comparisons and present rvp, a software toolkit that enables practitioners to construct scenarios using their own data to make principled comparisons across policy levers that account for their specific distributions, welfare objectives, and cost structures. Appendix C maps these conceptual components to their implementations in rvp 3 3 3 Full documentation and worked examples are available at github.com/unai-fa/relative-value-of-prediction . . In practice, such comparisons are often difficult because costs or benefits may be underspecified. A planner may not know what investment yields a given prediction improvement, or how capacity expansion costs scale. However, even with incomplete information, we show that useful comparisons remain possible. We partition the scenarios rvp supports based on what cost information is available to the planner. (Q1): How should a fixed budget be allocated across levers? When costs are known for all levers, the planner can compare levers directly. Given a total budget B , the problem becomes allocating resources across levers to maximize total welfare gain. This joint optimization produces budget-allocation curves showing how resources should be distributed as a function of total budget. See, e.g., Section 6.1 and Section 6.2 . (Q2): What improvement would one lever need to deliver to match an investment in another? When costs are known for one lever but uncertain for another, we can use the known lever as a benchmark. Suppose a planner knows the cost of expanding capacity by a fixed amount. What prediction improvement would generate equivalent welfare gains? This identifies a break-even point, allowing the planner to assess whether such gains are plausibly achievable at comparable cost. See, e.g., Section 5.1 . (Q3): How much more should we be willing to pay for one lever over the other? When cost information is unavailable for both levers, we can still compare their relative impact. Following Perdomo 2024 and Fischer-Abaigar et al. 2025 , we consider the ratio of welfare gains from each lever. This ratio provides a threshold. For example, suppose a given prediction improvement generates twice the welfare gain of a given capacity expansion. Then the prediction improvement is the better investment as long as it costs less than twice as much. See, e.g., Section 5.2 . 5 Case Study: German Employment Offices Having introduced our empirical toolkit, we now demonstrate how practitioners can use rvp to derive actionable insights around the design of prediction-based allocation systems. All analyses in this section were conducted using rvp. Our first case study focuses on identifying long-term unemployment, using real administrative data from the German Federal Employment Agency. Prediction-based profiling of jobseekers is a topic of substantial policy relevance. To our knowledge, such systems have not been analyzed empirically using the kind of framework we develop here. Background. Public Employment Services (PES) across countries deploy predictive models to support one of their most critical task: the allocation of support programs to job seekers at risk of long-term unemployment (LTU) [ Körtner and Bonoli 2023 , Desiere et al. 2019 ] . As LTU incurs considerable costs for public welfare, the support programs allocated to at-risk job seekers account for large shares of PES spending. The need for improved efficiency and effectiveness is high [ Bach et al. 2023 , Kern et al. 2024 ] . We use a 2% random sample of all German governmental labor market records comprising over 60 million entries from 1970–2021. More information on the data and experimental setup can be found in Appendix A . Problem Setup. Agencies use pre-unemployment covariates x\in\mathcal{X} , such as employment and benefits history, to predict unemployment duration w (measured in days). A common utility is u(w,a)=a\cdot\mathbf{1}\{w\geqslant t_{\beta}\} which rewards correctly targeting jobseekers in the top- \beta fraction of unemployment duration (see Figure 1 ). This assumes no harm from misallocating, i.e. u(w,0)=0 . The planner can prioritize at most an \alpha -fraction of the population and sets \pi(x)=\mathbf{1}\{p(x)\geqslant t_{\alpha}\} , where t_{\alpha} is the appropriate quantile. Figure 1 : (a) Illustrates the task of identifying jobseekers at risk of long-term unemployment (purple) under a fixed capacity constraint. The employment office observes only imperfect predictions of risk, so the ranking of individuals is uncertain. (b) Increasing capacity expands the set of individuals who can be served. (c) Improving prediction sharpens the ranking, allowing limited resources to be targeted more effectively toward those truly at risk. What is the value of prediction for identifying jobseekers at risk? Before comparing policy levers, we first ask: what is the value of predictive targeting at all? Given the utility defined above, we can bound the value of prediction. Random targeting achieves welfare \alpha\beta , while perfect targeting achieves \text{min}(\alpha,\beta) . For example, with \beta=0.15 and \alpha=0.1 , perfect targeting correctly identifies 100 at-risk individuals per 1,000 jobseekers, compared to only 15 under random assignment. In practice, prediction quality lies between these extremes. Using a gradient boosting model trained on administrative records, predictive targeting achieves 42 correct identifications per 1,000 jobseekers. Figure 9(a) in the Appendix shows how this value declines with rising capacity; when resources are abundant, accurate targeting matters less. To explore the value of prediction along this continious range, we interpolate between current performance and perfect prediction, \tilde{p}=p+\eta(w-p) , where 0\leqslant\eta\leqslant 1 controls the magnitude of improvement, implying \text{RMSE}(\tilde{p})=(1-\eta)\times\text{RMSE}(p) . In settings like employment services, where agencies already operate on large administrative datasets, further predictive gains require collecting new features and data sources, investments whose costs and effects are difficult to anticipate. With this approach, planners can evaluate whether a given improvement in predictive accuracy would be worthwhile relative to other levers. By allowing \eta to vary across the population, we can simulate targeted improvements for subgroups of the population. – Covariate Subgroup. Setting \eta(x)=\eta\cdot\mathbf{1}\{g(x)=1\} concentrates improvement in a particular demographic group, region, or administrative office. – Prediction Subgroup. And, \eta(p)=\eta\cdot\mathbf{1}\{|p(x)-\tau|<\varepsilon\} targets marginal cases near the decision boundary. Figure 9(b) in the Appendix shows the welfare gains induced by uniform prediction improvements across the population. 5.1 Is collecting additional information for jobseekers with limited employment history worth it? ( Q2 ) Next, we consider a scenario in which we aim to simulate the value of improving the predictor for a specific subgroup. We focus on jobseekers over 35 for whom information on last job is missing or unavailable ( \approx 3\% of cases), either because records are incomplete or because they have limited formal employment experience. These individuals are harder to assess using standard administrative data. Specifically, we set \eta(x)=\eta\cdot\mathbf{1}\{\text{age}>35\land\text{missing job information}\} . In our setting, we observe that RMSE would need to decrease by 17\% to match the RMSE of the overall population. Specifically, we compare two investment options: (1) allocating caseworker hours to conduct intake interviews to collect additional information for this subgroup, thereby improving p , or (2) using those same caseworker hours to expand \alpha , prioritizing a larger fraction of the overall population with existing prediction quality. Suppose each additional screening slot requires 4 hours of caseworker time, while collecting missing employment information takes approximately 1 hour per jobseeker with unknown job history. The cost of data collection is known, but it is unclear what prediction improvement it will generate. What prediction improvement would justify investing in data collection rather than capacity expansion? (a) (b) Figure 2 : Comparison of prediction improvements versus capacity expansion for targeting long-term unemployment risk ( \alpha=\beta=0.15 ). The subgroup consists of jobseekers over 35 with missing or unavailable employment history ( \approx 3\% of cases), for whom standard administrative data is less informative. Additional data collection assumed to cost 1 caseworker hour per jobseeker in this subgroup; this total budget is converted into an equivalent number of screening slots at 4 hours per slot, defining the capacity expansion baseline. Since the RMSE improvement achieved by data collection is uncertain, both panels plot the welfare difference across a continuous range of hypothetical uniform RMSE reductions, allowing the planner to read off the break-even requirement. (a) Data collection applied to all subgroup members; the yellow line marks break-even. (b) Same comparison when data collection is restricted to subgroup members near the decision threshold (10% bandwidth), where better predictions are most likely to change allocation decisions. We use rvp to simulate this tradeoff. Figure 2(a) shows the welfare difference between investing in prediction improvements versus capacity expansion, as a function of the RMSE reduction achieved in the subgroup. The yellow line marks the break-even point. RMSE would need to decrease by at least 20\% to make prediction investment welfare-equivalent to capacity expansion, while a 17\% reduction is needed to match population-average prediction quality. Since break-even requires exceeding this threshold, bringing the subgroup to better-than-average prediction quality, the planner must assess whether such gains are realistic. Figure 3 : Maximum caseworker hours a planner should invest in data collection to improve predictions for jobseekers over 35 with missing employment history. For each hypothetical uniform RMSE reduction, the y-axis shows the hours of capacity expansion, at 4 hours per additional screening slot, that would lead to the same welfare gain. This defines an upper bound on the cost-worthwhile investment in data collection. Figure 3 shows for each level of RMSE improvement the equivalent capacity expansion (in caseworker hours) that would generate the same welfare gain. This provides intuition about the “opportunity cost” of prediction investments. For instance, a 10\% RMSE reduction in this subgroup generates welfare equivalent to expanding capacity by approximately 1,000 hours, or 250 additional screening slots. However, more targeted improvements in prediction may still be worthwhile. Social planners could focus data collection on individuals near the decision threshold, where better information is most likely to change allocation decisions. We model this as \eta(x,p)=\eta\cdot\mathbf{1}\{\text{age}>35\land\text{missing job information}\}\cdot\mathbf{1}\{|p(x)-\tau|<\varepsilon\} , where \varepsilon defines a 10\% bandwidth. Figure 2(b) (bottom) shows that this targeted approach requires a much smaller RMSE reduction to break even – less than 5\% for those near the threshold. For this employment office, the analysis suggests that intake interviews for all jobseekers with missing history are less likely to pay off, but targeted data collection for those near the threshold could be worthwhile. 5.2 What is the relative value of prediction when allocating both good and harms? ( Q3 ) Employment agencies often aim to allocate job training programs to individuals expected to benefit most. Empirical evaluations document substantial heterogeneity in training effects across baseline labor market prospects [ Osikominu 2021 , Osikominu 2013 , Wunsch 2016 ] . Training programs typically require participants to reduce job search activity during enrollment, creating lock-in effects that delay employment. For individuals with strong labor market prospects (those likely to find work quickly) this opportunity cost can outweigh the downstream benefits of training. In contrast, individuals at high risk of long-term unemployment tend to benefit more: they face lower opportunity costs from lock-in and show larger gains in downstream earnings [ Osikominu 2013 ] . To capture this pattern, we adopt a simple utility u(w,a)=a\cdot g(w) based on predicted unemployment duration y where g(w)=-h if w0,\ \rho\neq 1 The curvature of the CRRA utility function is governed by \rho , with higher values of \rho corresponding to larger utility gains from cash transfers to poorer households (relative to cash transfers to richer households). Values of \rho from 2-4 are standard in the literature Gandelman and Hernandez-Murillo 2015 ; following Hanna and Olken 2018 we use a value of \rho=3 in our empirical simulations. We evaluate a simple allocation policy that ranks households by predicted consumption p(x) and allocates to those predicted poorest up to capacity \pi(x)=\mathbf{1}\{p(x)\leqslant t_{\alpha}\} . Figure 6 shows the ratio of welfare under predictive versus random targeting, varying capacity (i.e. the share of households eligible for cash transfers) with a fixed benefit size of $100 USD PPP (purchasing power parity) — corresponding to an 8% increase in yearly consumption for the average household in Ethiopia in 2015. The value of predictive targeting is substantially higher under CRRA utility than step function utility, and highest at constrained capacity levels. Similar patterns hold when varying benefit size at fixed capacity (Figure 11 ). Figure 7 : Welfare-optimizing budget allocation for a new hypothetical cash transfer program in Ethiopia, as a function of total program budget (CRRA utility \rho=3 , and step-function utility \beta=0.5 ). Data collection refers to poverty scorecard surveys at a median cost of $13 USD PPP per household; capacity investment expands the share of households receiving transfers at a fixed benefit of $100 USD PPP. (a) Optimal share of budget allocated to data collection versus transfers. (b) Resulting share of households with scorecard data collected. (c) Resulting program capacity. 6.1 What is the value of improving prediction when designing a new program? ( Q1 ) Because the poverty scorecard surveys used to estimate household poverty in proxy means tests are expensive to conduct — with a median per-survey cost of $13 USD PPP reported in the literature [ Aiken et al. 2023 ] — such PMT registry databases often fail to cover all households in a country, or even all households in the poorest parts of a country. A recent review of PMT registries in low- and middle-income countries found a median registry coverage of 21% of households (ranging from less than 1% in Belize to over 99% in Argentina) [ Grosh et al. 2022 ] . Households without PMT scorecard data collected are by default ineligible for aid programs targeted with a proxy means test, effectively dramatically eroding predictive accuracy of the targeting model at deployment time. The administrators of PMT-targeted cash transfer programs thus face an allocation design problem: with a fixed budget to invest, should they prioritize investing in data collection to improve targeting accuracy (by reducing the errors of exclusion arising from households not having PMT data collected), or invest in increasing the cash transfer budget dispersed by the program? We use rvp to simulate a planner designing a new aid program with a fixed budget. With no data yet collected for program targeting, how much of the budget should be invested in PMT data collection vs. cash transfers? We assume a fixed benefit size, so the only investment in allocation available to the planner is increasing capacity (we relax this constraint in Section 6.2 ). We simulate aid programs with budgets up to $2.7 billion PPP per year. 4 4 4 This maximum budget corresponds to 100% capacity for a 100 per year cash transfer program covering Ethiopia’s 27.3 million households if no budget were allocated for data collection. We then identify the welfare-optimizing choice of investments in data collection for targeting vs. distribution of cash transfers. Figure 7 shows that the optimal investment in data collection is higher under CRRA utility than the more egalitarian step function. For both programs, the optimal budget allocations for limited-budget programs (under USD $1.5 billion PPP) are a mix of data collection and expanding capacity; for large-budget programs collecting data for all households is the welfare-optimizing approach. 6.2 What is the value of improving prediction when expanding an existing program? ( Q1 ) Section 6.1 assumed a fixed transfer size of $100 USD PPP to all beneficiaries, but a planner may have the option to choose between increasing program allocations on the extensive margin by increasing capacity, or on the intensive margin by increasing the benefits allocated to eligible households. Consider a planner who has already made initial investments in data collection, capacity, and benefit sizes. Given an increase in available budget, where should improvements be prioritized? We consider a typical real-world cash transfer program, with 20% data coverage to begin with, 5% capacity, and a yearly cash transfer to eligible households of $100 PPP. What if the existing data collection coverage was much smaller (1%) or much larger (70%)? What if the existing capacity was much smaller (0.5%) or much larger (40%)? What if the benefit size was much smaller ($10 per household) or much larger ($1,000 per household)? rvp answers this question by optimizing over policy levers, given the planner’s baseline. Figure 8 shows the best incremental investments under CRRA utility for varying initial conditions. The best allocation of resources to each policy lever is very dependent on the original investments, demonstrated by the variation across subplots in Figure 8 . When there is little data already labeled, data collection is prioritized, but the share of data labeled does not make a large difference in how the transfer budget should be allocated between the intensive and extensive margin. Data collection to improve predictive accuracy is also more important when there is high initial capacity and large initial transfer sizes. (a) Low initial data share (b) High initial data share (c) Low initial capacity (d) High initial capacity (e) Low initial transfer (f) High initial transfer Figure 8 : Optimal marginal investments in data collection, capacity, and benefit size as a function of additional budget, varying initial conditions. (a)-(b): Low (1%) vs. high (70%) initial data share, holding capacity (5%) and transfer ($100 PPP) fixed. (c)-(d): Low (0.5%) vs. high (40%) initial capacity, holding data (20%) and transfer ($100 PPP) fixed. (e)-(f): Low ($10 PPP) vs. high ($1000 PPP) initial transfer, holding data (20%) and capacity (5%) fixed. 7 Conclusion Building on past theoretical work on the relative value of prediction in allocation problems, this paper introduces an empirical framework for reasoning about investing in improved prediction relative to other policy levers available to the implementers of systems that allocate scarce social goods. We show the value of this framework in two empirical examples, and provide the rvp software toolkit that generalizes our framework to a variety of prediction-allocation settings. We hope that this work will allow researchers and practioners to apply similar methods to new prediction-allocation problems, and to reason about improving prediction as part of the broader set of design choices available in such settings. Appendix A Identifying Long-Term Unemployment in Germany A.1 Background Algorithmic profiling of job seekers in the delivery of support measures are debated and implemented by Public Employment Services (PES) in various countries [ Loxha and Morgandi 2014 , Körtner and Bonoli 2023 ] . In Germany, the introduction of algorithmic decision-support tools has been discussed since the early 2000s [ Rudolph and Müntnich 2001 ] . A common narrative in these discussions is the hope to improve efficiency over rule- or case-worker-based profiling workflows, supported by comparative studies that report higher accuracy of algorithmic profiling relative to human case-workers in predicting long-term unemployment risks [ Desiere et al. 2019 , Junquera and Kern 2025 ] . Yet, German PES currently rely on case-worker-based profiling, motivating our case study as an illustrative investigation of how different profiling regimes could support employment services in Germany. The hope of increased efficiency is contrasted by concerns of disparate impact of prediction-based profiling as historical disadvantages of minorities are often deeply embedded in labour market data. In the German context, this includes long-standing disadvantages and discrimination based on gender and ethnicity [ Azmat et al. 2006 , Zschirnt and Ruedin 2016 ] . Kern et al. 2024 show how profiling models in the German context can incur considerable error disparities based on nationality. Similar concerns are raised for the AMAS model in Austria by Allhutter et al. 2020 and Achterhold et al. 2025 , and for a profiling system used by the Flemish PES Desiere and Struyven 2021 . Zezulka and Genin 2024 study the link between LTU risk predictions and targeting decisions with data from the Swiss PES. In the targeting context, Cockx et al. 2023 and Goller et al. 2025 exploit effect heterogeneity of active labour market programs (ALMPs) to find optimal allocations of programs to job seekers. Körtner and Bach 2023 demonstrate how inequality-averse allocation of ALMPs to job seekers could mitigate historical differences in group-specific unemployment risks. Yet, a common thread in these works is that most parameters of the allocation problem are treated as given, i.e, they present modeling solutions given fixed, and often insufficient, data rather than asking how (subgroup) outcomes could be improved with an expanded set of actions, such as additional data collection or increased screening capacity. A.2 Data We make use of a comprehensive dataset on German jobseekers. The Sample of Integrated Labour Market Biographies (SIAB) is provided via a Scientific Use File from the Research Data Centre (FDZ) of the German Federal Employment Agency (BA) at the Institute for Employment Research (IAB) [ Schmucker and vom Berge 2023b ] . The SIAB is a 2% sample of all governmental labor market records in Germany, comprising approximately 60 million entries spanning 1970 to 2021. It contains information on employment status, jobseeker demographics, employment and benefits histories, and participation in active labor market programs. Further details on its content, sampling procedure, and anonymization can be found in the accompanying data report [ Schmucker and vom Berge 2023a ] . A.3 Predictive Modeling We construct a prediction task for long-term unemployment, predicting the number of months a jobseeker will remain unemployed at entry into unemployment. Following Bach et al. 2023 , Kern et al. 2024 , Fischer-Abaigar et al. 2025 , we use the same spell aggregation procedure to construct covariates capturing sociodemographic information, labor market and benefits history, and characteristics of the last job held. This leads to 56 numerical and 24 categorical variables; the latter are one-hot encoded. To simulate deployment conditions in real employment offices, we use records from 2010 and 2011 for training, data from 2012 for validation, and data from 2015 for testing. We train a gradient boosting model (CatBoost) on this temporal split. All policy lever comparisons in this paper are conducted on the test set ( n=86,692 ). A.4 Replication We provide full replication code for the policy lever comparisons using rvp. Due to data sensitivity, the underlying records are not publicly available but can be applied for at the Research Data Centre (FDZ) of the Institute for Employment Research (IAB). A.5 Additional Analysis (a) Value of Prediction (b) Improvements in Prediction Figure 9 : (a) Welfare ratio of prediction-based targeting relative to random allocation across different baseline capacities \alpha . (b) Welfare gains from improving prediction ( \alpha=0.1 , \beta=0.15 ). Value of Prediction for Women. Evidence suggests that certain demographic groups, such as women or non-citizens, face distinct labor market challenges, including discrimination and greater vulnerability to long-term unemployment [ Arntz and Wilke 2009 , Bishu and Alkadry 2017 ] . Concerns have also been raised about how statistical profiling tools may reinforce existing inequalities for these groups [ Allhutter et al. 2020 , Kern et al. 2024 ] . An employment agency might therefore ask what would be gained from improving prediction specifically for women. Figure 10 shows welfare gains from prediction improvements for women (setting \eta(x)=\eta\cdot\mathbf{1}\{\text{female}\} ). We evaluate these gains under two welfare functions; one that averages utility across the full population, and one that averages only over women. A policymaker might primarily aim to improve allocation for women motivated by evidence of labor market discrimination or concerns about algorithmic fairness. Under such a subgroup-specific objective, welfare gains rise more with prediction quality, making prediction improvements relatively more valuable than aggregate welfare alone would suggest. The tradeoffs we study in the following sections are shaped by these choices, how utility is specified and what outcomes are prioritized. (a) Improvements for Women Figure 10 : Welfare gains from improving prediction for women ( \alpha=0.1 , \beta=0.15 ). Welfare is evaluated under two objectives: averaged over the full population, and averaged over women only. Appendix B Poverty Targeting B.1 Background Proxy means tests are one of the most popular approaches for targeting cash transfer programs and other social protection programs in low-income contexts where comprehensive administrative data on incomes or consumption expenditures are unavailable. They are currently used to target social protection programs in at least fifty low- and middle-income countries [ Barrientos 2018 ] . The accuracy of proxy means tests in practice for identifying poor households have been studied in many studies across Africa Brown et al. 2018 , Schnitzer and Stoeffler 2024 , McBride and Nichols 2018 , Asia Narayan and Yoshida 2005 , and Latin America Noriega-Campero et al. 2020 . Other work has assessed the fairness of PMTs relative to other targeting approaches Noriega-Campero et al. 2020 , susceptibility to intentional data misreporting and collusion Banerjee et al. 2020 , and acceptability to data subjects Premand and Schnitzer 2021 , Alatas et al. 2012 , but little previous work has addressed the benefit of investing in PMT coverage and accuracy in comparison relative to investment in allocating resources to the cash transfer programs and other social programs targeted with PMTs. Aiken et al. 2025 provide an initial framework for such cost-benefit trade-offs using data on targeting cash transfers in Bangladesh, we expand this framework in this paper to account for additional policy levers and data availability constraints. B.2 Data The data for our simulations of cash transfer program are from Ethiopia’s 2015 Living Standards Measurement Survey. The survey data covers 4,954 nationally representative households. We use data from 4,694 households that have complete information on consumption expenditures, asset posession, housing quality, and household demographics. We convert consumption expenditures data to yearly total consumption expenditures measured in USD PPP using the PPP exchange rate for 2015 from the World Bank. B.3 Predictive Modeling The target of our predictive model is log-transformed total household consumption expenditures. The features are 54 variables commonly included in proxy means tests in low-income countries, including: – Asset possession, such as as whether the household owns radio, TV, satellite dish, sofa, bicycle, car, or bed – Housing quality, such as how many rooms the dwelling has, the construction material of the roof and floor, and the primary materials used for lighting and cooking – Household demographics, such as the number of members, number of children, gender and age of the household head, and education and literacy levels of the household head – The region of residence of the household All continuous feature variables are winsorized at the 99th percentile and normalized to a 0-1 range. All categorical variables are one hot encoded. We train the predictive model on a random 75% of households and produce predictions on the remaining 25%. We repeat all our experiments for poverty targeting over 100 random train-test splits and report the average result. Our predictive model is a LASSO regression with regularization strength determined via three-fold cross validation. B.4 Simulating test-time data availability Several of our experiments involve simulating lower test-time data availability – scenarios where for some households in the test set feature data is not available. We simulate this by removing predictions for these households from the test set; households without predictions are ineligible to be targeted regardless of program capacity. In some of our simulations, the share of households with data availability can be lower than the program capacity—in this setting, households without data are targeted at random (along with all households with data available) to fill the program capacity constraint. B.5 Replication All code for the poverty targeting simulations is available, including cleaning the survey data to prepare it for predictive modeling. The survey data can be downloaded from the LSMS program at https://microdata.worldbank.org/index.php/catalog/2783 . B.6 Additional Analysis Figure 11 : Ratio of welfare impacts under predictive targeting to welfare impacts under random targeting, as a function of benefit size (keeping program capacity fixed at 20%). Appendix C rvp Toolkit Table 1 summarizes the mapping between the formal objects defined in the main text and their software implementations. Full documentation, installation instructions, and worked examples are available here . Table 1 : Mapping from conceptual components to rvp classes. Concept Class Important Parameters Distribution {\cal D} AllocationData df, predictions_col, ground_truth_col Utility u(w,a) CRRAUtility rho, b PartitionedUtility thresholds, values Constraint \alpha CoverageConstraint max_coverage, population_size Policy \pi RankingPolicy ascending Problem AllocationProblem data, utility, constraint, policy Levers \ell PredictionImprovementLever error_reduction, covariate_mask ExpandCoverageLever coverage_increase, marginal_cost_per_person DataLabelingLever label_share, cost_per_label CRRABenefitLever new_benefit Comparison optimize_budget_allocation (Q1) Budget optimization LeverComparison (Q2) Equivalent cost, welfare difference plot_welfare_curve (Q3) Welfare curves, heatmaps