Decision-centric fairness: Evaluation and optimization for resource allocation problems
Simon De Vos, Jente Van Belle, Andres Algaba, Wouter Verbeke, Sam Verboven · 2025
Read Decision-centric fairness: Evaluation and optimization for resource allocation problems by Simon De Vos, Jente Van Belle, Andres Algaba, Wouter Verbeke, Sam Verboven (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20642.txt.
Introduction
Simon De Vos and co-authors argue fairness should be judged at the decision point in a paper from 2025. Scores drive real allocations: loans from credit scores, offers from churn scores. A model can look fair on average yet skew the group actually picked. Demographic parity on selected shares is their yardstick.
Their method enforces fairness only inside the decision region. That region spans the thresholds a decision maker might plausibly use. Outside it, the score is left alone, preserving accuracy where choices never land. Optimization then reshapes scores just where selection happens. The result is a fairer allocation with less needless distortion. Fairness, on this view, is a property of decisions, not of scores in the abstract.
Catalog record
| CREATOR | Simon De Vos, Jente Van Belle, Andres Algaba, Wouter Verbeke, Sam Verboven |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-20642
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Decision-centric fairness: Evaluation and optimization for resource allocation problems Simon De Vos, Jente Van Belle, Andres Algaba, Wouter Verbeke, Sam Verboven Abstract Data-driven decision support tools play an increasingly central role in decision-making across various domains. In this work, we focus on binary classification models for predicting positive-outcome scores and deciding on resource allocation, e.g., credit scores for granting loans or churn propensity scores for targeting customers with a retention campaign. Such models may exhibit discriminatory behavior toward specific demographic groups through their predicted scores, potentially leading to unfair resource allocation. We focus on demographic parity as a fairness metric to compare the proportions of instances that are selected based on their positive outcome scores across groups. In this work, we propose a decision-centric fairness methodology that induces fairness only within the decision-making region—the range of relevant decision thresholds on the score that may be used to decide on resource allocation—as an alternative to a global fairness approach that seeks to enforce parity across the entire score distribution. By restricting the induction of fairness to the decision-making region, the proposed decision-centric approach avoids imposing overly restrictive constraints on the model, which may unnecessarily degrade the quality of the predicted scores. We empirically compare our approach to a global fairness approach on multiple (semi-synthetic) datasets to identify scenarios in which focusing on fairness where it truly matters, i.e., decision-centric fairness, proves beneficial. A Preprint Keywords Machine learning \cdot Classification \cdot Data-driven decision-making \cdot Demographic parity \cdot Group fairness 1 Introduction In an increasingly data-driven world, algorithms and machine learning models play a crucial role in business decision-making. In this paper, we focus on predictive models that are used to optimize resource allocation, particularly on binary classification models that predict positive-outcome scores for this purpose. Such models are widely used across various domains, including marketing, where retention incentives are offered based on churn propensity scores ( Verbeke et al., 2011 ; Verbeke et al., 2012 ) ; credit risk management, where loans are granted based on default risk assessments ( Lessmann et al., 2015 ) ; and fraud detection, where investigative resources are allocated based on predicted fraud risk ( Van Vlasselaer et al., 2017 ) . These models can exhibit discriminatory behavior toward specific demographic groups through their predicted scores—that is, the predicted scores may follow different distributions across demographic groups—potentially leading to unfair resource allocations. Such discriminatory behavior can originate from biases in the historical data that is used to train the models or from inherent differences between groups in their tendency to belong to the positive class, which—although statistically justified—may be considered unacceptable discrimination when acted upon. Fairness is central to the acceptability of algorithm-informed decisions, particularly in domains where these decisions can significantly affect individuals’ access to resources or opportunities ( Hardt et al., 2016 ) . While much of the existing research has focused on preventing gender-based discrimination in pricing to comply with regulatory standards ( Lindholm et al., 2022 ; Frees and Huang, 2023 ; Xin and Huang, 2024 ) , the relevance of fairness extends well beyond pricing models to key business functions such as credit risk assessment, targeted marketing, and fraud detection. Fairness is closely tied to principles embedded in non-discrimination laws, particularly in the EU and US, which emphasize equitable outcomes across demographic groups and provide a foundation for fairness criteria like demographic parity ( European Union, 2012 ) . Similar to the pricing context, discrimination in credit risk management ( Hurlin et al., 2024 ; Garcia et al., 2024 ) and fraud detection is legally prohibited (e.g., to prevent gender-based discrimination and ethnic profiling). Additionally, in marketing, fairness considerations are seen by some companies as crucial for building and maintaining both a diverse customer base and a positive reputation. Traditional approaches to evaluating algorithmic fairness typically rely on output-based metrics that assess disparities in average predictions or error rates between demographic groups ( Makhlouf et al., 2021 ) . These approaches are built on the idea that protected attributes, such as gender or race, should not impact a predicted score (e.g., a customer’s default risk score). Although such metrics provide a general view, they often overlook more subtle nuances in algorithmic behavior ( Khan and Stoyanovich, 2023 ) . Recent work has expanded fairness analyses by incorporating higher-order moments of the output distribution, such as the variance ( Khan et al., 2023 ) , and by comparing entire output distributions ( Han et al., 2023 ) . More specifically, Han et al. (2023) propose distribution-level variants of demographic parity, a fairness metric that compares the proportions of positive class predictions—the predictions on which we would potentially act in a resource allocation setting—across groups. While Han et al. (2023) focus on model evaluation from a fairness perspective, Peeperkorn and De Vos (2024) show that these distribution-level fairness notions can be used to develop predictive models that are intrinsically more fair. Building on these works, we propose a pragmatic decision-centric fairness approach to classification for resource allocation optimization. Specifically, rather than focusing on inducing demographic parity across the entire output distribution (i.e., ensuring a proportionally equal number of positive outcomes at all possible decision thresholds on the predicted scores), which we term a global fairness approach , we propose to concentrate on the "decision-making region" by inducing parity only within the range of relevant thresholds used for resource allocation, as visualized in Figure 1 . For example, in a customer retention campaign, interventions are typically targeted at customers with a high predicted churn propensity score. Since resource allocation decisions affect only instances within this high-risk-score region, fairness should be enforced within this region, across all relevant application-dependent thresholds. The proposed decision-centric approach aims to ensure fairness where it matters, while achieving better predictions compared to a global fairness approach. The latter imposes overly strict constraints on the model to enforce fairness also outside the decision-making region, where it will not affect real-world decisions, potentially degrading the predictive quality of the generated scores more than necessary. (a) No fairness induction (b) Induced decision-centric fairness Figure 1: Densities of predicted scores \tilde{y} for two demographic groups (with protected attributes s=0 and s=1 , in blue and red, respectively), along with the corresponding demographic parity ( DP ) across all possible thresholds. By inducing decision-centric fairness, we aim to achieve demographic parity in the decision-making region, i.e., where \tilde{y}>\tau , to ensure a proportionally equal number of positive outcomes across the two groups at all thresholds within this region. While achieving fairness in terms of demographic parity is straightforward using a group-dependent decision threshold post-hoc when decisions are made in batch, optimizing classification models to be inherently more fair without focusing on a single decision threshold is useful in common online decision-making settings (i.e., on a continuous basis). In such settings, resource constraints—such as marketing budgets, loan-granting capacity, or investigative resources—may change over time ( Ali and Arıtürk, 2014 ) , causing the decision threshold to vary within a certain decision-making region. In these cases, setting group-dependent decision thresholds post hoc to achieve parity is not possible, and retraining the model each time a new threshold (within the decision-making region) is adopted due to changing resource constraints