Fair Classification by Direct Intervention on Operating Characteristics
Kevin Jiang, Edgar Dobriban · 2025
Read Fair Classification by Direct Intervention on Operating Characteristics by Kevin Jiang, Edgar Dobriban (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-25481.txt.
Introduction
Kevin Jiang and Edgar Dobriban build fair classifiers by adjusting a ready trained model's behavior directly, rather than retraining it. Fairness rules like demographic parity and equalized odds can clash, and meeting several at once is hard. Their 2025 method works in the setting where group membership is known at decision time.
First, the method finds the best achievable group wise performance curves from the base model's own trade off fronts. Then it post processes the model's outputs, mixing group specific thresholds, to hit those targets with as few changes as possible. The approach extends to several protected traits and several fairness rules at once. On two standard datasets, it met three fairness measures approximately, with many fewer interventions and accuracy near the best possible.
Catalog record
| CREATOR | Kevin Jiang, Edgar Dobriban |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 111 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-25481
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fair Classification by Direct Intervention on Operating Characteristics Author e-mail addresses: [email protected] , [email protected] . Kevin Jiang, Edgar Dobriban Abstract We develop new classifiers under group fairness in the attribute-aware setting for binary classification with multiple group fairness constraints (e.g., demographic parity (DP), equalized odds (EO), and predictive parity (PP)). We propose a novel approach, applicable to linear fractional constraints, based on directly intervening on the operating characteristics of a pre-trained base classifier, by (i) identifying optimal operating characteristics using the base classifier’s group-wise ROC convex hulls and (ii) post-processing the base classifier to match those targets. As practical post-processors, we consider randomizing a mixture of group-wise thresholding rules subject to minimizing the expected number of interventions. We further extend our approach to handle multiple protected attributes and multiple linear fractional constraints. On standard datasets (COMPAS and ACSIncome), our methods simultaneously satisfy approximate DP, EO, and PP with few interventions and a near-oracle drop in accuracy; comparing favorably to previous methods. 1 Introduction Modern machine learning systems inherit and can amplify historical and measurement biases present in data, raising concerns in high-stakes applications such as criminal justice, credit, hiring, and healthcare (see e.g., Barocas & Selbst 2016 ; Obermeyer et al. 2019 ; Raghavan et al. 2020 ; Chouldechova & Roth 2020 ; Fuster et al. 2022 , etc) . These concerns have galvanized the field of algorithmic fairness ( Barocas et al. 2023 , see e.g.,) , which formalizes fairness criteria and develops methods to enforce them. One broad family of metrics, termed group fairness criteria, requires that a performance metric of a model is equal across protected groups (e.g., race, gender, age). These performance metrics are often motivated by legal rulings, regulatory guidance, and broader normative considerations (e.g., anti-discrimination norms, see Hardt et al. 2016 ; Verma & Rubin 2018 ; Barocas et al. 2023 ). Methods designed to ensure group fairness can be roughly categorized into three categories based on where they intervene in the training pipeline: pre-processing intervenes on the training data via methods like reweighing/sampling, causal inference, and adversarial debiasing (see e.g., Salazar et al. 2021 ; Zhang & Sang 2020 ; Zeng et al. 2024 ; Plečko et al. 2024 , etc) ; in-processing modifies the learner’s objective or model architecture (see e.g., Zhang et al. 2018 ; Agarwal et al. 2018 ; Cho et al. 2020 , etc) ; and post-processing alters the predictions of a fixed learned model (see e.g., Hardt et al. 2016 ; Alghamdi et al. 2022 ; Xian & Zhao 2024 , etc) . These methods have found broad applications (see e.g., Jammalamadaka & Itapu 2023 ; Weerts et al. 2023 ; Mackin et al. 2025 , etc) . In parallel, policy and litigation have highlighted the desire to simultaneously satisfy multiple fairness constraints (e.g., analyses surrounding the COMPAS model, see Larson & Angwin 2016 ; Dieterich et al. 2016 ). However, incompatibility results in the literature show that perfect compliance across sufficiently many metrics is generally impossible except in special cases ( Chouldechova 2017 ; Kleinberg 2018 ; Defrance & De Bie 2025 ) . Consequently, many works adopt approximate group fairness, where a model’s performance across groups are only required to be approximately equal (see, e.g., Celis et al. 2019 ; Zeng et al. 2024 ). Our contributions. In this work, we develop new classifiers aiming for approximate group fairness for binary classification with multiple group fairness constraints (e.g., demographic parity (DP), equalized odds (EO), and predictive parity (PP)), as long as they have a linear fractional representation related to that considered in Celis et al. 2019 . Our novel approach directly intervenes on the operating characteristics of a pre-trained base classifier, by: (i) identifying optimal operating characteristics using the base classifier’s group-wise receiver operating characteristic (ROC) convex hulls; and then (ii) post-processing the base classifier to match those targets. We extend our approach to handle multiple protected attributes and multiple linear fractional constraints. On standard datasets (COMPAS and ACSIncome), our methods simultaneously satisfy approximate DP, EO, and PP. They lead to few changes to the predictions made by the original classifier and a nearly optimal drop in accuracy; comparing favorably to previous methods. 2 Related Work Both empirically and theoretically, it is known that satisfying multiple fairness constraints can be challenging ( Chouldechova 2017 ; Kleinberg 2018 ; Majumder et al. 2023 ; Defrance & De Bie 2025 ) . Bell et al. 2023 show that, in principle, there may exist classifiers that achieve approximate fairness for multiple constraints. However, this assumes the existence of classifiers that can satisfy an arbitrary assignment of labels to the test set, and also requires tuning population-level quantities that are typically out of our control. In highly relevant work, Celis et al. 2019 propose a meta-algorithm based on an optimization perspective in the space of classifiers. Our approach differs fundamentally, since we rely on the geometry of the realizable regions traced by the convex hull of each group’s ROC curve. Hsu et al. 2022 develop post-processing methods based on mixed-integer linear programming for a more granular notion of fairness, equalizing group rates across scores/predicted probabilities as opposed to binary labels. Their definitions reduce to ours when using two bins. With this approach, empirically, our methods outperform those from Celis et al. 2019 and Hsu et al. 2022 . Due to space limitations, additional related work is reviewed in Section A.1 . 3 Problem Setup We consider a fair binary classification problem where two types of feature are observed: the usual feature X\in\mathcal{X} and the protected feature A\in\mathcal{A} which we take to be discrete, with \mathcal{A}=\{1,2,\ldots,m\} , m\geq 2 . We would like to achieve non-discrimination with respect to the protected groups , defined by the values a\in\mathcal{A} of the protected feature. The features and binary label are distributed according to (X,A,Y)\sim\mathbb{P} . Given a pre-trained probabilistic predictor s:\mathcal{X}\times\mathcal{A}\to[0,1] and an i.i.d. sampled post-processing set 1 1 1 In the post-processing literature for fairness, this set has been alternatively called a holdout or calibration set ( Pleiss et al. 2017 ; Hansen et al. 2024 ) . \mathcal{D}_{\textrm{post}}:=\{(x_{i},a_{i},y_{i})\}_{i=1}^{N} drawn from \mathbb{P} , we seek to develop a (possibly randomized) classifier f:\mathcal{X}\times\mathcal{A}\to\{0,1\} that minimizes the population risk \mathcal{L}(f)=\mathbb{E}[\ell(f(X,A),Y)] , for a loss \ell:\{0,1\}\times\mathcal{Y}\to\mathbb{R} subject to K\geq 1 fairness constraints . To impose fairness constraints, we consider equalizing certain group performance functions G_{k,a} , which reflect the performance of the classifier over protected groups. We focus on loss functions and group performance rates which can be expressed as ratios of linear combinations of a classifier’s true positive rate (TPR) and false positive rate (FPR); as well as the associated false negative rate (FNR) and true negative rate (TNR), for each group 2 2 2 When it is clear which classifier f the group-wise operating characteristics are tied to, we will sometimes omit the classifier from the argument, writing, for instance \textrm{TPR}_{a} , etc. a\in\mathcal{A} : \displaystyle\textrm{TPR}_{a}(f):=\Pr(f{=}1\mid Y{=}1,A{=}a), \displaystyle\qquad\textrm{FPR}_{a}(f):=\Pr(f{=}1\mid Y{=}0,A{=}a); \displaystyle\textrm{FNR}_{a}(f):=1-\textrm{TPR}_{a}(f), \displaystyle\qquad\textrm{TNR}_{a}(f):=1-\textrm{FPR}_{a}(f). (1) We consider the following class of group performance functions, a special case of more general notions from Celis et al. 2019 , but encompassing many common fairness metrics, see Table 1 ). Definition 3.1 (LF group performance functions) . For each