Intersectional Divergence: Measuring Fairness in Regression
Joe Germino, Nuno Moniz, Nitesh V. Chawla · 2025
Read Intersectional Divergence: Measuring Fairness in Regression by Joe Germino, Nuno Moniz, Nitesh V. Chawla (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00830.txt.
Introduction
Germino, Moniz, and Chawla propose in twenty twenty-five a fairness measure for prediction models whose outputs are numbers, not labels. Fairness research mostly covers yes-no decisions, leaving score-based systems unchecked. Their measure looks at combinations of protected traits at once, not one at a time, and weighs errors most where users care about the target range.
They also turn the measure into a training penalty with proven convergence and smooth enough behaviour to optimise in practice. Wide tests showed the measure exposes behaviour that averages hide. Training with the penalty improved fairness for single traits and trait combinations alike, at little cost to accuracy. The authors offer both as tools for fairer scoring systems.
Catalog record
| CREATOR | Joe Germino, Nuno Moniz, Nitesh V. Chawla |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-00830
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Intersectional Divergence: Measuring Fairness in Regression Joe Germino, Nuno Moniz, Nitesh V. Chawla Abstract . Fairness in machine learning research is commonly framed in the context of classification tasks, leaving critical gaps in regression. In this paper, we propose a novel approach to measure intersectional fairness in regression tasks, going beyond the focus on single protected attributes from existing work to consider combinations of all protected attributes. Furthermore, we contend that it is insufficient to measure the average error of groups without regard for imbalanced domain preferences. Accordingly, we propose Intersectional Divergence (ID) as the first fairness measure for regression tasks that 1) describes fair model behavior across multiple protected attributes and 2) differentiates the impact of predictions in target ranges most relevant to users. We extend our proposal demonstrating how ID can be adapted into a loss function, IDLoss , that satisfies convergence guarantees and has piecewise smooth properties that enable practical optimization. Through an extensive experimental evaluation, we demonstrate how ID allows unique insights into model behavior and fairness, and how incorporating IDLoss into optimization can considerably improve single-attribute and intersectional model fairness while maintaining a competitive balance in predictive performance. DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY Price: 15.00 ISBN: 978-1-4503-XXXX-X/18/06 1. Introduction There are two critical aspects of growing importance in Fair Machine Learning: the recognition of the intersectionality of protected attributes and the impact of imbalanced domains. While fairness is most commonly measured as the difference in performance between groups across a single protected attribute ( Calders et al., 2013 ; Berk et al., 2017 ; Agarwal et al., 2019 ; Chi et al., 2021 ) , this approach is severely limiting and can hide model biases ( Buolamwini and Gebru, 2018 ) . Instead, one must consider the simultaneous impact of multiple protected attributes, i.e., intersectionality . Furthermore, it is necessary to acknowledge the impact of imbalanced domains. Depending on the context of the task, some values may be more important to predict accurately than others, introducing an additional layer to fairness. Thus far, most existing fairness work has been focused on classification tasks with negligible attention towards regression ( Pessach and Shmueli, 2022 ; Chen et al., 2022 ; Caton and Haas, 2024 ) . While the issues of intersectionality ( Gohar and Cheng, 2023 ; Xu et al., 2024 ) and imbalance ( Iosifidis and Ntoutsi, 2020 ; Roy et al., 2022 ) have been addressed in classification ( Morina et al., 2019 ; Foulds et al., 2020 ) and ranking tasks ( Pastor and Bonchi, 2024 ) , the level of attention to these issues in regression has been negligible in comparison ( Zhao and Chen, 2019 ) . Importantly, this has left a critical gap where no work is available to tackle intersectional fairness, while accounting for imbalanced domain preferences in regression. Figure 1. Unfairness measured by the difference in MAE split by race in 3 different datasets. All measures disparate treatment in race across all persons both Male and Female. Disparate treatment based on race can vary widely based on sex (Male and Female). Results from Experimental Evaluation (Section 5 ). We demonstrate the intersectionality problem in Figure 1 . Unfairness by race varies significantly depending on the sex attribute. For example, in the COMPAS dataset, although overall unfairness by race is near zero, females are subject to disparate treatment based on their race. This shows why using a single feature to evaluate the model bias sources hinders more actionable explanations. As for the consequences of domain imbalance, in Figure 2 , we present a synthetic scenario where a financial firm is using a model to assign clients a risk score. Errors that misidentify high-risk clients as low-risk are more costly than the opposite. Because the Mean Absolute Error (MAE) is equal for both privileged and unprivileged groups, this scenario would appear fair by traditional fairness measures. However, error distributions differ significantly – the MAE for the privileged group is lower than the MAE for the unprivileged group when predicting high-risk scores. Such discrepancies may hold substantial real-world implications. Figure 2. A hypothetical scenario where higher values are more important to predict accurately (left) and the total error for both groups is identical (right) despite the unprivileged group having significantly higher errors in the higher relevance values. Contributions. In this paper, we illustrate the urgency in considering intersectionality and domain imbalance in fair regression measures. We propose a new measure, Intersectional Divergence (ID) , providing a more accurate representation of a model’s biases and a deeper understanding of unfair behavior w.r.t. existing methods. Finally, we demonstrate how ID can be adapted into a loss function, IDLoss, and provide theoretical analysis establishing its convergence properties and optimization guarantees despite its non-convex nature. Our analysis shows that IDLoss satisfies the Łojasiewicz inequality ( Karimi et al., 2020 ) , ensuring convergence to stationary points, and has piecewise Lipschitz continuous gradients that enable practical optimization. 2. Related Work Existing fairness measures can be separated into three categories: group, individual ( Dwork et al., 2012 ; Bechavod, 2024 ; Munagala and S. Sankar, 2024 ) , and counterfactual fairness ( Kusner et al., 2017 ) . The most common of these is group fairness , which attempts to ensure that privileged and unprivileged groups are treated equally. For example, Statistical Parity measures the probability difference between the privileged and unprivileged groups in the positive class ( Dwork et al., 2012 ) , and Equalized Odds measures the difference in the fraction of true and false positives between groups ( Hardt et al., 2016 ) . ABROCA measures the difference between groups’ Receiver Operating Characteristics (ROC) curves ( Gardner et al., 2019 ) . Although there is a focus on measuring and optimizing around single protected attributes, there are strong arguments about the need for a different approach. Critically, Crenshaw (2013) discusses the theory of intersectionality and argues that unique combinations of protected attributes interact in their own ways, which can lead to bias not captured on an individual level. Alternatively, multiple discrimination explores the additive effects of discrimination across multiple protected attributes ( Roy et al., 2023 ) , and Alvarez and Ruggieri (2025) demonstrate that multiple discrimination fails to account for the intersectional biases. Buolamwini and Gebru (2018) show how race and gender intersectionality affects the errors of a facial recognition system, and Colakovic and Karakatič (2023) explores boosting with multiple sensitive attributes. Fair classification algorithms apply these measures to an optimization problem in various ways. Zafar et al. (2017) uses an in-processing approach that applies fairness constraints to a classifier while maximizing performance, and Agarwal et al. (2018) uses an adversarial learning approach to exploit failures in fairness. Alternatively, Kamiran and Calders (2012) develops a pre-processing method to remove unfairness through data relabeling, and Chakraborty et al. (2021) uses data perturbation and sampling. Zhang et al. (2024) proposes a general framework for calibrating models based on fairness risks across multiple sensitive attributes simultaneously. 2.1. Fairness in Regression In regression, group fairness is the common approach and the one we use in ID . Measures such as Statistical