FairTree: Subgroup Fairness Auditing of Machine Learning Models with Bias–Variance Decomposition Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 27–30, 2026; Montreal, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 27–30, 2026, Montreal, Canada Note: Accepted at the 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montréal, Canada. This is the author’s preprint version. CCS: Computing methodologies Machine learning CCS: Social and professional topics
Rudolf Debelak · 2026
Read FairTree: Subgroup Fairness Auditing of Machine Learning Models with Bias–Variance Decomposition Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 27–30, 2026; Montreal, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 27–30, 2026, Montreal, Canada Note: Accepted at the 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montréal, Canada. This is the author’s preprint version. CCS: Computing methodologies Machine learning CCS: Social and professional topics by Rudolf Debelak (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19357.txt.
Introduction
Debelak presents FairTree, a method for auditing subgroup fairness in machine learning models, adapted from psychometric invariance testing. Standard tests lean on loss-based scores, which can miss score shifts inside key subgroups. Earlier tools struggle with smooth-valued inputs, but FairTree handles continuous, categorical, and ordinal features directly, with no binning. It also splits score gaps into steady bias and variance, and the paper offers and tests two variants, one shuffle-based and one closer to a model-based test.
Catalog record
| CREATOR | Rudolf Debelak |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53851 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.19357
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FairTree: Subgroup Fairness Auditing of Machine Learning Models with Bias–Variance Decomposition Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 27–30, 2026; Montreal, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 27–30, 2026, Montreal, Canada Note: Accepted at the 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montréal, Canada. This is the author’s preprint version. CCS: Computing methodologies Machine learning CCS: Social and professional topics Rudolf Debelak Abstract . The evaluation of machine learning models typically relies mainly on performance metrics based on loss functions, which risk to overlook changes in performance in relevant subgroups. Auditing tools such as SliceFinder and SliceLine were proposed to detect such groups, but usually have conceptual disadvantages, such as the inability to directly address continuous covariates. In this paper, we introduce FairTree, a novel algorithm adapted from psychometric invariance testing. Unlike SliceFinder and related algorithms, FairTree directly handles continuous, categorical, and ordinal features without discretization. It further decomposes performance disparities into systematic bias and variance, allowing a categorization of changes in algorithm performance. We propose and evaluate two variations of the algorithm: a permutation-based approach, which is conceptually closer to SliceFinder, and a fluctuation test. Through simulation studies that include a direct comparison with SliceLine, we demonstrate that both approaches have a satisfactory rate of false-positive results, but that the fluctuation approach has relatively higher power. We further illustrate the method on the UCI Adult Census dataset. The proposed algorithms provide a flexible framework for the statistical evaluation of the performance and aspects of fairness of machine learning models in a wide range of applications even in relatively small data. 1. Introduction The evaluation of model performance in machine learning is a complex, multi-faceted problem. An aspect that is closely related to the evaluation of fairness is the detection of subpopulations where a chosen machine learning model performs worse than in other parts of the population. This problem is particularly relevant in prediction problems, where such algorithms can help with the detection of use cases where models predictions are found to be systematically biased or unreliable as an aspect of model validation. The aim of this paper is the presentation of a new method named FairTree that is based on recursive partitioning, a method that was adapted from psychometrics and econometrics ( 11 ; 10 ; 20 ) . Compared to existing frameworks, our approach has the following features: a) It can handle ordered and unordered categorical features as well as continuous features without requiring their discretization. This reduces the risk of overlooking slices with poor prediction performance. b) In the interpretation of the slices, we distinguish between effects on bias and variance, since those lead to qualitative differences in their interpretation. While bias detection reveals if and where a machine learning model systematically discriminates against a group (e.g., consistently underpredicting income for women), detecting variance shifts reveals where a model is unreliable or unstable for a specific group. The proposed method leads to an intuitive visualization that summarizes its findings. 2. Related Work Model validation is a central part of establishing machine learning pipelines. While general metrics such as the root mean squared error can provide guidance on the overall performance of a model, practitioners and researchers are also interested in finding populations where a model shows exceptionally bad performance, which also includes systematic biases. This type of evaluation is closely related to the assessment of a model’s fairness and the possible discrimination of relevant subpopulations. In the following two subsections, we will first briefly summarize work in this line of research in machine learning research, before describing related approaches in psychometrics. 2.1. Fairness and Evaluation in Machine Learning The evaluation of fairness in machine learning presents a rich, complex challenge. At its core is the problem of how ethical and legal frameworks for fairness can be formalized ( 9 ) . Chouldechova and G’Sell ( 4 ) propose a recursive partitioning framework, also based on score-type tests in the tradition of Zeileis et al. ( 21 ) , for identifying subgroups where two classification models differ in their fairness properties, such as disparities in false positive rates. While their approach shares the same methodological foundations as FairTree, it addresses a different problem: comparing fairness metrics across two models rather than auditing the performance of a single model. FairTree instead targets the loss function of a single model directly, applies to both classification and regression settings, and decomposes detected performance disparities into bias and variance components. Other approaches for evaluating fairness include structured regression for intersectional subgroup analysis ( 7 ) and complementary interactive visualization frameworks ( 3 , e.g.,) . The FairTree framework operates in the domain of group fairness metrics by comparing the loss function of models across different groups. In contrast to classical metrics for assessing fairness in machine learning, such as demographic parity or equalized odds, FairTree is not based on a comparison of two predefined groups. Kearns et al. ( 8 ) address a related problem by auditing fairness over rich collections of subgroups defined by conjunctions of features, but their combinatorial approach assumes discrete features and focuses on learning fair classifiers rather than diagnosing the source of performance disparities. FairTree instead proposes a method of interpretable machine learning to detect groups of data points, which are defined by values of observed covariates, between which the model shows performance heterogeneity. Methods that are based on the comparison of pre-existing groups can overlook a change in the performance of models by comparing groups which are not related to observed model changes. The proposed algorithm aims to address this drawback by detecting groups which are affected by changes in the predictive performance of a machine learning model, as measured by the loss function in the validation or test data set. Several approaches for detecting data slices with poor performance exist. A general approach consists of clustering data points that show similar values in their loss function. An important alternative method is the SliceFinder framework ( 5 ; 6 ) , which aims at finding clusters of data points which not only share a similar level of their loss function, but are also interpretable for humans. By design, this framework searches for groups of data points which a) have a specific minimum effect size, b) are statistically significant, and c) can be described by a minimum number of literals, or defining characteristics (such as "sex", "education", or similar). To find such slices, Chung et al. ( 5 ) propose two automated methods, with the first being based on decision trees and the second one being based on lattice searching. The first approach leads to an exhaustive partitioning of the feature space into slices. The second approach is relatively more expensive and leads to slices that can potentially overlap. Both approaches can be directly applied with categorical features. Numerical features can be handled as well by discretizing them. If an unfortunate discretization is chosen, it might lead to a misinterpretation of effects, and in the worst case, even to overlooking small slices with poor performance. While the SliceFinder approach is conceptually interesting and related to the presented FairTree approach, there