FACROC: a fairness measure for FAir Clustering through ROC curves
Tai Le Quy, Long Le Thanh, Lan Luong Thi Hong, Frank Hopfgartner · 2025
Read FACROC: a fairness measure for FAir Clustering through ROC curves by Tai Le Quy, Long Le Thanh, Lan Luong Thi Hong, Frank Hopfgartner (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-00854.txt.
Introduction
Tai Le Quy, Long Le Thanh, Lan Luong Thi Hong, and Frank Hopfgartner propose FACROC, a visual way to grade fairness in clustering in two thousand twenty-five. Clustering sorts data into groups with no labels, and fair versions try not to slight protected groups. Past fairness scores ignore how good the clusters are for each group value.
FACROC builds a curve for each value of the protected trait, using a quality score drawn from cluster shape. The gap between curves then reads as unfairness, and the plot itself can be inspected by eye. Tests on known fairness data sets and on standard and fair clustering models show the measure works as hoped. It adds a picture-based check to a mostly numeric field.
Catalog record
| CREATOR | Tai Le Quy, Long Le Thanh, Lan Luong Thi Hong, Frank Hopfgartner |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-00854
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FACROC: a fairness measure for FAir Clustering through ROC curves Tai Le Quy, Long Le Thanh, Lan Luong Thi Hong, Frank Hopfgartner Abstract Fair clustering has attracted remarkable attention from the research community. Many fairness measures for clustering have been proposed; however, they do not take into account the clustering quality w.r.t. the values of the protected attribute. In this paper, we introduce a new visual-based fairness measure for fair clustering through ROC curves, namely FACROC. This fairness measure employs AUCC as a measure of clustering quality and then computes the difference in the corresponding ROC curves for each value of the protected attribute. Experimental results on several popular datasets for fairness-aware machine learning and well-known (fair) clustering models show that FACROC is a beneficial method for visually evaluating the fairness of clustering models. 1 Introduction Clustering is a fundamental problem in unsupervised learning, and fairness in clustering has garnered significant attention within the machine learning (ML) community, starting with the foundational work of Chierichetti et al. [ 7 ] . Fair clustering techniques aim to ensure equitable representation or treatment of groups or individuals within clusters. Researchers have focused on two main challenging problems in fair clustering: defining and enforcing fairness constraints [ 6 ] . Hence, a number of fairness notions and techniques were introduced to ensure fairness constraints in clustering and can be applied in many domains, such as healthcare [ 4 ] , education [ 13 ] , etc. There are more than 20 fairness notions in fair clustering [ 6 ] . Since fairness notions can be turned into measures, we will use the terms “fairness notion” and “fairness measure” interchangeably. Fairness notions are defined based on the group-level, individual-level, algorithm agnostic, and algorithm specific. At the group-level, the algorithms should not discriminate against or unfairly favor any group of individuals in the predictions. For instance, balance notion [ 7 ] , the most popular fairness notion used for fair clustering, requires a ratio balance between the protected group, e.g., female, and the non-protected group, e.g., male. Unlike group-level fairness, individual-level fairness ensures that similar individuals are treated similarly by the clustering model. The fairness notion of proportionality for centroid clustering [ 5 ] is an example of individual-level fairness. However, to our knowledge, all the defined fairness notions do not consider the clustering quality w.r.t. values of the protected attribute. Regarding the clustering quality, it is determined by several measures, such as the silhouette coefficient, sum of squared error (SSE), Dunn index (DI), and others [ 13 , 15 ] . However, most of these metrics are difficult to visualize for comparison between clustering models. To address this issue, AUCC (Area Under the Curve for Clustering) [ 10 ] has been introduced as a measure of clustering quality. This is a visual-based measure that utilizes the Receiver Operating Characteristics (ROC) analysis of clustering results. In addition, ABROCA, a visual-based fairness measure, has been proposed for the classification problem [ 8 ] . This method evaluates the fairness of classification models through slicing analysis based on the ROC curves. ABROCA measures the absolute value of the area between the ROC curves of the protected and non-protected groups. To this end, we propose a new fairness measure for FAir Clustering through ROC curves (shortly: FACROC) which takes into account the clustering quality on each value of the protected attribute. In particular, we use AUCC to measure the clustering quality and then compute the FACROC by the deviation between the ROC curves corresponding to each value of the protected attribute. Afterward, we perform the experiments on five popular datasets used in fairness-aware ML with three prevalent fair clustering models to evaluate the performance of FACROC versus other popular fairness measures. The rest of our paper is structured as follows: Section 2 overviews the related work. The computation of the FACROC measure is described in Section 3 . Section 4 presents the details of our experiments on various datasets and clustering models. Finally, the conclusion and outlook are summarized in Section 5 . 2 Related work In this work, we focus on two main types of fairness measures for clustering including group-level fairness and individual-level fairness. Regarding group-level, balance is the first group fairness measure introduced by [ 7 ] . Next, the bounded representation measure was proposed with the aim of reducing imbalances in cluster representations of protected attributes [ 1 ] . This measure was generalized with two parameters \alpha and \beta in the study of [ 3 ] . Subsequently, social fairness notion was introduced by [ 9 ] , which aims to provide equitable costs for different clusters. Additionally, diversity-aware fairness was initiated by [ 16 ] which ensures a minimum number of cluster centers in the clustering are selected from each group. Based on the summarization task, the fair summaries measure was used to ensure that the data summary for each group is represented equally [ 12 ] . In contrast to group-level fairness, individual-level fairness notions aim to ensure that similar individuals are treated similarly. For example, Chen et al. [ 5 ] proposed the individual-level fairness notion of proportionality for centroid clustering to guarantee that points are treated equally. An individual-level concept that establishes a fair radius for clusters in center-based clustering objectives was presented by Jung et al. [ 11 ] . Chakrabarti et al. [ 4 ] provided algorithms for the k -center objective and proposed the idea of individual fairness, which guarantees that points receive comparable quality of service. However, unlike other fairness measures for clustering based on the representation of protected attribute values in clusters, we propose a new visual-based fairness measure that takes into account the difference in the clustering performance for each group w.r.t. the protected attribute. 3 FACROC: a fairness measure for fair clustering Given a dataset \mathcal{X}=\{x_{1},\ldots,x_{n}\} with n data points and a clustering \mathcal{C}=\{C_{1},C_{2},...,C_{k}\} with k clusters, the corresponding AUCC value is computed with the following steps [ 10 ] : 1. Compute a similarity matrix of the objects in the original dataset. 2. Acquire two arrays that present the pairwise relationship for each pair of objects: (a) Similarity: get from the similarity matrix. (b) Clustering: 1 if the pair belongs to the same cluster; otherwise, 0. 3. AUCC is obtained from the ROC analysis procedure with two above arrays, in which pairwise clustering memberships correspond to the “true classes” concept in classification. Given a binary protected attribute P=\{p,\bar{p}\} ; e.g., gender={female, male}, we inherit the concept of fairness from the ABROCA fairness measure for classification [ 8 ] : “ equal model performance across subgroups ”. To this end, FACROC is defined as the absolute value of the area between the protected ( ROC_{p} ) and non-protected group ( ROC_{\overline{p}} ) curves across all possible thresholds t\in[0,1] of False Positive Rate (FPR) and True Positive Rate (TPR). The absolute difference between the two curves is measured to capture the case that the curves may cross each other. \int_{0}^{1}\mid ROC_{p}(t)-ROC_{\overline{p}}(t)\mid\,dt. (1) The value range: FACROC\in[0,1] . The lower value indicates a lower difference in the clustering quality between the two groups and, therefore, a fairer model. Fig. 1 visualizes the FACROC slice