Fair Model-Based Clustering

Jinwon Park, Kunwoong Kim, Jihu Lee, Yongdai Kim · 2026

Read Fair Model-Based Clustering by Jinwon Park, Kunwoong Kim, Jihu Lee, Yongdai Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-21509.txt.

Introduction

Jinwon Park and three co-authors propose Fair Model-based Clustering, a fair clustering algorithm built on a finite mixture model. Fair clustering seeks clusters whose sensitive-attribute shares, such as gender or race, resemble those of the whole dataset. Existing fair methods often modify K-means to satisfy a fairness constraint.

A critical limit of several existing methods is parameter count: because each datum's cluster assignment must be optimized alongside cluster centers, learnable parameters grow with sample size, blocking scale-up. The new method breaks that link. Its parameter count stays independent of sample size, so mini-batch learning can yield approximately fair clusters at scale. It also handles non-metric data like categorical data whenever the likelihood is well-defined. Theory and experiments support its superiority.

Catalog record

CREATORJinwon Park, Kunwoong Kim, Jihu Lee, Yongdai Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-21509

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fair Model-Based Clustering Jinwon Park, Kunwoong Kim, Jihu Lee, Yongdai Kim Abstract The goal of fair clustering is to find clusters such that the proportion of sensitive attributes (e.g., gender, race, etc.) in each cluster is similar to that of the entire dataset. Various fair clustering algorithms have been proposed that modify standard K-means clustering to satisfy a given fairness constraint. A critical limitation of several existing fair clustering algorithms is that the number of parameters to be learned is proportional to the sample size because the cluster assignment of each datum should be optimized simultaneously with the cluster center, and thus scaling up the algorithms is difficult. In this paper, we propose a new fair clustering algorithm based on a finite mixture model, called Fair Model-based Clustering (FMC). A main advantage of FMC is that the number of learnable parameters is independent of the sample size and thus can be scaled up easily. In particular, mini-batch learning is possible to obtain clusters that are approximately fair. Moreover, FMC can be applied to non-metric data (e.g., categorical data) as long as the likelihood is well-defined. Theoretical and empirical justifications for the superiority of the proposed algorithm are provided. Introduction Artificial intelligence (AI) systems have been increasingly deployed as decision support tools in socially sensitive domains such as credit scoring, criminal risk assessment, and college admissions. AI models trained on real-world data may inherently encode biases present in the training data. As a result, these models can exhibit discriminatory behavior or amplify historical biases ( 17 ; 4 ; 11 ; 25 ; 30 ; 56 ) . Numerous studies have shown that, in the presence of such unfairness, these systems tend to favor majority groups, such as white men, while disadvantaging minority groups, such as black women. This can lead to unfair treatment of socially sensitive groups ( 15 ; 2 ) . These findings underscore the need for fairness-aware learning algorithms to mitigate bias in automated decision-making systems. Given these circumstances, it is crucial to prioritize fairness in automated decision-making systems to ensure that their development is aligned with the principles of social responsibility. Consequently, a variety of algorithmic approaches have been introduced to reduce bias by promoting equitable treatment of individuals across demographic groups. For instance, one common approach enforces fairness by requiring that the rates of favorable outcomes be approximately the same across groups defined by sensitive attributes such as race or gender ( 9 ; 19 ; 51 ; 54 ; 1 ; 14 ; 52 ; 48 ; 37 ) . In parallel with advances in supervised learning, the study of algorithmic fairness in unsupervised learning, especially clustering, has garnered increasing attention. Clustering methods have long been used for various machine learning applications, including time series analysis ( 28 ; 36 ) , audio and language modeling ( 7 ; 13 ; 8 ; 55 ) , recommendation systems ( 34 ; 44 ) , and image clustering ( 27 ; 20 ; 32 ) . Fair clustering ( 10 ) aims to ensure that the proportion of each protected group within every cluster is similar to that of the overall population. To this end, a variety of algorithms have been proposed to minimize a given clustering objective (e.g., K -means clustering cost) while satisfying predefined fairness constraints ( 5 ; 3 ; 29 ; 16 ; 57 ; 53 ) . Most fair clustering algorithms are based on the K -means (center) algorithm which searches for good cluster centers and a good assignment map (mapping each instance to one of the given cluster centers) under fairness constraints. A critical limitation of such existing fair clustering algorithms is that the fairness of a given assignment map depends on the entire training data and thus learning the optimal fair assignment map is computationally demanding. In fact, the assignment of each data point must be learned along with the cluster centers under a fairness constraint, so the number of learnable parameters is proportional to the sample size. Moreover, a mini-batch learning algorithm, a typical tool to scale-up a given learning algorithm, would not be possible since the fairness of a given assignment map cannot be evaluated on a mini-batch. Another limitation of existing fair clustering algorithms is that they are based on the K -means algorithm, which requires data to lie in a metric space, thus making it difficult to process non-metric data such as categorical data. The aim of this study is to develop a new fair clustering algorithm that resolves the aforementioned limitations. The proposed algorithm is based on model-based clustering, and we estimate the parameters under a fairness constraint. Note that the existing methods are geometric and distance metric-based, yielding deterministic assignments, whereas model-based fair clustering assumes a probabilistic model for the data and uses likelihood-based estimation, providing probabilistic assignments. An important advantage of the proposed fair clustering algorithm is that the number of learnable parameters is independent of the size of training data and thus can be applied to large-scale datasets easily. Moreover, the development of a mini-batch algorithm to provide approximately fair clusters is possible with theoretical guarantees. In addition, non-metric data can be processed without much difficulty as long as the likelihood can be well-specified. The main contributions of this paper are summarized as follows. • We propose a novel fair clustering algorithm based on a probabilistic model that facilitates scalable mini-batch learning and dynamically recalculates fair assignments for large test datasets. • Unlike most existing fair clustering methods, our proposed algorithms are built upon a probabilistic mixture model and naturally extend to categorical data. • We establish a theoretical guarantee that the proposed model generalizes well to unseen data, and validate it through comprehensive empirical evaluations. Review of Existing Fair Clustering Algorithms There are three categories of existing methods for fair clustering. (1) Pre-processing methods ( 10 ; 3 ) use the concept of fairlets-small subsets of the data satisfying fairness-and then perform clustering on the space of fairlets. (2) In-processing methods ( 26 ; 29 ; 57 ; 53 ; 24 ) optimize both the assignments and cluster centers to find a good clustering among those satisfying a given fairness level. (3) Post-processing methods ( 5 ; 21 ) only build fair assignments for fixed cluster centers. Here, we briefly review in-processing methods to explain the limitations of existing fair clustering algorithms. Let \mathcal{D}=\{x_{1},\dots,x_{N}\} be the given training data to be clustered, and let s_{1},\ldots,s_{N} be sensitive attributes corresponding to x_{1},\ldots,x_{N}, where s_{i}\in[M] for all i\in[N]. Here, M is the number of sensitive groups. Let \mathcal{D}^{(s)}=\{x_{i}\in\mathcal{D}:s_{i}=s\} for s\in[M]. We first focus on the case M=2 for the following discussion, and propose a way of extending the algorithm in the Modification of FMC to multinary sensitive attributes section. A typical clustering algorithm (without a fairness constraint) receives \mathcal{D} and the number of clusters K as inputs and yields the cluster centers \mu_{k},k\in[K] , and the assignment map \mathcal{A}:\mathcal{D}\rightarrow[K] such that \mathcal{A}(x_{i}) is the cluster to which x_{i} belongs. The algorithm searches \{\mu_{k},\,k\in[K]\} and \mathcal{A} that minimizes the clustering cost L(\mathcal{D};K):=\sum_{i=1}^{N}\rho(x_{i},\mu_{\mathcal{A}(x_{i})}) for a given metric \rho. A fair clustering algorithm receives \mathcal{D}^{(s)} , s\in[2] and K as inputs and searches \mu_{k},\,k\in[K]

Read the complete text