Visual Model Selection using Feature Importance Clusters in Fairness-Performance Similarity Optimized Space
Sofoklis Kitharidis, Cor J. Veenman, Thomas Bäck, Niki van Stein · 2025
Read Visual Model Selection using Feature Importance Clusters in Fairness-Performance Similarity Optimized Space by Sofoklis Kitharidis, Cor J. Veenman, Thomas Bäck, Niki van Stein (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22209.txt.
Introduction
Sofoklis Kitharidis, Cor J. Veenman, Thomas Bäck, and Niki van Stein help decision-makers choose among fair machine learning models that all strike the fairness-versus-accuracy bargain differently. A portfolio of defensible models is a blessing and a burden: picking one is a values decision, but the differences between models are usually buried in technical detail.
Their interactive framework first learns a distance that treats two models as similar when their fairness and performance outcomes are similar, using weakly supervised metric learning. Feature importance profiles for every model are placed in that reshaped space, then grouped by clustering. Users can browse families of models that behave alike and differ from other families in understandable ways. The goal is a selection process stakeholders can actually follow, with trade-offs made visible instead of averaged away.
Catalog record
| CREATOR | Sofoklis Kitharidis, Cor J. Veenman, Thomas Bäck, Niki van Stein |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-22209
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Visual Model Selection using Feature Importance Clusters in Fairness-Performance Similarity Optimized Space Sofoklis Kitharidis, Cor J. Veenman, Thomas Bäck, Niki van Stein Abstract In the context of algorithmic decision-making, fair machine learning methods often yield multiple models that balance predictive fairness and performance in varying degrees. This diversity introduces a challenge for stakeholders who must select a model that aligns with their specific requirements and values. To address this, we propose an interactive framework that assists in navigating and interpreting the trade-offs across a portfolio of models. Our approach leverages weakly supervised metric learning to learn a Mahalanobis distance that reflects similarity in fairness and performance outcomes, effectively structuring the feature importance space of the models according to stakeholder-relevant criteria. We then apply clustering technique (k-means) to group models based on their transformed representations of feature importances, allowing users to explore clusters of models with similar predictive behaviors and fairness characteristics. This facilitates informed decision-making by helping users understand how models differ not only in their fairness-performance balance but also in the features that drive their predictions. [orcid=0009-0005-8404-0724, [email protected], ] [orcid=0000-0002-2645-1198, [email protected], ] [orcid=0000-0001-6768-1478, [email protected], ] [orcid=0000-0002-0013-7969, [email protected], ] keywords Fair Machine Learning ,Model Selection ,Fairness-Performance Trade-off ,Weakly Supervised Metric Learning ,Clustering ,Feature Importance † † copyrightyear: 2025 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: AEQUITAS 2025: Workshop on Fairness and Bias in AI — co-located with ECAI 2025, Bologna, Italy † † address: Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Einsteinweg 55, 2333 CC Leiden, The Netherlands † † address: Netherlands Organization for Applied Scientific Research (TNO), Anna van Buerenplein 1, 2595 DA The Hague, The Netherlands 1 Introduction Ensuring that machine learning systems not only excel in predictive accuracy but also uphold equitable treatment is crucial, especially in high-stakes domains where decisions can profoundly impact individuals’ lives. Over the past decade, algorithmic fairness has emerged as a critical consideration, aiming to ensure models do not disadvantage protected groups (e.g. by gender or race) Caton and Haas 2020 . Numerous quantitative fairness definitions have been proposed, such as demographic parity, equalized odds, and predictive parity, but these criteria often cannot all be satisfied simultaneously S 2020 . Developers thus face fundamental trade-offs between model fairness and performance: improving a fairness metric usually degrades accuracy or violate another fairness notion. As a result, achieving “fair” machine learning is inherently a multi-objective problem that requires context-dependent value judgments S 2020 . This challenge is intensified by the complexity of real-world data and biases, making fairness an active and complex area of research. Organizations seeking to implement decision-making algorithms frequently encounter significant technical challenges. Bridging fairness research to practice remains difficult, as existing fairness mitigation algorithms, ranging from pre-processing data transformations to in-processing model constraints and post-processing outcome adjustments Caton and Haas 2020 , have not fully translated into user-friendly tools for organizations. Therefore, there is an urgent need for human-centered frameworks to support fair decision-making within applied contexts. Stakeholders such as domain experts, policymakers, or model auditors need to understand the trade-offs involved in selecting one model over another. For instance, different classifiers or hyperparameter settings can yield comparable overall accuracy yet produce significantly varied fairness outcomes Dai et al. 2025 . One model might maximize predictive accuracy while exhibiting higher bias against a minority group, whereas an alternative model may sacrifice a small amount of accuracy for a more equitable distribution of errors. Choosing among these models requires not only technical evaluation but also alignment with broader societal and stakeholder values. However, without dedicated support, it is challenging for decision-makers to fully understand these trade-offs, particularly when multiple fairness metrics and model behaviors must be compared simultaneously. In many cases, decision-makers are presented with a collection of models that embody different fairness–performance trade-offs, rather than a single “best” solution. Systematically exploring and comparing a large set of models is non-trivial since it can be overwhelming to evaluate dozens of models across multiple fairness and performance metrics, particularly when each model may rely on different features in subtle ways. Existing visualization tools, such as Fairlearn’s dashboard Weerts et al. 2023 and IBM AI Fairness 360 Bellamy et al. 2018 , typically focus on individual models or isolated fairness-performance trade-offs, limiting the stakeholders’ capacity to understand the complete landscape of available models simultaneously. In contrast, our framework arranges models in a two-dimensional fairness–performance space and overlays clusters derived from their transformed feature-importance profiles. By grouping models whose decision logic reflects similar feature attributions, we surface archetypes whose behavior aligns with particular domain hypotheses or known causal relationships. Stakeholders can therefore choose not only based on a cluster’s position in the fairness–performance space, but also because its characteristic feature-importance signature resonates with organizational policies or domain expertise. 2 Related Works In this section, we review core algorithmic approaches for enforcing fairness in machine learning, interpretability techniques that shed light on model behavior, and interactive visualization tools that support human‐centered model comparison. Fairness in Machine Learning. Ensuring fairness in predictive models has been the focus of extensive research, yielding various definitions and mitigation strategies Caton and Haas 2020 . Broadly, fairness interventions are categorized as pre-processing (altering training data), in-processing (altering the optimization algorithm), or post-processing (altering model outputs) Caton and Haas 2020 . Our work concerns in-processing techniques that directly build models capable of achieving different fairness-performance trade-offs. One line of research adds fairness constraints or objectives into model training. For example, Agarwal et al. (2018) Agarwal et al. 2018 formulate fairness-constrained classification as a series of cost-sensitive learning tasks, finding a model with minimal error subject to a fairness constraint. This reductions-based approach can enforce criteria like demographic parity or equalized odds by adjusting weights on training examples, and it has become a general blueprint implemented in toolkits (e.g. Microsoft’s Fairlearn library implements this strategy Weerts et al. 2023 ). Another approach is to design custom learning algorithms that inherently balance accuracy and fairness. Barata et al. (2021) Barata et al. 2021 introduce a splitting criterion for decision trees that combines ROC AUC with a fairness measure (strong demographic parity) during each split. By optimizing a trade-off of fairness and performance at training time, it produces decision trees that are interpretable and explicitly designed to achieve specific fairness-performance trade-offs. Barata et al. 2021 . In practice, data scientists must often adjust a hyperparameter (such as the fairness penalty strength or a target constraint value) to get a model that achieves an acceptable balance. This tuning yields multiple candidate models along a continuum from highest accuracy to highest fairness, rather than a single optimal solution. Interpretability and Fairness Analysis. Common post-hoc interpretability techniques include feature importance measures and instance-level explanations. SHAP values Lundberg and Lee 2017 have become a popular choice for explaining complex models because they provide consistent and theoretically grounded attributions for each feature’s influence on a prediction. Specifically, SHAP uses cooperative game theory to calculate the marginal contributions of each feature by considering all possible subsets of features. In the context of fairness, SHAP and related methods have been used to diagnose which features might be contributing to bias. For