A Generalised Exponentiated Gradient Approach to Enhance Fairness in Binary and Multi-class Classification Tasks
Maryam Boubekraoui, Giordano d’Aloisio, Antinisca Di Marco · 2026
Read A Generalised Exponentiated Gradient Approach to Enhance Fairness in Binary and Multi-class Classification Tasks by Maryam Boubekraoui, Giordano d’Aloisio, Antinisca Di Marco (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21393.txt.
Introduction
Boubekraoui and co-authors tackle fairness in classification, where models can treat groups unequally. Fairness methods are well studied for binary tasks but less so for multi-class ones. They frame fair learning as a trade-off between prediction correctness and several fairness constraints. Their Generalised Exponentiated Gradient algorithm works during training for both settings. They test it against six baselines on seven multi-class and three binary datasets, using four effectiveness metrics and three fairness definitions.
Catalog record
| CREATOR | Maryam Boubekraoui, Giordano d’Aloisio, Antinisca Di Marco |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45632 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.21393
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Generalised Exponentiated Gradient Approach to Enhance Fairness in Binary and Multi-class Classification Tasks Maryam Boubekraoui, Giordano d’Aloisio, Antinisca Di Marco Abstract The widespread use of AI and ML models in sensitive areas raises significant concerns about fairness. While the research community has introduced various methods for bias mitigation in binary classification tasks, the issue remains under-explored in multi-class classification settings. To address this limitation, in this paper, we first formulate the problem of fair learning in multi-class classification as a multi-objective problem between effectiveness (i.e., prediction correctness) and multiple linear fairness constraints. Next, we propose a Generalised Exponentiated Gradient (GEG) algorithm to solve this task. GEG is an in-processing algorithm that enhances fairness in binary and multi-class classification settings under multiple fairness definitions. We conduct an extensive empirical evaluation of GEG against six baselines across seven multi-class and three binary datasets, using four widely adopted effectiveness metrics and three fairness definitions. GEG overcomes existing baselines, with fairness improvements up to 92% and a decrease in accuracy up to 14%. 1 Introduction With the increasing adoption of AI- and ML-based software systems in sensitive domains such as healthcare [ 11 ] , finance [ 40 ] , and education [ 4 ] , it is critical to ensure that they act in an unbiased and ethical way. In other words, they must be fair . The relevance of software fairness has been highlighted in recent years not only in research literature [ 44 , 12 , 14 ] , but also in regulations such as the European Union’s recently introduced AI Act [ 25 ] . Fairness is defined as: “The absence of prejudice and favouritism of a software system toward individuals or groups" [ 44 ] . When a system behaves unfairly, it is said to be biased . When not properly addressed, software bias may cause severe consequences and discrimination, like for the recruitment instrument employed by Amazon, which penalised women candidates for IT job positions, 1 1 1 https://www.bbc.co.uk/news/technology-45809919 or the criminal recidivism predictions made by the commercial risk assessment software COMPAS, which misjudged black individuals based on biased profiling [ 2 ] . Bias can originate from three main sources [ 44 ] : the data used to train the AI and ML components, a biased implementation of the AI and ML components, and the people that interact with those components. In this paper, we focus on mitigating bias in an ML model trained on biased data (i.e., data bias). More specifically, this work focuses on the classification task using structured, tabular data. The research community has proposed several methods for bias mitigation at different processing levels [ 44 , 12 ] . However, the majority of them can be applied only to binary classification tasks. Instead, several examples of multi-class classification approaches have been applied in sensitive domains such as education [ 5 , 60 ] , food [ 55 , 43 ] , and health [ 62 ] . Ensuring that these systems behave in a fair and unbiased way is paramount, also to achieve some of the United Nations Sustainable Development Goals, (SDG) 2 2 2 https://sdgs.un.org/goals e.g., SDG 2 (zero hunger) [ 55 , 43 ] , SDG 3 (good health and well-being) [ 62 ] , and SDG 4 (quality education) [ 5 , 60 ] . 1.1 Research Objectives To address the lack of bias mitigation for multi-class classification, in this paper, we first formulate the problem of fairness in multi-class classification as a multi-objective problem between effectiveness (i.e., prediction correctness) and multiple fairness definitions. Next, we propose a Generalised Exponentiated Gradient (GEG) algorithm to solve this optimisation problem. GEG is an extension of the original Exponentiated Gradient (EG) bias mitigation algorithm first proposed by Agarwal et al. for binary classification [ 1 ] . However, GEG differs from the original EG approach in two aspects: first, it can mitigate bias in both binary and multi-class classification tasks; second, it mitigates bias across multiple fairness constraints simultaneously. These capabilities make GEG more flexible and practical for multiple use cases . We perform an extensive evaluation of GEG, benchmarking it against six approaches across seven multi-class and three binary datasets, using four widely adopted effectiveness metrics and three fairness definitions. Results show that GEG is an efficient approach for bias mitigation in multi-class classification, achieving fairness improvement up to 92%, overcoming existing baselines. Additionally, from our empirical evaluation, we draw practical tips on employing GEG in real-case scenarios. 1.2 Main Contributions The main contributions of our work are the following: • We formulate the problem of fairness in multi-class classification as a multi-objective problem between multiple fairness definitions and prediction effectiveness. • We propose a Generalised Exponentiated Gradient (GEG) approach to mitigate bias in binary and multi-class classification tasks under multiple fairness definitions simultaneously. • We perform an extensive empirical evaluation of GEG against multiple baselines, datasets, and metrics. • We draw a set of practical insights on adopting GEG in real-case scenarios. • We release a replication package including a Python implementation of GEG and the results of our empirical evaluation to foster future research. 3 3 3 https://github.com/giordanoDaloisio/GEG 1.3 Roadmap The rest of this paper is structured as follows: Section 2 provides background knowledge on fairness and discusses related work. Section 3 presents the fairness learning in multi-class classification as a multi-objective optimisation problem and describes the GEG approach. Section 4 describes the empirical evaluation performed, while Section 5 discusses the obtained results and provides practical insights. Finally, Section 7 discusses future work and concludes the study. 2 Background and Related Work . 2.1 Background Knowledge on Bias Assessment and Mitigation In general, the fairness of an ML model can be assessed following two main criteria: individual and group fairness [ 54 ] . Individual fairness requires that two individuals who are similar to one another receive the same treatment (i.e., an ML model should make identical predictions). Most of the time, two individuals are treated as similar if they only differ in sensitive attributes 4 4 4 In the rest of this paper, we will use the terms ”sensitive attributes”, ”protected attributes” or ”sensitive features” as synonyms. (e.g., ethnicity , gender , age ). Group fairness, on the other hand, addresses fairness by treating population groups, defined by protected attributes (like ethnicity , gender , or age ), equally. In this work, we focus on group fairness criteria, as they are more common and have been more extensively addressed in previous work [ 34 , 22 ] . Specifically, many group fairness definitions and corresponding metrics have been proposed in the literature [ 44 , 12 ] . The general idea behind all group fairness definitions is that, given two groups named privileged and unprivileged (e.g., men and women ), they must have the same probability of having a given positive outcome from the ML model, possibly conditioned on the ground truth label [ 44 ] . In Sections 3 and 4 , we provide the formal specification of the fairness definitions we address in this paper. In addition to measuring bias, research has proposed several methods for mitigating bias at different processing levels [ 34 , 44