Diversity Drives Fairness: Ensemble of Higher Order Mutants for Intersectional Fairness of Machine Learning Software
Zhenpeng Chen 1 , Xinyue Li 2 , Jie M. Zhang 3 , Federica Sarro 4 , Yang Liu 1 5 · 2024
Read Diversity Drives Fairness: Ensemble of Higher Order Mutants for Intersectional Fairness of Machine Learning Software by Zhenpeng Chen 1 , Xinyue Li 2 , Jie M. Zhang 3 , Federica Sarro 4 , Yang Liu 1 5 (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08167.txt.
Introduction
Zhenpeng Chen, Xinyue Li, and colleagues improve fairness for people who sit at the overlap of several protected groups in a 2024 software fairness study. A hiring model can look fair for each single attribute while failing badly for a specific combination, the intersectional gap. Their ensemble mutates inputs at higher orders, changing several attributes at once to probe those combined subgroups during inference.
Diversity among the mutant ensemble members drives the gains, the authors argue. Checking fairness only one attribute at a time is no longer enough for deployed systems, and inference-time fixes avoid retraining models that owners cannot touch.
Catalog record
| CREATOR | Zhenpeng Chen 1 , Xinyue Li 2 , Jie M. Zhang 3 , Federica Sarro 4 , Yang Liu 1 5 |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-08167
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Diversity Drives Fairness: Ensemble of Higher Order Mutants for Intersectional Fairness of Machine Learning Software Thanks: Corresponding author: Jie M. Zhang ([email protected]). Zhenpeng Chen 1 , Xinyue Li 2 , Jie M. Zhang 3 , Federica Sarro 4 , Yang Liu 1 5 Abstract Intersectional fairness is a critical requirement for Machine Learning (ML) software, demanding fairness across subgroups defined by multiple protected attributes. This paper introduces FairHOME, a novel ensemble approach using higher order mutation of inputs to enhance intersectional fairness of ML software during the inference phase. Inspired by social science theories highlighting the benefits of diversity, FairHOME generates mutants representing diverse subgroups for each input instance, thus broadening the array of perspectives to foster a fairer decision-making process. Unlike conventional ensemble methods that combine predictions made by different models, FairHOME combines predictions for the original input and its mutants, all generated by the same ML model, to reach a final decision. Notably, FairHOME is even applicable to deployed ML software as it bypasses the need for training new models. We extensively evaluate FairHOME against seven state-of-the-art fairness improvement methods across 24 decision-making tasks using widely adopted metrics. FairHOME consistently outperforms existing methods across all metrics considered. On average, it enhances intersectional fairness by 47.5%, surpassing the currently best-performing method by 9.6 percentage points. I Introduction Machine Learning (ML) software plays a critical role in high-stakes human-related decisions, such as hiring [ 1 ] , criminal sentencing [ 2 ] , and loan application [ 3 ] . In this context, fairness of ML software holds increasing significance, as biases in these systems can perpetuate inequalities and harm historically marginalized groups [ 4 , 5 ] . Unfair ML software can lead to ethical, reputational, financial harm, and legal consequences if it violates anti-discrimination laws [ 6 , 5 ] . Indeed, fairness has long been acknowledged as a foundational requirement for ML software [ 7 , 8 , 9 , 10 , 11 , 12 , 13 ] , aiming at mitigating bias and discrimination tied to protected attributes such as sex, race, and age. From the Software Engineering (SE) perspective, unfairness in ML software can be considered as software ‘fairness bugs’ [ 14 ] . This has led to a growing body of SE studies aimed at improving ML software fairness (also referred to as bias mitigation) [ 15 , 16 , 17 , 4 , 18 , 19 , 20 , 21 ] . Software users inherently belong to multiple intersecting identity groups defined by various protected attributes. These intersections yield varied experiences of discrimination among different subgroups. For instance, black women might encounter biases stemming from both sexism and racism. This emphasizes the importance of ‘intersectional fairness’, which measures fairness among subgroups formed by the combination of multiple protected attributes [ 22 ] . Notably, intersectional fairness has been encoded in legal regulations [ 23 ] and thus highlights the compelling need for software researchers and engineers to consider multiple protected attributes simultaneously [ 22 ] . Compared to fairness concerning individual protected attributes, which oversimplifies the complex realities faced by software users, intersectional fairness is considered a more challenging task [ 24 ] . Recent SE studies have introduced advanced bias mitigation methods capable of dealing with multiple protected attributes and improving intersectional fairness. Notable examples include FairSMOTE [ 15 ] , which pre-processes training data to mitigate bias across protected attributes and then trains a fairer model; MAAT [ 4 ] , which trains distinct models to optimize fairness for each protected attribute individually and then combines them; and FairMask [ 16 ] , which trains individual extrapolation models based on training data to modify protected attributes in inputs for fairer outcomes. In this paper, we introduce FairHOME, a novel ensemble approach using higher order mutation of inputs to improve intersectional fairness of ML software during the inference phase. In the social science domain, it is widely acknowledged that increasing diversity can foster fairness in decision-making [ 25 , 26 , 27 ] . Drawing inspiration from this, FairHOME generates diverse mutated inputs from various subgroups for each given input by applying higher order mutation across multiple protected attributes, thereby enriching the decision-making process with diverse perspectives. This approach is particularly effective in addressing intersectional fairness, which inherently involves numerous subgroups, thus ensuring diversity within the generated input set. Then FairHOME combines the predictions generated by the ML software for the original input and its mutants to reach the final decision. Unlike conventional ensemble methods [ 28 ] , including state-of-the-art ones in fairness research [ 4 , 21 ] , that combine predictions from different models, FairHOME combines predictions generated by the same ML model. This unique characteristic enables FairHOME to bypass the need for creating new models, rendering it even applicable to already deployed ML software. To evaluate FairHOME, we conduct a large-scale empirical study, which compares it with seven bias mitigation methods across 24 decision-making tasks using six intersectional fairness metrics. Additionally, given that bias mitigation often decreases ML performance (e.g., accuracy) [ 6 ] , we comprehensively evaluate the fairness-performance trade-off achieved by FairHOME using an advanced benchmarking tool [ 29 ] with 30 fairness-performance measurements. The evaluation results demonstrate the effectiveness of FairHOME in improving intersectional fairness, showcasing its ability to consistently outperform all methods across each metric considered. On average across all metrics, FairHOME improves intersectional fairness by 47.5%, marking a 9.6 percentage point improvement over the currently best-performing method. Additionally, FairHOME achieves this notable fairness improvement with only minimal reductions in ML performance, ranging from 0.1% to 2.7% depending on the metric considered. Evaluation using the advanced benchmarking tool [ 29 ] reveals that FairHOME surpasses all existing methods in fairness-performance trade-off. To summarize, this work offers the following contributions: • Introduction of FairHOME : A novel ensemble approach using higher order mutation of inputs to significantly enhance intersectional fairness in ML software. • Large-scale empirical study : An extensive evaluation of FairHOME against 7 state-of-the-art techniques across 24 decision-making tasks, employing 6 intersectional fairness metrics and 30 fairness-performance measurements. • Open resources : Public access to all our data and code [ 30 ] to encourage replication and facilitate further research. II Preliminaries II-A Fairness in ML Software This paper focuses on fairness of ML classification, the most extensively studied topic in software fairness research [ 14 , 31 ] . In this context, ML software assigns input instances with favorable or unfavorable labels. Central to discussions of fairness is the concept of protected attributes , which are sensitive characteristics such as sex, race, age, religion, and disability status. The population is divided into groups based on these protected attributes, commonly known as privileged and unprivileged groups. Privileged groups historically enjoy certain advantages, while unprivileged groups face disadvantages or discrimination. In practice, ML software frequently exhibits bias by more often assigning favorable outcomes to members of privileged groups and unfavorable outcomes to those in unprivileged groups [ 4 ] . This predicament has spurred researchers to advocate for the principle of group fairness. This principle aims to ensure that decisions made by ML software do not unfairly benefit or harm any specific population group.