Data Preparation for Fairness-Performance Trade-Offs: A Practitioner-Friendly Alternative?

Gianmario Voria, Rebecca Di Matteo, Giammaria Giordano, Gemma Catolino, Fabio Palomba · 2024

Read Data Preparation for Fairness-Performance Trade-Offs: A Practitioner-Friendly Alternative? by Gianmario Voria, Rebecca Di Matteo, Giammaria Giordano, Gemma Catolino, Fabio Palomba (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-15920.txt.

Introduction

Gianmario Voria and co-authors propose a study in 2024 on fair data preparation for machine learning. Bias often enters through the data itself, long before a model trains. Fixes applied before training can work but may hurt performance and resist integration.

As a registered report, the paper lays out a planned test rather than final results. Their tool, FATE, will select preparation pipelines that jointly lift fairness and performance. The plan compares those pipelines against standard pre-training bias fixes. The authors argue everyday preparation steps are familiar to practitioners and easier to adopt. The study aims to show whether that friendly route can beat heavier methods.

Catalog record

CREATORGianmario Voria, Rebecca Di Matteo, Giammaria Giordano, Gemma Catolino, Fabio Palomba
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-15920

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Data Preparation for Fairness-Performance Trade-Offs: A Practitioner-Friendly Alternative? Gianmario Voria, Rebecca Di Matteo, Giammaria Giordano, Gemma Catolino, Fabio Palomba Abstract Context. As machine learning (ML) systems are increasingly adopted across industries, addressing fairness and bias has become essential. While many solutions focus on ethical challenges in ML, recent studies highlight that data itself is a major source of bias. Pre-processing techniques, which mitigate bias before training, are effective but may impact model performance and pose integration difficulties. In contrast, fairness-aware ‘Data Preparation’ practices are both familiar to practitioners and easier to implement, providing a more accessible approach to reducing bias. Objective. This registered report proposes an empirical evaluation of how optimally selected fairness-aware practices, applied in early ML lifecycle stages, can enhance both fairness and performance, potentially outperforming standard pre-processing bias mitigation methods. Method. To this end, we will introduce FATE , an optimization technique for selecting ‘Data Preparation’ pipelines that optimize fairness and performance. Using FATE , we will analyze the fairness-performance trade-off, comparing pipelines selected by FATE with results by pre-processing bias mitigation techniques. I Introduction The rapid adoption of machine learning (ML) has raised ethical concerns around fairness [ 1 ] —the principle that models should make impartial decisions without introducing biases for or against specific groups. Unfairness arises when models replicate biases from training data [ 2 , 3 ] , leading to decisions that create ethical and legal risks [ 4 ] . To address fairness, the software engineering (SE) research community—especially within software engineering for artificial intelligence (SE4AI)—has advanced bias mitigation techniques [ 5 ] . These approaches generally fall into three categories: pre-processing , in-processing , and post-processing techniques. Pre-processing methods, like FairSMOTE [ 6 ] , work to mitigate bias by rebalancing sensitive groups within the dataset prior to training. In-processing techniques adjust the learning algorithm itself to minimize bias, such as fairness-aware training methods [ 7 ] . Post-processing techniques aim to improve fairness by adjusting model outputs, for example, through fairness testing [ 8 ] . A key focus in fairness research is the recognition that bias in ML systems often stems from imbalanced datasets, making early-stage interventions in the ‘Data Preparation’ phase, i.e., the ML engineering stage in which raw data gets processed into a clean, structured, and optimized format suitable for efficient model training [ 9 ] , critical for achieving fair outcomes [ 10 , 11 ] . While specialized data pre-processing techniques [ 6 , 12 , 13 ] , i.e., specific techniques and algorithms designed to reduce ML models’ bias operating on the dataset before model training, have shown effectiveness in mitigating bias, they also come with considerable costs. These costs include both the additional computation demands they place on model development and the extra effort required for practitioners to apply them as they diverge from standard workflows [ 14 , 15 ] . In contrast, recent research highlighted the potential efficacy in mitigating bias of common ‘Data Preparation’ practices, i.e., ML engineering techniques used to increase models’ efficacy and that operate before model training [ 16 ] . Examples of these practices are data scaling, resampling, or normalization [ 16 ] , and they differ from specialized bias mitigation pre-processing techniques because they are not explicitly built to mitigate bias. These techniques, named fairness-aware practices , are lightweight, often familiar to practitioners, and seamlessly integrated into ML workflows, making them inherently more accessible and practical to implement [ 17 ] . In addition, they differ from general pre-processing strategies because they are tailored to specific goals or domain requirements. Previous literature suggests that fairness-aware practices are not only more practical but also often preferred by practitioners over specialized bias mitigation methods for addressing fairness issues. For instance, Voria et al. [ 16 ] documented that fairness-aware practices primarily cluster around the ‘Data Preparation’ phase. At the same time, a survey of expert ML practitioners confirmed that these practices positively influence fairness and are frequently used to modify datasets relative to protected attributes [ 17 ] . Additionally, these practices appear to offer a distinct advantage in managing the fairness-performance trade-off, as they can enhance both fairness and model performance without the potential performance costs sometimes associated with bias mitigation techniques [ 18 ] . These insights lead us to hypothesize that there may be a practical advantage in using data preparation practices for fairness, which practitioners are already familiar with and regularly employ. Accordingly, this study aims to empirically examine this potential advantage by investigating whether and to what extent standard data preparation practices can effectively mitigate bias. Our confirmatory study will also assess how these approaches compare against specialized bias mitigation algorithms, providing insights into their relative efficacy on the fairness-performance trade-off. Working Hypothesis. Based on the considerations that (1) specific pre-processing bias mitigation techniques are harder to apply than common fairness-aware practices, (2) fairness-aware practices at the ‘Data Preparation’ stage are known to have a positive impact on fairness and are also used to improve models’ efficacy, and (3) practitioners already actively employ fairness-aware practices in their ML pipelines, our research hypothesis is that a near-optimal selection of fairness-aware practices during the ‘Data Preparation’ stage has a high positive impact on fairness and performance in practice and can be beneficial for practitioners to easily mitigate ML bias. Building on this hypothesis, the objective of this registered report is to outline a confirmatory study that will empirically assess how a near-optimal selection of fairness-aware practices in earlier ML lifecycle stages can contribute to fair and efficient ML models. As pre-processing techniques represent state-of-the-art bias mitigation at these stages, our hypotheses will be structured around a comparison of near-optimal ‘Data Preparation’ pipelines against such solutions in terms of fairness and performance gains. Our contributions are threefold. First, we will develop an optimization technique, FATE , which selects ‘Data Preparation’ pipelines to optimize both fairness and performance. Second, we will assess how FATE supports balancing the fairness-performance trade-off in model building. Lastly, we will compare the impact of FATE -selected pipelines with widely used pre-processing bias mitigation techniques. II Background & Related Work ML fairness, i.e., the absence of prejudice toward a protected group by an automated decision maker [ 1 ] , has emerged as a pivotal research domain within the Software Engineering community, with an expanding body of literature examining the topic from various perspectives [ 3 , 19 , 20 , 5 ] . This concern is highlighted by several known ethical incidents involving ML applications [ 21 , 22 ] , underscoring the urgent need for fair ML practices. Researchers have explored fairness through empirical studies, proposing bias mitigation strategies at different stages of the ML pipeline, named pre-, in-, and post-processing techniques. Pre-processing methods tackle bias in the training data. For example, Chakraborty et al. [ 6 ] introduced Fair-SMOTE , a synthetic augmentation technique that preserves model performance. Reweighting methods, like those by Kamiran and Calders [ 12 ] , adjust instance weights to improve fairness. In-processing techniques modify the learning algorithm itself to mitigate bias during training. Zhang et al. [ 23 ] used an adversarial approach, while Chakraborty et al. [ 24 ] emphasized balancing fairness and

Read the complete text