From Expectation to Habit: Why Do Software Practitioners Adopt Fairness Toolkits?
Gianmario Voria, Stefano Lambiase, Maria Concetta Schiavone, Gemma Catolino, Fabio Palomba · 2024
Read From Expectation to Habit: Why Do Software Practitioners Adopt Fairness Toolkits? by Gianmario Voria, Stefano Lambiase, Maria Concetta Schiavone, Gemma Catolino, Fabio Palomba (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-13846.txt.
Introduction
Gianmario Voria and co-authors ask why software practitioners adopt fairness toolkits in this 2024 paper. Toolkits that audit machine learning bias exist, but usage lags. The study surveys industry practitioners through a technology acceptance lens. A structural model tests which beliefs drive intention and real use.
Performance expectancy and habit emerged as the main drivers. Practitioners keep using tools that clearly help and that already fit their routine. Social pressure and ease mattered less in the model. Designers should prove concrete benefit fast and seed daily habits. Training and mandates alone will not spread fairness practice. Adoption research turns ethics tooling into a product problem with known levers.
Catalog record
| CREATOR | Gianmario Voria, Stefano Lambiase, Maria Concetta Schiavone, Gemma Catolino, Fabio Palomba |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-13846
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Expectation to Habit: Why Do Software Practitioners Adopt Fairness Toolkits? Gianmario Voria, Stefano Lambiase, Maria Concetta Schiavone, Gemma Catolino, Fabio Palomba Abstract As the adoption of machine learning (ML) systems continues to grow across industries, concerns about fairness and bias in these systems have taken center stage. Fairness toolkits—designed to mitigate bias in ML models—serve as critical tools for addressing these ethical concerns. However, their adoption in the context of software development remains underexplored, especially regarding the cognitive and behavioral factors driving their usage. As a deeper understanding of these factors could be pivotal in refining tool designs and promoting broader adoption, this study investigates the factors influencing the adoption of fairness toolkits from an individual perspective. Guided by the Unified Theory of Acceptance and Use of Technology (UTAUT2), we examined the factors shaping the intention to adopt and actual use of fairness toolkits. Specifically, we employed Partial Least Squares Structural Equation Modeling (PLS-SEM) to analyze data from a survey study involving practitioners in the software industry. Our findings reveal that performance expectancy and habit are the primary drivers of fairness toolkit adoption. These insights suggest that by emphasizing the effectiveness of these tools in mitigating bias and fostering habitual use, organizations can encourage wider adoption. Practical recommendations include improving toolkit usability, integrating bias mitigation processes into routine development workflows, and providing ongoing support to ensure professionals see clear benefits from regular use. I Introduction Machine Learning (ML) has become pervasive, with its adoption accelerating across a wide array of industries and everyday applications [ 1 ] . ML-enabled systems—software systems powered by AI or ML algorithms [ 2 ] —are revolutionizing sectors such as healthcare and entertainment by improving efficiency, optimizing decision-making processes, and driving innovative solutions [ 3 , 4 , 5 , 6 ] . As ML continues to spread, it has also prompted significant ethical concerns, particularly around fairness [ 7 ] , which refers to the principle that models should make impartial decisions, avoiding bias or discrimination against certain groups. Unfairness occurs when models inherit biases present in training data [ 8 , 9 ] , resulting in decisions that undermine trust and pose ethical as well as legal challenges [ 10 ] . This is proven by several known ethical incidents caused by ML applications, e.g., Facebook vision model that put the “primate” label to black men or Amazon assigning lower sales ranking to books containing LGBTQIA+ themes, highlighting the urgent need for fair ML software [ 11 , 12 , 13 , 14 ] . Acknowledging the critical importance of fairness, the software engineering (SE) research community—particularly in the domain of software engineering for artificial intelligence (SE4AI)—has made substantial strides in developing bias mitigation techniques [ 15 ] , recognizing fairness as a crucial non-functional requirement. These approaches can generally be grouped into three main categories: pre-processing , in-processing , and post-processing techniques. In this regard, the research community and organizations have developed instruments to make these solutions available for software practitioners , e.g., Aif360 [ 16 ] or FairLearn [ 17 ] . These tools referred to as fairness toolkits , comprise ready-to-use metrics to measure fairness or bias mitigation techniques [ 18 ] . While fairness toolkits have proven effective in mitigating bias [ 18 , 19 ] , there is still a significant gap in understanding their actual adoption. Specifically, it remains unclear what decision-making heuristics lead practitioners to consider using fairness toolkits in their workflow. We argue that this is an important limitation for two reasons. First, studying the adoption of fairness toolkits may uncover the main drivers that need to be considered or encouraged to further increase the uptake of these tools, as suggested by previous research investigating technology acceptance [ 20 , 21 ] . Second, understanding the considerations that lead to their adoption can offer additional insights into how existing fairness toolkits can be refined and better integrated into practitioners’ workflows [ 22 ] . This may inform recommendations for designing the next generation of fairness toolkits. In summary, a deeper understanding of these heuristics could provide valuable insights for both researchers and toolkits vendors. Recognizing the aforementioned opportunities, our goal is to offer a complementary perspective by investigating the key factors influencing practitioners’ willingness to adopt fairness toolkits. Therefore, this research seeks to address this gap, starting by defining the following guiding research question: Research Question. What factors influence software practitioners in the adoption of fairness toolkits? To address the research question, we conducted a quantitative study grounded in the Unified Theory of Acceptance and Use of Technology (UTAUT2) [ 23 ] . We surveyed expert practitioners and employed Partial Least Squares Structural Equation Modeling (PLS-SEM) for data analysis [ 24 ] . Our results show that software practitioners’ intention to adopt fairness toolkits is mainly driven by their expectancy of the performance of these instruments, i.e., the extent to which they are able to mitigate bias. Moreover, habit emerged as a driver for both the intention to use and the actual adoption of fairness toolkits by practitioners. II Background and Related Works In the following subsections, we summarize the most relevant literature regarding fairness. Machine Learning Fairness. Fairness in decision-making refers to the absence of bias or favoritism based on inherent or acquired characteristics [ 9 , 7 , 25 ] . Various metrics and strategies evaluate fairness in ML, focusing on data similarities, decision probabilities, and cause-effect relationships [ 26 ] . Majumder et al. [ 27 ] categorized fairness metrics into seven groups, although not all nuances are captured. Bias in ML systems can be mitigated using pre-, in-, and post-processing techniques. Pre-processing targets bias in training data, with Sharma et al. [ 28 ] and Calmon et al. [ 29 ] using probabilistic methods, and Chakraborty et al. [ 30 ] introducing Fair-SMOTE . In-processing adjusts the learning algorithm itself; Zhang et al. [ 31 ] used adversarial methods, and Kamishima et al. [ 32 ] applied regularization. Reweighting methods, like those from Kamiran and Calders [ 33 ] and Chakraborty et al. [ 34 ] , adjust instance weights. Post-processing techniques refine model outputs after training, with Galhotra et al. [ 35 ] introducing Themis and Udeshi et al. [ 36 ] developing Aequitas . Software Engineering for ML Fairness. Fairness in ML has gained traction in the SE community, with various studies addressing it from multiple perspectives [ 9 , 7 , 25 , 37 , 15 ] . Ferrara et al. [ 38 ] stressed the importance of context-aware fairness requirements. Additionally, Ferrara et al. [ 39 ] advocated for fairness integration across the development lifecycle. Discrimination often stems from biased training datasets [ 40 ] . Zhang and Harman [ 41 ] argued that increasing dataset features does not inherently reduce discrimination, while Chakraborty et al. [ 30 ] emphasized the role of feature selection. Sesari et al. [ 42 ] highlighted the need to examine fairness across the entire dataset, and Voria et al. [ 43 , 44 ] cataloged fairness-aware practices surveying domain experts. Fairness Toolkits in Practice. Various open-source fairness toolkits help researchers and developers create fairer ML models [ 45 ] .