Software Fairness Testing in Practice

Ronnie de Souza Santos, Matheus de Morais Leça, Reydne Santos, Cleyton Magalhaes · 2025

Read Software Fairness Testing in Practice by Ronnie de Souza Santos, Matheus de Morais Leça, Reydne Santos, Cleyton Magalhaes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-17095.txt.

Introduction

Ronnie de Souza Santos and co-authors ask in a 2025 study how fairness tests for software fare in real work. Smart systems can treat groups unfairly, and test methods exist to catch that skew. Yet firms use them far less than school research would suggest.

The team asked working testers and builders how they test for fairness, what tools they reach for, and what blocks them. A lack of clear steps and fit tools came up again and again. The study grounds a hot topic in shop-floor fact. Tool makers and team leads gain a list of gaps to close if fairness tests are to spread.

Catalog record

CREATORRonnie de Souza Santos, Matheus de Morais Leça, Reydne Santos, Cleyton Magalhaes
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-17095

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Software Fairness Testing in Practice Ronnie de Souza Santos, Matheus de Morais Leça, Reydne Santos, Cleyton Magalhaes Abstract Software testing ensures that a system functions correctly, meets specified requirements, and maintains high quality. As artificial intelligence and machine learning (ML) technologies become integral to software systems, testing has evolved to address their unique complexities. A critical advancement in this space is fairness testing, which identifies and mitigates biases in AI applications to promote ethical and equitable outcomes. Despite extensive academic research on fairness testing—including test input generation, test oracle identification, and component testing—practical adoption remains limited. Industry practitioners often lack clear guidelines and effective tools to integrate fairness testing into real-world AI development. This study investigates how software professionals test AI-powered systems for fairness through interviews with 22 practitioners working on AI and ML projects. Our findings highlight a significant gap between theoretical fairness concepts and industry practice. While fairness definitions continue to evolve, they remain difficult for practitioners to interpret and apply. The absence of industry-aligned fairness testing tools further complicates adoption, necessitating research into practical, accessible solutions. Key challenges include data quality and diversity, time constraints, defining effective metrics, and ensuring model interoperability. These insights emphasize the need to bridge academic advancements with actionable strategies and tools, enabling practitioners to systematically address fairness in AI systems. I Introduction Software testing has changed significantly over the past decades, always evolving to support new challenges and technological advancements [ 1 , 2 ] . Initially, testing was indistinguishable from debugging, relying on ad hoc methods to fix defects. By the 1950s-1970s, testing became a distinct practice focused on verifying correctness while debugging addressed failures. The 1970s-1980s saw a shift toward error detection, followed by the 1980s-1990s, when formal standards emphasized early defect prevention. In the post-1990s era, methodologies like Test-Driven Development embedded testing into the software lifecycle [ 1 , 3 ] . Today, with the rise of machine learning and AI, testing has further evolved to address the non-deterministic nature of AI systems [ 4 , 5 ] . In the current landscape of software engineering, fairness testing has emerged as a crucial component of quality assurance, addressing the ethical challenges posed by AI-driven systems. These systems, capable of performing complex tasks such as recommendation, object detection, classification, and prediction, require advanced validation techniques to ensure their reliability and fairness [ 6 , 7 ] . Unlike traditional software, AI models continuously adapt to data, making them susceptible to biases introduced through training data, algorithmic design, or societal inequalities [ 8 ] . Fairness testing, then, aims to systematically evaluate the ethical implications and potential biases embedded within AI systems, ensuring that decision-making processes lead to equitable outcomes across diverse demographic groups. By identifying and mitigating discriminatory risks based on factors such as race, gender, or socioeconomic status, fairness testing plays a key role in ensuring ethical AI development and promoting fairness in automated decision-making [ 9 , 10 ] . While extensive research has been conducted on fairness testing, focusing on areas such as test input generation, test oracle identification, and the testing of various components—including data testing, machine learning program testing, and model testing [ 11 ] —much of this work remains confined to academic settings, offering limited practical guidance for industry professionals. This gap leaves practitioners struggling to effectively implement fairness testing and manage fairness-related challenges in real-world AI systems. For example, there is a growing demand for fairness testing tools that align more closely with industry needs, particularly in terms of usability, comprehensive coverage, and configurability, ensuring they can be seamlessly integrated into existing development workflows [ 12 ] . Therefore, considering that fairness testing is a relatively new aspect of software development practice, and that theories and academic findings often take time to be adopted by industry, this paper investigates how software professionals are testing AI-powered systems and what strategies they use to verify biases in the software. To guide our research, we formulated the following question: RQ. How are software professionals currently testing AI-powered systems for fairness and bias? Answering this question has direct practical implications, helping software professionals grasp the current state of fairness testing in AI systems while enabling academic researchers to identify gaps between theory and industry practice. By bridging this divide, our study highlights areas where further research and development are needed to align academic insights with real-world implementation. This alignment can drive the creation of more effective tools, methods, and guidelines to tackle bias in software systems. In summary, our study provides four key contributions: 1. It identifies the primary focus areas of fairness testing in the industry, highlighting diversity and inclusivity, model consistency, and data representation and balancing as key testing targets. 2. It shows that fairness testing in practice currently relies heavily on ad-hoc and iterative approaches rather than standardized methods. 3. It highlights key challenges in fairness testing, including poor data quality and diversity, time constraints, lack of specialized tools and metrics, fairness knowledge gaps within teams, and black-box behavior issues. 4. It reports the need for scalable, automated tools, clearer industry guidelines, and stronger cross-functional collaboration between AI developers and testing professionals. From this introduction, this study is organized as follows. In Section 2, we present a literature review on software fairness and fairness testing. Section 3 describes the method conducted in this study. In Section 4, we present our findings, which are discussed in Section 5, along with the implications and limitations of this study. Finally, Section 6 summarizes our contributions and final considerations. II Background This section is focused on exploring two concepts central to this study: software fairness and fairness testing. II-A Software Fairness Although there is no single, universally accepted definition of fairness in the software context, the term generally refers to a set of properties designed to prevent discriminatory behaviors or biases, particularly regarding sensitive attributes such as gender, race, and age [ 13 , 14 , 7 ] . Ensuring fairness is essential for all types of software systems, especially AI-driven applications used in critical domains like criminal justice, healthcare, and recruitment [ 6 ] . Without proper fairness considerations, these systems can perpetuate or even amplify existing social inequalities, leading to biased and discriminatory outcomes that disproportionately impact certain individuals or groups [ 14 ] . The absence of fairness in software systems can have far-reaching consequences, reinforcing and perpetuating existing social inequalities [ 14 ] . Unfair systems often amplify biases present in training data, leading to discriminatory outcomes that disproportionately impact marginalized individuals or groups [ 14 , 6 , 15 ] . Beyond social harm, fairness issues can also damage organizational reputation and reduce public trust in automated systems. The deployment of biased software can lead to negative perceptions of the organizations that use it, reducing confidence in AI-driven decision-making. Additionally, fairness violations carry legal and ethical risks, particularly in sensitive domains such as criminal justice and healthcare, where biased decisions can have severe real-world consequences [ 6 ] . Ensuring fairness in software presents significant challenges due to biased data, software complexity, and the lack of dedicated tools and methods. AI systems inherit biases from their training data, reinforcing inequalities if those biases

Read the complete text