Real Faults in Deep Learning Fault Benchmarks: How Real Are They?
Gunel Jahangirova, Nargiz Humbatova, Jinhan Kim, Shin Yoo, Paolo Tonella · 2024
Read Real Faults in Deep Learning Fault Benchmarks: How Real Are They? by Gunel Jahangirova, Nargiz Humbatova, Jinhan Kim, Shin Yoo, Paolo Tonella (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-16336.txt.
Introduction
Gunel Jahangirova and four co-authors audit the benchmarks used to test deep learning fault tools. Their twenty twenty-four paper deals with collections of real bugs in AI systems. New tools for finding, locating, and fixing such bugs prove themselves on these benchmarks, so the benchmarks must be sound.
The team hand-checked four hundred ninety faults from five benchmarks and kept three hundred five for study. They asked whether each bug matched its source, what type it was, and whether it could be reproduced. Only about fifteen percent met their realism bar. Their own attempts to reproduce the faults worked in just over half the cases, a warning for the field.
Catalog record
| CREATOR | Gunel Jahangirova, Nargiz Humbatova, Jinhan Kim, Shin Yoo, Paolo Tonella |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-16336
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Gunel Jahangirova, Nargiz Humbatova, Jinhan Kim, Shin Yoo, Paolo Tonella Abstract As the adoption of Deep Learning (DL) systems continues to rise, an increasing number of approaches are being proposed to test these systems, localise faults within them, and repair those faults. The best attestation of effectiveness for such techniques is an evaluation that showcases their capability to detect, localise and fix real faults. To facilitate these evaluations, the research community has collected multiple benchmarks of real faults in DL systems. In this work, we perform a manual analysis of 490 faults from five different benchmarks and identify that 314 of them are eligible for our study. Our investigation focuses specifically on how well the bugs correspond to the sources they were extracted from, which fault types are represented, and whether the bugs are reproducible. Our findings indicate that only 18.5% of the faults satisfy our realism conditions. Our attempts to reproduce these faults were successful only in 52% of cases. Keywords real faults \cdot deep learning \cdot testing \cdot fault localisation \cdot program repair 1 Introduction The growing popularity of deep learning (DL) systems and their widespread adoption makes ensuring that they are fault-free a task of utmost importance. In response to this challenge, in the last few years, research in the Software Engineering (SE) field has strongly focused on proposing approaches for testing, fault localisation, and repair of such systems. An obvious requirement for evaluation of these techniques is to demonstrate that they can detect, localise or fix faults in faulty DL systems. The need for faulty versions of programs has long been essential for evaluating similar approaches that target traditional software systems, the initial response to which was to apply mutation testing tools to generate versions of a program with small syntactic changes. Later, the discussion on whether the mutants are the worthy replacement for real-world faults has motivated the researchers to create large datasets of real reproducible faults such as Software-artifact Infrastructure Repository (SIR) [ 1 ] , Defects4J [ 2 ] , and BugsJS [ 3 ] . In contrast, research on techniques for DL systems rarely relies on mutation testing tools to generate faulty DL models. Instead many publications include both a proposed approach and a dataset curated specifically to evaluate this approach [ 4 , 5 , 6 ] , while there are also publications the sole purpose of which is to create an independent benchmark of DL faults, such as Defects4ML [ 7 ] and gDefects4DL [ 8 ] . As evidenced by Defects4J [ 2 ] (a benchmark of 835 faults in 17 Java projects), such benchmarks can become essential in SE research, with almost all proposed approaches being evaluated on them, to the extent that there is a risk that the proposed approaches are overfitted to the benchmark. Therefore, it is imperative that the benchmarks consist of faults extracted in a systematic manner and remain unchanged with respect to their source to ensure that they are indeed representative of real-world scenarios. Moreover, the benchmarks need to be diverse in terms of both the subject programs and fault types covered. The goal of this work is to perform a critical analysis of the benchmarks of real, reproducible faults in DL systems. Despite being relatively new, these benchmarks have already been used across multiple studies and, given the growth of the research on SE for DL, are likely to see increased adoption in the future. It should be noted that our focus is on faults experienced when building DL systems, not the faults in DL frameworks/libraries such as Keras, TensorFlow, PyTorch, etc. A DL fault takes place when the behaviour of the DL component is inadequate for the task at hand, meaning it is ‘functionally insufficient’ as per ISO/PAS 21448:2019 [ 9 , 10 ] and the root cause of this inadequacy is due to a human error made during the development and training of the DL model. We first perform a systematic literature search to identify the works that contain benchmarks of reproducible real faults. We proceed with a manual analysis of each bug in the benchmarks and check whether it satisfies the following four realism conditions : (1) the source code for the buggy version in the benchmark should match the buggy code reported in its source (such as a bug report) ; (2) the fix applied in the benchmark should match the fix reported in the source ; (3) the training data used in the benchmark must match the one mentioned in the source ; (4) the training data must be realistic , i.e., it refers to well-known existing datasets, it was collected with a solid procedure, possibly involving manual labelling, or it was generated using a sound mathematical/statistical procedure (not just randomly). If the bug passes all the mentioned checks, we run the bug and check whether it is indeed reproduced and whether this reproduction is stable across multiple runs. Lastly, based on the taxonomy of DL faults by Humbatova et al. [ 10 ] , we extract the fault types that are represented in each bug and check whether these faults can be simulated with the use of a mutation tool. Our overview of 490 bugs from five different benchmarks reveals that 176 of them are unsuitable for our study (see Section 4.4 for details). The analysis of the remaining 314 bugs shows that all four realism conditions are satisfied for only 58 of them. We then attempt to reproduce the faults. For the faults related to tensor problems, we do not require the realism conditions related to training data to be satisfied. This adjustment increased the number of bugs eligible for reproduction attempts to 165. Ultimately, we successfully reproduced 86 of these bugs. The main contributions of this work are as follows: • We conduct a systematic literature review that compiles a list of works that use real DL faults in their approach/evaluation. • We propose a set of characteristics for the analysis of the bugs to check their realism. • We share a subset of the analysed faults that are realistic, reproducible and stable. • We offer an in-depth discussion on the implications of our findings for improving bug benchmarks and mutation testing of DL systems. We believe our work is a timely intervention in the rapidly growing field. Our goal is not to criticise ongoing efforts but to make a constructive contribution to the dialogue about best practices. By rigorously examining the benchmarks of faults, we aim to highlight areas for improvement and encourage the community to adopt higher standards that will hopefully lead to a healthy development of the research area. 2 Fault Dataset Extraction 2.1 Database Search We performed a systematic literature search to identify the list of works that include reproducible real faults in DL systems. The search was conducted using Scopus, a large, multi-disciplinary database of peer-reviewed literature that offers an advanced search functionality. Our search string is designed to look for the terms related to the real bugs in any part of a paper while checking for the terms associated with DL or ML systems only in the