Automated Root-Cause Subclassification and No-Code Fix Generation for Invalid Bug Reports
Mahmut Furkan Gön, Emre Dinç, Tevfik Emre Sungur, Eray Tüzün · 2026
Read Automated Root-Cause Subclassification and No-Code Fix Generation for Invalid Bug Reports by Mahmut Furkan Gön, Emre Dinç, Tevfik Emre Sungur, Eray Tüzün (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17561.txt.
Introduction
Gon and colleagues standardize root-cause subclassification for invalid bug reports, which need no code changes and resolve with no-code fixes. On a manually curated gold-standard benchmark they test vanilla language models, retrieval-augmented generation and agentic web search. Retrieval-augmented generation leads subclassification at 0.66 weighted F1, while agentic web search leads no-code fix generation at about 69 percent judge success. Wrong Version remains hardest, scoring near zero.
Catalog record
| CREATOR | Mahmut Furkan Gön, Emre Dinç, Tevfik Emre Sungur, Eray Tüzün |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86758 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17561
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Automated Root-Cause Subclassification and No-Code Fix Generation for Invalid Bug Reports Mahmut Furkan Gön, Emre Dinç, Tevfik Emre Sungur, Eray Tüzün Abstract Context: Issues faced when using software are reported in the form of bug reports. However, many bug reports are invalid, meaning they do not require code changes, and are resolved with a no-code fix. Manually determining the root cause of the invalid bug reports and providing actionable resolutions by the customer support cause a serious waste of resources. Objective: Our goal is to introduce a standardized taxonomy for root-cause oriented invalid bug report subclassification, and perform experiments to test the accuracy of various approaches on invalid subclassification and no-code fix generation. We study how different configurations perform on a gold-standard benchmark we have created. Method: Using a manually curated benchmark for higher quality analysis, we experimented with vanilla LLMs, Retrieval Augmented Generation, and agentic web search to identify invalid subclasses and generate no-code fixes. We evaluated the results against manually labeled ground truth data that includes the invalid subclass and no-code fixes from the original bug reports. We measured subclass detection performance with weighted F1-Score, and assessed no-code fix suggestions using BERTScore and Judge LLM success rates. Results: For subclassification, retrieval augmented generation achieves the highest overall performance with 0.66 weighted F1, slightly outperforming vanilla LLMs at 0.65 and agentic web search at 0.64. At the subclass level, performance peaks at 0.85 F1 for Non-reproducibility and 0.79 for Feature Request and Question, while Wrong Version remains the most challenging with scores between 0.00 and 0.29. For no-code fix generation, agentic web search achieves the highest overall Judge LLM success rate at 68.9%, compared to 64.4% for RAG applications and 64.9% for vanilla LLMs, with subclass-level peaks of 87.4% for Working as Designed and 72.2% for Question. Conclusion: This study shows that retrieval augmented generation improves invalid subclassification performance, while no-code fix generation benefits more from agentic web search, indicating that different components are effective for different tasks. The generated no-code fixes demonstrate the potential to automate customer support workflows, reduce manual triage effort, and provide immediate, actionable guidance to users within bug tracking systems. 1 1 footnotetext: https://github.com/brave/brave-browser/issues/25057 2 2 footnotetext: https://github.com/brave/brave-browser/issues/26323 I Introduction Software maintenance is an essential aspect of software development. Software maintenance costs more than 2 trillion USD annually [ 1 ] . Most open-source and proprietary projects address software maintenance through bug reports in bug tracking platforms such as Jira or GitHub Issues [ 2 , 3 ] . End users create bug reports that reflect their problems, such as implementation issues, crashes, configuration problems, or misunderstandings about the software product. These reports are then reviewed by project owners or developers, who investigate and resolve the reported problems. From the software maintainer’s perspective, bug reports can be categorized as either valid bug reports that require modifications to the source code or invalid bug reports that do not require changes to the source code, hence not inherently a software defect [ 4 , 5 , 6 ] . A considerable portion of submitted bug reports are labeled as invalid. For example, in the Eclipse project, about 22% of the 121,855 reported bugs were classified as invalid [ 4 ] . While invalid bug reports usually do not require changes to the source code, they may still highlight issues within the product. In an analysis of 7,000 issue reports across five open-source projects, 33.8% of reports initially labeled as valid bugs were actually misclassified [ 7 ] . As a result, 39% of source files marked as defective were found to have never contained an actual bug [ 7 ] . Moreover, one study found that resolving invalid bug reports can take nearly as long as resolving valid ones, 16 and 18 days on average across two different software products [ 8 ] . There might be several root causes why a bug report can be invalid, including a misunderstanding of an intended feature [ 5 , 9 , 10 , 11 ] , user-side configuration problems [ 5 , 9 , 10 , 11 ] , or using a wrong version of the software product [ 5 , 10 , 11 ] . The customer support team typically identifies the root causes of invalid bug reports [ 12 ] . (a) Faulty Configuration Issue 3 3 footnotemark: 3 (b) External System Dependency Issue 4 4 footnotemark: 4 Fig. 1 : Invalid Bug Report Examples with Different Root Causes After identifying the root causes, the customer support team resolves these invalid bug reports with no-code fixes , fixes that do not require changes to the source code. In this study, we argue that each potential root cause may require distinct no-code fixes. For instance, a user configuration error could be resolved by finding the required configuration on the user’s machine (see Figure 3 ). In contrast, an external system dependency issue could be resolved by explaining that the issue originates from an upstream external issue (see Figure 4 ). The customer support team can also consider these root causes while providing no-code fix solutions to the reporters. Early detection and resolution of invalid bug reports significantly reduce the workload of all stakeholders involved in the bug tracking lifecycle, including users, customer support, project managers/team leads, and developer teams. By identifying invalid bug reports early, the customer support team is relieved of the repetitive task of manually reviewing, classifying, and responding to them. Instead, they can conc entrate on verifying valid reports and reviewing automatically generated no-code fixes. Once the valid reports are classified, they are forwarded to the team leads, who then assign them to the appropriate developers. Except for a few edge cases, team leads usually prioritize valid issues that are more likely to require code changes [ 13 ] . Consequently, developers can devote their time to genuine software bugs without having to determine whether a bug report actually requires source code modification. However, this may still leave reporters uncertain about how to resolve the invalid bug reports. Incorporating no-code fixes directly addresses this gap by guiding reporters toward the appropriate solution. As a result, it enhances user experience by improving interaction satisfaction and fostering continued engagement. Some earlier studies have applied different machine learning (ML) algorithms [ 8 , 4 ] to detect invalid bug reports. Some others used deep learning (DL) models [ 14 , 15 ] for the same task. More recent studies have applied large language models (LLMs) [ 16 ] , while others have implemented hybrid solutions that combine DL and LLM approaches [ 17 ] to detect invalid bug reports. In addition to basic validity detection, several studies have empirically investigated the root causes behind invalid bug reports [ 5 , 10 , 11 , 9 , 7 ] . However, these works are limited because they rely solely on manual analysis rather than proposing automated methods for invalid sub-categorization by root causes. Although early studies exist, they do not go beyond detecting invalid bug reports or merely discussing the root causes of them. Invalid bug reports need to be detected, categorized by potential root causes, and resolved with no-code fixes. To the best of our knowledge, no