WALL*: A Web Application for Automated Quality Assurance using Large Language Models

Seyed Moein Abtahi, Akramul Azim · 2025

Read WALL*: A Web Application for Automated Quality Assurance using Large Language Models by Seyed Moein Abtahi, Akramul Azim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-09918.txt.

Introduction

Seyed Moein Abtahi and 1 co-author present WALL in 2025, a web tool that pairs a code scanner with language models to clean up software automatically. Growing projects collect thousands of small defects, and finding, fixing, and grading fixes by hand eats developer time. WALL chains three parts together: one pulls issues out of files with SonarQube, one rewrites the code, and one compares the rewrite against the original.

Trials covered 563 files carrying more than seven thousand flagged issues. Mixing a cheap model with an advanced one cut costs while raising the share of successful revisions, the authors report. Human effort fell without quality slipping. Planned upgrades add open models and remove the human checkpoint entirely, aiming at fully automatic quality care.

Catalog record

CREATORSeyed Moein Abtahi, Akramul Azim
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-09918

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

WALL*: A Web Application for Automated Quality Assurance using Large Language Models Thanks: WALL ( W eb A pplication using L arge L anguage Models) is the name of our web application. Seyed Moein Abtahi, Akramul Azim Abstract As software projects become increasingly complex, the volume and variety of issues in code files have grown substantially. Addressing this challenge requires efficient issue detection, resolution, and evaluation tools. This paper presents WALL, a web application that integrates SonarQube and large language models (LLMs) such as GPT-3.5 Turbo and GPT-4o to automate these tasks. WALL comprises three modules: an issue extraction tool, code issues reviser, and code comparison tool. Together, they enable a seamless pipeline for detecting software issues, generating automated code revisions, and evaluating the accuracy of revisions. Our experiments, conducted on 563 files with over 7,599 issues, demonstrate WALL’s effectiveness in reducing human effort while maintaining high-quality revisions. Results show that employing a hybrid approach of cost-effective and advanced LLMs can significantly lower costs and improve revision rates. Future work aims to enhance WALL’s capabilities by integrating open-source LLMs and eliminating human intervention, paving the way for fully automated code quality management. I Introduction As modern programming projects grow increasingly complex, the number of code files and programming languages used within a single project expands rapidly. Consequently, the variety and volume of issues that can arise in these files also increase significantly. Manually reviewing and debugging all files to ensure they are issue-free is a time-consuming and labor-intensive process. Even when a dedicated quality assurance team is in place, human error remains a significant risk in detecting and resolving all issues, especially in large projects. Leveraging automated frameworks for issue detection is highly beneficial to address this challenge. Tools like SonarQube conduct static code analysis to detect various software issues. These insights improve code quality, maintainability, and security. Software issues can result in system breakdowns, financial setbacks, and security risks, underscoring the importance of effective detection mechanisms [ 1 ] . While traditional detection methods offer some effectiveness, they often struggle to capture the nuanced and intricate problems characteristic of contemporary software development. To ensure code quality, developers commonly rely on static analysis tools [ 2 ] . Numerous studies have demonstrated the efficacy of static analysis tools in uncovering vulnerabilities that might be overlooked during manual code reviews [ 3 , 4 ] . Once issues are identified, the next critical step is their resolution. However, manually revising code to address all detected issues is both time-consuming and costly. Furthermore, humans may not consistently resolve all issues accurately. This research investigates the incorporation of large language models (LLMs) into issue detection frameworks, focusing on methodologies, challenges, and opportunities for enhancing code integrity assurance. LLMs can play a transformative role by automating the code generation process [ 5 ] . Utilizing the detailed issue reports generated by continuous code quality inspection platforms, LLMs significantly reduce the time and cost associated with manual corrections, thereby improving overall project efficiency. The final step involves evaluating the revised code files generated by LLMs against the original files. Predefined metrics are employed to assess the quality of the revisions, ensuring that only files with unsatisfactory metrics require further inspection and review by the quality assurance team. When implemented within an automated pipeline, this streamlined approach ensures continuous code quality improvement with minimal human intervention. II Related Work The adoption of large language models (LLMs) has garnered significant attention in software engineering research due to their potential to transform various stages of the software development lifecycle. Notably, Feng and Dong [ 6 ] examined the application of LLMs in code generation, illustrating their impact across multiple phases of software development. Similarly, Malik and Muhammad [ 7 ] explored the utility of a multi-agent paradigm powered by LLMs. In addition to their role in automating development processes, LLMs have proven effective in identifying security vulnerabilities within software systems. Zhang et al. [ 8 ] highlighted how LLMs are increasingly being employed to detect software vulnerabilities. The performance of LLM-based systems, however, is heavily influenced by the design of prompts. Yi and Gelei [ 9 ] emphasized the critical importance of prompt engineering, detailing how advanced prompt design and optimization techniques significantly enhance the effectiveness and reliability of LLM-driven solutions in achieving superior outcomes in software-related tasks. To further enhance the capabilities of LLMs, the Retrieval-Augmented Generation (RAG) technique has emerged as a powerful approach. This method integrates external knowledge sources with the model’s training data, resulting in improved performance in specialized tasks. Du et al. [ 10 ] demonstrated the effectiveness of RAG in the domain of vulnerability detection, underscoring its potential to address complex security challenges in software systems. Expanding on these advancements, Ali et al. [ 11 ] proposed a novel framework to address requirements traceability, a critical aspect of software development and maintenance. Their approach leverages LLMs and RAG techniques to bridge the semantic gap between natural language requirements and software artifacts, such as UML class diagrams. By integrating keyword, vector, and graph-based indexing techniques, the method significantly enhances the accuracy and efficiency of traceability processes. Building on these studies, we developed the WALL tool to address the advancements and challenges highlighted in their research. III Sources and Data This section outlines the sources and platforms employed in the design and development of the WALL tool and the datasets used for testing the application. The dataset comprises code files written in various programming and configuration languages. WALL comprises three core components: an Issue Extraction Platform, Code Revision using LLMs, and a Self-Developed Code Comparison Tool. The development and operation of the application follow these three sequential steps, ensuring a comprehensive and efficient workflow for detecting, revising, and evaluating code issues. An overview of the application workflow is illustrated in Fig. 1 . III-A Issue Extraction Platform The static code analysis platform integrated into WALL is SonarQube [ 12 ] , selected for its robust support of numerous programming languages, which is particularly advantageous for large software projects where maintaining high code quality across diverse languages is essential. SonarQube helps to identify bugs, which are unintentional errors made during development; code smells, which signal potential design or structural flaws that could benefit from refactoring; and vulnerabilities, which are weaknesses in the code that could pose security risks or be exploited [ 12 ] .To achieve optimal results, it is recommended to use the latest version of SonarQube, which enhances issue detection capabilities and extends support for a wider range of programming languages. Fig. 1: Overview of the WALL application workflow, including data processing steps and how the application functions III-B Large Language Models The language models selected for this experiment are GPT-3.5 Turbo [ 13 ] , GPT-4o, and GPT-4o Mini [ 14 ] . GPT-3.5 Turbo, a cost-effective and versatile model from OpenAI, is well-suited for general-purpose tasks. In contrast, GPT-4o, the latest and most advanced model, provides enhanced capabilities and improved performance over its predecessors. GPT-4o Mini offers a balance between performance and resource efficiency. The selection of these models follows a strategic approach: GPT-3.5 Turbo is used to revise the majority of files cost-efficiently, while GPT-4o is reserved for addressing complex

Read the complete text