Leveraging Large Language Models for Trustworthiness Assessment of Web Applications

1 st Oleksandr Yarotskyi, 2 nd José D’Abruzzo Pereira, 3 rd João R. Campos · 2026

Read Leveraging Large Language Models for Trustworthiness Assessment of Web Applications by 1 st Oleksandr Yarotskyi, 2 nd José D’Abruzzo Pereira, 3 rd João R. Campos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23781.txt.

Introduction

Yarotskyi and co-authors test whether large language models can judge if web apps follow secure coding practices. Manual checks of trust are slow and hard to scale. They compare prompt styles across five state-of-the-art models, from plain zero-shot prompts to prompts with rules and call-graph context. Extra structure adds noise, while clear rule-based prompts improve reliability, they report. Their scores feed a quality model that yields one trust score. The score separates secure builds from vulnerable ones.

Catalog record

CREATOR1 st Oleksandr Yarotskyi, 2 nd José D’Abruzzo Pereira, 3 rd João R. Campos
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51463
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.23781

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Leveraging Large Language Models for Trustworthiness Assessment of Web Applications 1 st Oleksandr Yarotskyi, 2 nd José D’Abruzzo Pereira, 3 rd João R. Campos Abstract The widespread adoption of web applications has made their security a critical concern and has increased the need for systematic ways to assess whether they can be considered trustworthy. However, “trust” assessment remains an open problem as existing techniques primarily focus on detecting known vulnerabilities or depend on manual evaluation, which limits their scalability; therefore, evaluating adherence to secure coding practices offers a complementary, pragmatic perspective by focusing on observable development behaviors. In practice, the identification and verification of secure coding practices are predominantly performed manually, relying on expert knowledge and code reviews, which is time-consuming, subjective, and difficult to scale. This study presents an empirical methodology to automate the trustworthiness assessment of web applications by leveraging Large Language Models (LLMs) to verify adherence to secure coding practices. We conduct a comparative analysis of prompt engineering techniques across five state-of-the-art LLMs, ranging from baseline zero-shot classification to prompts enriched with semantic definitions, structural context derived from call graphs, and explicit instructional guidance. Furthermore, we propose an extension of a hierarchical Quality Model (QM) based on the Logic Score of Preference (LSP), in which LLM outputs are used to populate the model’s quality attributes and compute a holistic trustworthiness score. Experimental results indicate that excessive structural context can introduce noise, whereas rule-based instructional prompting improves assessment reliability. The resulting trustworthiness score allows discriminating between secure and vulnerable implementations, supporting the feasibility of using LLMs for scalable and context-aware trust assessment. I Introduction Web applications are fundamental for the modern digital infrastructure, supporting critical operations across a range of sectors [ 1 , 2 ] . As a consequence, we increasingly depend on these systems to behave correctly and securely, making their trustworthiness a critical quality attribute. However, this makes them prime targets for cyber threats, often stemming from insecure coding practices [ 1 , 3 ] . The persistence of these threats is exemplified by the massive 2023 MOVEit data breach, where a single SQL Injection flaw (CVE-2023-34362) compromised thousands of organizations globally [ 4 ] . With injection flaws consistently ranking among the top risks in the Open Worldwide Application Security Project (OWASP) Top 10 [ 5 ] , it is evident that fundamental practices remain a critical yet often neglected line of defense [ 6 , 7 , 8 , 9 ] . Traditional security assessment approaches focus primarily on detecting known vulnerabilities [ 1 , 3 ] . However, this perspective is limited: the absence of alerts does not guarantee the reliability of the application, as it ignores latent weaknesses [ 10 ] . As a result, vulnerability-centric security tools are insufficient to support a comprehensive trustworthiness assessment. Additionally, conventional techniques have structural limitations: Static Application Security Testing (SAST) tends to generate high False Positives (FPs) due to a lack of context, while Dynamic Application Security Testing (DAST) fails to cover critical execution paths [ 11 , 12 , 13 ] . Hybrid solutions ( Interactive Application Security Testing (IAST) , Runtime Application Self-Protection (RASP) ), while attempting to mitigate these failures, often introduce prohibitive complexity and execution overhead [ 14 , 15 ] . To overcome these limitations, Lemes et al. [ 16 ] proposed a more proactive approach that focuses on assessing trustworthiness as the primary metric for measuring security quality. Rather than solely identifying individual flaws, this approach evaluates software by assessing its adherence to established secure coding practices and security-related quality attributes. The central hypothesis is that applications that demonstrate higher adherence to proven secure coding practices (such as those defined by OWASP [ 17 ] ) exhibit a lower likelihood of containing unknown vulnerabilities and can therefore be considered more trustworthy [ 16 ] . However, approaches for assessing trustworthiness based on coding practices, such as that proposed by [ 16 ] and recently extended to characterize open-source software security [ 10 ] , remain challenging to implement in practice. While robust, these approaches rely on manual or semi-automated verification to determine adherence to secure coding practices, limiting their scalability and integration into agile development environments, where automation is essential. At the same time, Large Language Models (LLMs) have recently demonstrated remarkable capabilities in software engineering [ 18 ] , including understanding and generating code [ 19 , 20 ] , opening new perspectives for cybersecurity [ 21 ] . Emerging applications include direct vulnerability detection [ 22 , 23 , 24 ] , automatic code repair [ 25 , 26 ] , and providing advice on secure coding [ 27 , 28 ] . These capabilities suggest that LLMs may be well-suited to assess coding practices that require semantic understanding and contextual reasoning beyond pattern-based analysis. In this work, we investigate the use of LLMs as a systematic mechanism for evaluating source code against established secure coding standards for trustworthiness assessment. By moving beyond ad hoc or advisory uses of LLMs , this study explores their role in structured, repeatable security evaluation processes, a direction that remains insufficiently characterized in existing research [ 29 ] . Building on the trustworthiness assessment framework proposed by Lemes et al. [ 16 ] , this study is guided by the following Research Questions (RQs) : • RQ 1: Can LLMs identify adherence to OWASP Input Validation secure coding practices under baseline (zero-shot) prompting conditions? • RQ 2: What is the impact of different prompt context enrichment strategies on the accuracy and consistency of LLM -based secure coding practice identification? • RQ 3: To what extent can LLMs be used to produce reliable trustworthiness scores? In summary, the main contributions of this paper are: • A systematic comparison of prompt engineering strategies for secure coding practice assessment, evaluating the effects of semantic enrichment, structural context, and explicit instructions across multiple LLMs . • An empirical assessment of the feasibility and reliability of LLM -driven trustworthiness automation, clarifying when LLM -based analysis can be applied at scale. • An extension of the Quality Model (QM) proposed by Lemes et al. [ 16 ] , leveraging LLM outputs to automate the classification of functions and compute trustworthiness scores. This paper is organized as follows. Section II presents the background and related work. Section III describes the experimental methodology. Section IV reports the evaluation results and the discussion. Section V addresses threats to validity, and Section VI concludes the paper and outlines directions for future work. II Background and Related Work This section presents background and related work of secure coding practices, trustworthiness assessment, and LLMs . II-A Secure Coding Practices A fundamental strategy to enhance the security of web applications is to implement security measures in the early stages of the development cycle [ 2 ] . To guide this process, diverse frameworks have been established, derived from industry experience. Initiatives like the Building Security in Maturity Model (BSIMM) [ 30 ] focus on measuring organizational maturity across various domains. In contrast, the Microsoft Security Development Lifecycle (SDL) [ 31 ] integrates security and privacy throughout the entire development lifecycle. Regarding specific code-level rules, the Computer Emergency Readiness Team (CERT) division from the

Read the complete text