A Survey on Web Testing: On the Rise of AI and Applications in Industry

Iva Kertusha, Gebremariem Assres, Onur Duman, Andrea Arcuri · 2025

Read A Survey on Web Testing: On the Rise of AI and Applications in Industry by Iva Kertusha, Gebremariem Assres, Onur Duman, Andrea Arcuri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05378.txt.

Introduction

Iva Kertusha and co-authors survey a decade of research on testing web applications, in a 2025 review. Testing keeps web systems reliable, secure, and fast, and the field has shifted hard toward automation and artificial intelligence. The team analyzed 259 papers from 2014 to 2025, charting methods, tools, venues, and how studies were run, with special attention to links with industry.

Work clustered on new techniques for black-box automated testing, with one conference leading and Selenium the most used tool. Human studies and real industrial use lagged behind, and many tools were never released openly. The survey maps where the field is strong and where practice still trails research.

Catalog record

CREATORIva Kertusha, Gebremariem Assres, Onur Duman, Andrea Arcuri
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE111 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-05378

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Survey on Web Testing: On the Rise of AI and Applications in Industry Iva Kertusha, Gebremariem Assres, Onur Duman, Andrea Arcuri Abstract Web application testing is an essential practice to ensure the reliability, security, and performance of web systems in an increasingly digital world. This paper presents a systematic literature survey focusing on web testing methodologies, tools, and trends from 2014 to 2024. By analyzing 214 214 research papers, the survey identifies key trends, demographics, contributions, tools, challenges, and innovations in this domain. In addition, the survey analyzes the experimental setups adopted by the studies, including the number of participants involved and the outcomes of the experiments. Our results show that web testing research has been highly active, with ICST as the leading venue. Most studies focus on novel techniques, emphasizing automation in black-box testing. Selenium is the most widely used tool, while industrial adoption and human studies remain comparatively limited. The findings provide a detailed overview of trends, advancements, and challenges in web testing research, the evolution of automated testing methods, the role of artificial intelligence in test case generation, and gaps in current research. Special attention was given to the level of collaboration and engagement with the industry. A positive trend in using industrial systems is observed, though many tools lack open-source availability. Keywords : web testing, GUI testing, front-end, survey, SBST, AI, fuzzing 1 Introduction The World Wide Web, commonly known as the Web, is the largest internet-based application and has experienced remarkable growth since its public debut in 1993 [ 75 ] . In an annual report published by Verisign, a global provider of critical internet infrastructure and domain name registry services, it is estimated that there are 354 million existing domains in the first quarter of 2023. 1 1 1 https://blog.verisign.com/domain-names/verisign-q1-2023-the-domain-name-industry-brief/ In 2024, Statista, a global data and business intelligence platform, reports 5.44 billion internet users worldwide. 2 2 2 https://www.statista.com/topics/1145/internet-usage-worldwide/ SimilarWeb, a company specialized on web analytics, 3 3 3 https://www.similarweb.com/ reports the top three most visited industries in 2024 are Search Engines, News & Media, and TV Movies &Streaming [ 241 ] . This highlights the significance of the web frontend, as it directly influences user engagement and interaction across these highly visited industries. The web frontend plays a crucial role in shaping user experiences, serving as the interface between users and the underlying functionality of a web application [ 222 , 241 ] . A well-designed frontend enhances usability, accessibility, and engagement by providing intuitive navigation and visually appealing layouts. As the first point of interaction, the frontend significantly impacts user perception and satisfaction of the web application. Web frontend testing is vital to ensure that web applications provide a seamless and reliable user experience [ 81 , 58 ] . By validating the functionality, usability, and responsiveness of the user interface, frontend testing helps identify and resolve potential issues before an official release or update. This not only enhances user satisfaction but also upholds the application’s reputation by preventing bugs, inconsistencies, and performance bottlenecks. Web frontend testing presents several challenges due to the dynamic and diverse nature of modern web applications. The complexity of interactive elements, asynchronous behaviors, and responsiveness pose significant challenges in testing web frontend applications. Maintaining up-to-date test environments and addressing the rapid evolution of web technologies further complicates the testing process. As web applications become more complex and dynamic, testing approaches must adapt to ensure reliability, usability, and performance. Web development has undergone significant transformations in recent years, introducing new technologies, frameworks, and practices that need a corresponding evolution in testing methodologies. In this survey, we aim to identify key trends, advancements, and challenges of the web testing domain over the past decade. To achieve a comprehensive understanding of this field, we have analyzed 214 papers covering the period 2014-2024. Additionally, we have formulated 14 research questions, that attempt to explore and analyze the advancements, challenges, and trends in web testing since 2014. The article is organized as follows. Section 2 introduces important background information needed to better understand the rest of this article. Section 3 discusses related work. Section 4 describes the paper selection process. In Section 5 we answer and discuss our research questions. Threats to validity are discussed in Section 6 . Section 7 provides the conclusion of the article. 2 Background 2.1 Web Applications Since its introduction in 1991 [ 2 ] , the web has undergone significant evolution, marked by continuous advancements. The web is quite complex, comprising of, but not limited to, frontend technologies, backend technologies, database technologies, protocols, etc. Initially, all Web documents were simply HTML pages [ 2 ] . The introduction of Cascading Style Sheets (CSS) enhanced the presentation and layout of web pages, while JavaScript enabled dynamic and interactive content [ 2 ] . The development of server-side technologies and databases facilitated the creation of complex web applications, expanding the web’s functionality beyond static content delivery. In recent years, trends such as Progressive Web Applications (PWAs), responsive design, and the integration of artificial intelligence have shaped web development practices. Web 4.0 [ 8 ] is the current phase of internet, often referred to as the “Intelligent Web”. It represents the next phase of internet evolution, integrating artificial intelligence, machine learning, and advanced automation to create highly personalized, context-aware, and interconnected digital experiences [ 9 ] . 2.2 Javascript and Asynchronousness JavaScript is a fundamental technology of modern web development, playing a crucial role in creating dynamic and interactive web applications. Initially developed in 1995 by Netscape, JavaScript was designed to enhance static web pages with simple scripting capabilities [ 238 ] . According to Statista, JavaScript is the most popular language of 2024. 4 4 4 https://www.statista.com/statistics/793628/worldwide-developer-survey-most-used-languages/ Over time, JavaScript has evolved into a powerful language that operates both on the client and server sides. Popular and powerful JavaScript frameworks include React, Angular, and Vue.js in frontend development. The rise of Node.js has extended JavaScript beyond the browser, enabling server-side development. JavaScript is a cornerstone of web development, continuously evolving with new tools, libraries, and performance optimizations to support complex web applications and real-time interactivity. JavaScript possesses several features that make it appealing to developers, including dynamic typing, support for event-driven programming, asynchronous event handling, first-class functions, and its weakly typed nature. These very same characteristics make JavaScript challenging to test. Its dynamic nature introduces complexities such as unpredictable type conversions, runtime errors, and difficulties in handling asynchronous operations. 2.3 Web Testing Testing is an important phase in the software development lifecycle, as it ensures that applications adhere to quality standards, fulfill functional requirements, and meet user expectations. Testing a web application amounts to almost 50% of the development cost [ 12 , 59 ] . Given the complexity of web applications now-a-days, the need for highly efficient and effective testing tools has increased. Manual testing involves executing test cases manually without the use of automated tools to identify defects in a software application. Testers simulate user interactions to evaluate functionality, usability, and overall system behavior, making it essential for exploratory, usability, and ad-hoc testing scenarios. However manual testing is prone to human errors, limited exploration capabilities and huge costs. Given the rapid development cycles of

Read the complete text