Automated Soap Opera Testing Directed by LLMs and Scenario Knowledge: Feasibility, Challenges, and Road Ahead

Yanqi Su, Zhenchang Xing, Chong Wang, Chunyang Chen, Xiwei Xu, Qinghua Lu, Liming Zhu · 2024

Read Automated Soap Opera Testing Directed by LLMs and Scenario Knowledge: Feasibility, Challenges, and Road Ahead by Yanqi Su, Zhenchang Xing, Chong Wang, Chunyang Chen, Xiwei Xu, Qinghua Lu, Liming Zhu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08581.txt.

Description

Yanqi Su and a team of co-authors tested if language models can run exploratory software testing. Their paper, from twenty twenty-four, deals with soap opera testing. In this style, testers use scene knowledge and flair to craft odd flows that expose bugs from the user side. It works well but needs hand work, which caps its scale. The team first ran a study of how good hand testing of this kind works.

From those lessons they built a multi agent system. It pairs language models with a graph of scene knowledge. Three agents plan, play, and judge the tests. Readers in software quality get a read on what robots can and cannot yet do in this craft.

Catalog record

CREATORYanqi Su, Zhenchang Xing, Chong Wang, Chunyang Chen, Xiwei Xu, Qinghua Lu, Liming Zhu
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-08581

Browse the full library · About the Tower of Babel