Automated Soap Opera Testing Directed by LLMs and Scenario Knowledge: Feasibility, Challenges, and Road Ahead
Yanqi Su, Zhenchang Xing, Chong Wang, Chunyang Chen, Xiwei Xu, Qinghua Lu, Liming Zhu · 2024
Read Automated Soap Opera Testing Directed by LLMs and Scenario Knowledge: Feasibility, Challenges, and Road Ahead by Yanqi Su, Zhenchang Xing, Chong Wang, Chunyang Chen, Xiwei Xu, Qinghua Lu, Liming Zhu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08581.txt.
Description
Yanqi Su and a team of co-authors tested if language models can run exploratory software testing. Their paper, from twenty twenty-four, deals with soap opera testing. In this style, testers use scene knowledge and flair to craft odd flows that expose bugs from the user side. It works well but needs hand work, which caps its scale. The team first ran a study of how good hand testing of this kind works.
From those lessons they built a multi agent system. It pairs language models with a graph of scene knowledge. Three agents plan, play, and judge the tests. Readers in software quality get a read on what robots can and cannot yet do in this craft.
Catalog record
| CREATOR | Yanqi Su, Zhenchang Xing, Chong Wang, Chunyang Chen, Xiwei Xu, Qinghua Lu, Liming Zhu |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-08581