Test Wars: A Comparative Study of SBST, Symbolic Execution, and LLM-Based Approaches to Unit Test Generation
1 st Azat Abdullin, 2 nd Pouria Derakhshanfar, 3 rd Annibale Panichella · 2025
Read Test Wars: A Comparative Study of SBST, Symbolic Execution, and LLM-Based Approaches to Unit Test Generation by 1 st Azat Abdullin, 2 nd Pouria Derakhshanfar, 3 rd Annibale Panichella (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10200.txt.
Description
Azat Abdullin, Pouria Derakhshanfar, and Annibale Panichella stage a contest of three ways to write unit tests by machine, in a 2025 paper. One tool searches for tests, one reasons through code paths, and one asks a large language model to draft them. Each was run on a Java bug data set and scored on reach and fault finding.
The language model tool lagged on code coverage but beat the others on mutation score, a sign its tests probe meaning more deeply. It trailed on real fault finding, though. All three tools struggled most with tangled classes, and the model based tool suffered most as class size grew.
Catalog record
| CREATOR | 1 st Azat Abdullin, 2 nd Pouria Derakhshanfar, 3 rd Annibale Panichella |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-10200