Test Wars: A Comparative Study of SBST, Symbolic Execution, and LLM-Based Approaches to Unit Test Generation

1 st Azat Abdullin, 2 nd Pouria Derakhshanfar, 3 rd Annibale Panichella · 2025

Read Test Wars: A Comparative Study of SBST, Symbolic Execution, and LLM-Based Approaches to Unit Test Generation by 1 st Azat Abdullin, 2 nd Pouria Derakhshanfar, 3 rd Annibale Panichella (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10200.txt.

Description

Azat Abdullin, Pouria Derakhshanfar, and Annibale Panichella stage a contest of three ways to write unit tests by machine, in a 2025 paper. One tool searches for tests, one reasons through code paths, and one asks a large language model to draft them. Each was run on a Java bug data set and scored on reach and fault finding.

The language model tool lagged on code coverage but beat the others on mutation score, a sign its tests probe meaning more deeply. It trailed on real fault finding, though. All three tools struggled most with tangled classes, and the model based tool suffered most as class size grew.

Catalog record

CREATOR1 st Azat Abdullin, 2 nd Pouria Derakhshanfar, 3 rd Annibale Panichella
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-10200

Browse the full library · About the Tower of Babel