Assessing Reproducibility in Evolutionary Computation CCS: General and reference Empirical studies CCS: Applied computing Document searching CCS: Theory of computation Theory of randomized search heuristics
Francesca Da Ros, Tarik Začiragić, Aske Plaat, Thomas Bäck, Niki van Stein · 2026
Read Assessing Reproducibility in Evolutionary Computation CCS: General and reference Empirical studies CCS: Applied computing Document searching CCS: Theory of computation Theory of randomized search heuristics by Francesca Da Ros, Tarik Začiragić, Aske Plaat, Thomas Bäck, Niki van Stein (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07059.txt.
Description
Francesca Da Ros and four co-authors measure how reproducible evolutionary computation papers truly are. Results in this field hinge on computational experiments, so reproducibility rests on how algorithms, protocols, and artifacts are documented and shared. Awareness has grown, yet hard evidence on actual practice was thin. The team studied papers from one track of the Genetic and Evolutionary Computation Conference across ten years.
They built a structured checklist and applied it by hand to the whole corpus in a systematic way. They also built RECAP, a language-model pipeline that scores reproducibility signals from paper text and code repos on its own. Papers averaged a completeness score of 0.62, and about 37 percent supplied material beyond the manuscript. RECAP agreed substantially with human scorers, at a Cohen's kappa of 0.67, which suggests automated tools can support large-scale monitoring of reproducibility practice.
Catalog record
| CREATOR | Francesca Da Ros, Tarik Začiragić, Aske Plaat, Thomas Bäck, Niki van Stein |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07059