On the Reproducibility of Quantum Software Defect Datasets: A Case Study of Bugs4Q
Haruto Ohto 1 , Yuta Ishimoto 1 , Shinsuke Matsumoto 1 , Shinji Kusumoto 1 · 2026
Read On the Reproducibility of Quantum Software Defect Datasets: A Case Study of Bugs4Q by Haruto Ohto 1 , Yuta Ishimoto 1 , Shinsuke Matsumoto 1 , Shinji Kusumoto 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27124.txt.
Description
Ohto and colleagues check whether a popular quantum bug collection still reproduces its bugs years later. Bugs4Q gathers real defects from quantum programs, letting researchers test debugging and repair tools fairly. Earlier work on classical collections showed bugs often stop reproducing as software environments drift. The team ran tens of thousands of executions across many versions of the Qiskit core library. Thirty-seven artefacts were exercised to see which reported bugs still trigger in 2026 conditions.
Reproducibility fell steeply as the library moved from an old release toward the newest one checked. Manual root-cause inspection blamed dependency drift for the overwhelming share of failures. Unlike classical cases, most failures here need source edits, not just version pinning. Import paths and renamed calls must be migrated by hand. The team therefore releases Bugs4Q-Robust, a patched edition restoring most lost reproducibility.
Catalog record
| CREATOR | Haruto Ohto 1 , Yuta Ishimoto 1 , Shinsuke Matsumoto 1 , Shinji Kusumoto 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.27124