Software Testing in the Quantum World
Rui Abreu, Shaukat Ali, Paolo Arcaini, José Campos, Michael Felderer, Claude Gravel, Fuyuki Ishikawa, Stefan Klikovits, Andriy Miranskyy, Anila Mjeda, Mohammad Reza Mousavi, Masaomi Yamaguchi, Lei Zhang, Jianjun Zhao · 2026
Read Software Testing in the Quantum World by Rui Abreu, Shaukat Ali, Paolo Arcaini, José Campos, Michael Felderer, Claude Gravel, Fuyuki Ishikawa, Stefan Klikovits, Andriy Miranskyy, Anila Mjeda, Mohammad Reza Mousavi, Masaomi Yamaguchi, Lei Zhang, Jianjun Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13996.txt.
Introduction
Rui Abreu and a large team survey how to test software written for quantum computers in 2026. Quantum computing offers significant speedups for simulating physical, chemical, and biological systems. It also helps optimization and machine learning tasks. As quantum software grows in complexity, old quality methods fail.
Classical simulation of quantum computers has long served quality assurance. That simulation becomes infeasible as machines grow past a set size. New methods must operate directly on real quantum computers. The survey maps this shift for testers and builders of quantum software. The field needs test tools built for quantum rigs from the start. This map of the shift can help course and lab leads plan that move.
Catalog record
| CREATOR | Rui Abreu, Shaukat Ali, Paolo Arcaini, José Campos, Michael Felderer, Claude Gravel, Fuyuki Ishikawa, Stefan Klikovits, Andriy Miranskyy, Anila Mjeda, Mohammad Reza Mousavi, Masaomi Yamaguchi, Lei Zhang, Jianjun Zhao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 11 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-13996
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Software Testing in the Quantum World Thanks: All authors contributed equally. Rui Abreu, Shaukat Ali, Paolo Arcaini, José Campos, Michael Felderer, Claude Gravel, Fuyuki Ishikawa, Stefan Klikovits, Andriy Miranskyy, Anila Mjeda, Mohammad Reza Mousavi, Masaomi Yamaguchi, Lei Zhang, Jianjun Zhao Abstract Abstract Quantum computing offers significant speedups for simulating physical, chemical, and biological systems, and for optimization and machine learning. As quantum software grows in complexity, the classical simulation of quantum computers, which has long been essential for quality assurance, becomes infeasible. This shift requires new quality-assurance methods that operate directly on real quantum computers. This paper presents the key challenges in testing large-scale quantum software and offers software engineering perspectives for addressing them. 1 Introduction Miranskyy and Zhang [ 4 ] highlighted the importance of quantum software testing. Since then, many methods and tools have focused on testing small programs executed on ideal, noise-free classical simulators, conditions rarely met on quantum computers. As quantum computers become powerful enough to simulate classically, larger-scale quantum software must be tested directly on real computers, creating new challenges and research opportunities that this column highlights. 2 Scale Existing testing methods relying on classical simulation fail to scale owing to exponential state growth, memory constraints, and high computational costs, including hardware-noise simulations. These methods are largely infeasible on real quantum computers, where access is limited, costly, and the hardware is noisy. Many assumptions in the current methods further restrict them to simulators (e.g., requiring many measurements). This mirrors the evolution of classical software testing, where growing complexity has led from exhaustive reasoning to abstract methods (e.g., model-based testing and surrogate models). Therefore, developing test abstractions is essential. Quantum circuit simplification is a promising approach for improving scalability by reducing circuits and slicing subcircuits as surrogate models for validating software properties. Property-based testing complements this by focusing on properties such as symmetries, invariants, or unitary relations rather than exhaustive output checks. However, the systematic identification of relevant properties remains challenging. Assume-guarantee decomposition supports scalability by decomposing global properties into component-level contracts, enabling compositional reasoning and targeted integration testing. Together, abstraction, property-based testing, and compositional reasoning form plausible solutions. A key challenge is tool development: fully quantum testing tools do not yet exist, classical tools fail to scale, and hybrid quantum-classical solutions are a near-term goal, whereas fully quantum implementations remain a long-term objective. 3 Test Oracle Efficient test oracles remain an open challenge [ 6 ] . Classical strategies based on input-output fail to scale owing to exponential state growth, limited observability, and costly hardware access. Measurement-induced disturbance further complicates oracle design, requiring repeated program runs to obtain statistically meaningful evidence. Shadow tomography allows partial estimation; however, exhaustive inspection remains infeasible, highlighting the need to shift from deterministic output verification to probabilistic, property-based correctness. Promising directions emphasize implicit and relational oracles that validate properties rather than explicit outputs [ 1 ] . Property-based oracles check semantic properties such as invariants, symmetries, unitarity, or equivalence between program behaviors, often as relation-checking problems, enabling automated test artifact construction via metamorphic transformations, self-consistency checks, or equivalence testing. Approximate and statistical oracles balance the cost with confidence guarantees, incorporating adaptive sampling strategies and noise-aware thresholds to remain robust under hardware imperfections. Entropy- and distribution-based checks provide additional fault detection without full-state reconstruction, albeit at increased measurement cost. Crucially, these approaches address the quantum kernel in isolation. A scalable oracle strategy must extend across the entire hybrid architecture, shifting the verification from component-level properties to the integrity of the classical-quantum interaction in an end-to-end computational process. 4 Test Adequacy A suitable notion of test adequacy for quantum programs should shift from “have the tests exercised all paths?” , as used in classical computing, to “have the tests accumulated enough evidence, with stated statistical confidence, that the observed behavior matches the specification within an acceptable noise margin?” Given the probabilistic outputs and imperfect hardware, adequacy must capture what was exercised and the confidence with which deviations could be detected. Building on this, the adequacy of hybrid quantum-classical systems should span the full classical-quantum workflow covering control flow, quantum resources (e.g., qubits, gate types, entanglement structure, and depth), and measurement interfaces that drive classical decisions. In essence, coverage must address both the classical decision surface and the quantum state-preparation/measurement space that it influences. Given these criteria, the test strength can be evaluated using fault-based sensitivity (e.g., mutation-style fault injection [ 2 ] ) and statistical power [ 3 ] : the smallest change in the output distribution, expectation value, or performance metric that a test suite can reliably detect at a fixed shot budget. This depends on realistic fault models that combine software defects (e.g., incorrect gates, qubits, basis, or parameters) with execution faults (e.g., decoherence and gate errors). To achieve adequate efficiency, input-space sampling should be adaptive: begin with diverse seeds, measure coverage and discrepancy, then iteratively select new inputs or parameters to maximize the number of uncovered targets or fault-detection coverage, stopping once coverage goals and confidence stabilize. 5 Quantum Computing for Quantum Software Testing Software testing involves computationally intensive tasks, such as test generation, prioritization, and selection, over large input spaces. As software grows in size and complexity, classical techniques increasingly rely on heuristics and trading off optimality to achieve scalability. Beyond revisiting testing concepts, a complementary question is whether quantum computing can serve as both a test target and a computational resource for testing itself. Quantum computing offers a distinct computational model with potential speedups for certain search, optimization, and learning problems that align naturally with core testing activities. Quantum search can accelerate the discovery of test inputs that satisfy coverage or fault conditions, complementing classical constraint-based generation. Test prioritization and minimization problems can be formulated as combinatorial optimization tasks, amenable to hybrid quantum–classical approaches, such as quantum approximate optimization or annealing. Quantum machine learning also enables data-driven testing tasks such as fault localization and approximation of test oracles without precise specifications. In the near term, these approaches are quantum-assisted rather than fully quantum and are integrated selectively with hybrid workflows alongside classical heuristics. Despite current hardware limitations, this perspective clarifies how, in the long term, quantum computing could provide an additional computational layer to reduce the growing cost of software testing tasks as technology matures [ 5 ] . 6 Benchmarks and Tools Benchmarking is central to assessing the scalability, effectiveness, and practical relevance of quantum software testing techniques. Unlike classical benchmarks, quantum testing benchmarks must account for hardware noise, finite shot budgets, calibration drift, and backend heterogeneity, as these factors directly influence observed behavior. Meaningful benchmarks should therefore report not only fault-detection rates or coverage, but also resource usage (e.g., shots, depth, qubits), statistical confidence, and robustness to noise and calibration variability. This creates a natural connection between software and hardware benchmarks: low-level hardware benchmarks (e.g., gate fidelity, readout error) may be reused to parametrize and contextualize software-level testing results. Community coordination around shared benchmark suites and experimental protocols is essential. Public, curated benchmarks with representative programs, standardized fault models, and clearly defined metrics enable fair comparison across tools and platforms, support reproducibility through transparent reporting of execution parameters, and allow longitudinal evaluation as hardware evolves. Although several tools exist (see Wang et al. [ 7