Enhancing Quantum Software Development Process with Experiment Tracking
Mahee Gamage, Otso Kinanen, Jake Muff, Vlad Stirbu · 2025
Read Enhancing Quantum Software Development Process with Experiment Tracking by Mahee Gamage, Otso Kinanen, Jake Muff, Vlad Stirbu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06990.txt.
Introduction
Mahee Gamage and co-authors bring trial logs to quantum software work in a 2025 paper. Quantum gear has moved from pure math to live rigs. With that move, lost runs and one-off luck can no longer pass for proof.
The team borrows the log craft of machine learning, where each run saves its settings, data, and scores in a shared book. A known log tool is bent to quantum tasks to show the gain. Shared logs make runs repeatable and choices clear across mixed classic and quantum work. Quantum teams gain a habit that scales as rigs and crews grow.
Catalog record
| CREATOR | Mahee Gamage, Otso Kinanen, Jake Muff, Vlad Stirbu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 8 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-06990
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enhancing Quantum Software Development Process with Experiment Tracking Mahee Gamage, Otso Kinanen, Jake Muff, Vlad Stirbu Abstract As quantum computing advances from theoretical promise to experimental reality, the need for rigorous experiment tracking becomes critical. Drawing inspiration from best practices in machine learning (ML) and artificial intelligence (AI), we argue that reproducibility, scalability, and collaboration in quantum research can benefit significantly from structured tracking workflows. This paper explores the application of MLflow in quantum research, illustrating how it enables better development practices, experiment reproducibility, decision making, and cross-domain integration in an increasingly hybrid classical-quantum landscape. I Introduction Quantum software engineering is an emerging discipline fueled by recent advances in quantum hardware. Despite being part of the broader field of software engineering, quantum software engineering has to take into account the current and near-term technical limitations of the Noisy intermediate-scale quantum (NISQ) [ 3 ] era hardware. The limited number of qubits available in quantum processing units (QPUs) and their quality have a direct impact on the complexity of the programs that can be executed, highlighting important challenges [ 2 ] , which have to be addressed to effectively leverage the promises of quantum computing. A quantum software or algorithm developer must navigate this complicated environment in a structured way following a well-defined software development lifecycle [ 5 ] , supported by specialized tools [ 1 ] . Given the limited availability of quantum hardware, the development process begins on quantum simulators. Subsequently, as the program or algorithm matures, its execution is performed on the actual hardware. Due to the unique nature of quantum environments, developers must collect relevant data to guide each development stage. Early on, the focus is on the program or algorithm itself, but once executed on a QPU, data collection expands to include hardware-specific information such as calibration and qubit quality. In this paper, we propose a quantum experiment tracking system built on MLflow, an open-source platform widely adopted in ML/AI development. By leveraging its’s existing capabilities, we focus on developing quantum-specific extensions while benefiting from its mature ecosystem and the operational expertise of an already skilled workforce. II Background and Motivation Experiment tracking [ 7 ] was introduced as a tool that addresses the challenges faced by machine learning (ML) developers in the following four areas: multitude of tools, experiment tracking, reproducibility, and production deployment. We can observe that quantum software development has some similarities with ML/AI development. For example, developers have the option to use several quantum software development toolkits (e.g. Qiskit 1 1 1 https://www.ibm.com/quantum/qiskit , PennyLane 2 2 2 https://pennylane.ai , Qrisp 3 3 3 https://www.qrisp.eu , etc.) that enables them to interact with a multitude of hardware vendors in order to execute their quantum routines. During this process, developers have to collect a plethora of software and hardware related data to steer the software development activities in the right direction. Fig. 1: Quantum software development activities supported by experiment tracking Experiment tracking fundamentally involves collecting and logging data about the software and hardware used. QProv [ 6 ] introduces a quantum provenance model with a data schema that captures four key categories: quantum circuit, quantum computer, compilation, and execution. These form the core of experiment tracking and can be extended with application-specific artifacts. Given the experimental nature of current quantum hardware, run data is essential not only for evaluating performance but also for ensuring reproducibility, since hardware reliability can vary between runs, and simulators cannot fully replace real hardware experimentation [ 4 ] . Additionally, the collected data supports progress tracking by providing a structured view of how performance goals are met, helping guide development to subsequent stages [ 1 ] . These artifacts also offer traceability and support decision-making. Finally, since quantum software development is inherently collaborative, experiment tracking enhances result sharing and supports joint development between hardware and software teams, as depicted in Fig. 1 . III Quantum Experiment Tracking Fig. 2: Experiment setup: the user executes a program on the on a quantum computer exposed via the VTT QX service and tracks the experiment results to the MLflow tracking server operated by its own organization Since its introduction, MLflow 4 4 4 https://mlflow.org has become a standard tool for managing the development lifecycle of ML projects, including more complex domains like Generative AI and Large Language Models. In our study, we used MLflow to track quantum experiment data from programs executed on an IQM 50-qubit quantum computer, operated by VTT via the QX service. The user’s organization hosts the MLflow tracking server and UI, while data is logged using the MLflow client integrated into the quantum program. The experiment setup is illustrated in Fig. 2 . ⬇ import mlflow mlflow . set_experiment (” Qx VTT Demo for QCE ”) with mlflow . start_run (): mlflow . set_tag (” Training info ”, ” Qiskit on Qx ”) provider = IQMProvider (” https :// qx . vtt . fi / api / devices / q50 ”) backend = provider . get_backend () shots = 500 result = demo_function ( backend , shots ) mlflow . log_param (” shots ”, shots ) mlflow . log_figure ( plot_histogram ( result . get_counts ()), ” results . png ”) calibration_set_id = str ( result . results [0]. calibration_set_id ) mlflow . log_text ( calibration_set_id , ” calibration_set_id . txt ”) calibration_data = get_calibration_data ( backend . client , calibration_set_id ) mlflow . log_dict ( calibration_data , ” calibration_data . json ”) Fig. 3: Tracking experiment data with MLflow. The implementation of demo_function , plot_histogram and get_calibration_data functions has been omitted for brevity. Experiment tracking data collection is performed using the MLflow client library that is included in the quantum program. MLflow client can name experiments, set tags on individual runs, and log parameters, metrics, or free-form artifacts (e.g. figures, datasets, etc), capabilities that can capture the QProv attributes. A simplified 5 5 5 Full program available at https://github.com/qubernetes-dev/q8s-examples program is depicted in the Listing. 3 . MLflow client library can be used to process data from multiple experiments using the search functionality. The result of a query can be used with other popular libraries to create new artifacts that support decision making activities. A simplified program is depicted in the Listing. 4 . ⬇ import mlflow import pandas as pd import matplotlib . pyplot as plt experiment_name = ” Qx VTT Demo for QCE ” exp = mlflow . get_experiment_by_name ( experiment_name ) runs_df = mlflow . search_runs ( experiment_ids =[ exp . experiment_id ]) … # Data - frame can be further processed with pandas and matplotlib Fig. 4: Processing experiments data with MLflow IV Discussion and Future Work In this paper, we demonstrated how MLflow can serve as a foundation for quantum experiment tracking. We showed that MLflow is well-suited to quantum research, supporting improved development practices, reproducibility, informed decision-making, and collaboration. Instead of building standalone solutions like the QProv provenance system [ 6 ] or Aqueduct 6 6 6 https://github.com/AqueductHub