Enhancing Quantum Software Development Process with Experiment Tracking

Mahee Gamage, Otso Kinanen, Jake Muff, Vlad Stirbu · 2025

Read Enhancing Quantum Software Development Process with Experiment Tracking by Mahee Gamage, Otso Kinanen, Jake Muff, Vlad Stirbu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06990.txt.

Introduction

Mahee Gamage and co-authors bring trial logs to quantum software work in a 2025 paper. Quantum gear has moved from pure math to live rigs. With that move, lost runs and one-off luck can no longer pass for proof.

The team borrows the log craft of machine learning, where each run saves its settings, data, and scores in a shared book. A known log tool is bent to quantum tasks to show the gain. Shared logs make runs repeatable and choices clear across mixed classic and quantum work. Quantum teams gain a habit that scales as rigs and crews grow.

Catalog record

CREATORMahee Gamage, Otso Kinanen, Jake Muff, Vlad Stirbu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE8 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-06990

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing Quantum Software Development Process with Experiment Tracking
Mahee Gamage, Otso Kinanen, Jake Muff, Vlad Stirbu

Abstract
As quantum computing advances from theoretical promise to experimental reality, the need for rigorous experiment tracking becomes critical. Drawing inspiration from best practices in machine learning (ML) and artificial intelligence (AI), we argue that reproducibility, scalability, and collaboration in quantum research can benefit significantly from structured tracking workflows. This paper explores the application of MLflow in quantum research, illustrating how it enables better development practices, experiment reproducibility, decision making, and cross-domain integration in an increasingly hybrid classical-quantum landscape.



I
Introduction

Quantum software engineering is an emerging discipline fueled by recent advances in quantum hardware. Despite being part of the broader field of software engineering, quantum software engineering has to take into account the current and near-term technical limitations of the Noisy intermediate-scale quantum (NISQ)
[
3
]
era hardware. The limited number of qubits available in quantum processing units (QPUs) and their quality have a direct impact on the complexity of the programs that can be executed, highlighting important challenges
[
2
]
, which have to be addressed to effectively leverage the promises of quantum computing.

A quantum software or algorithm developer must navigate this complicated environment in a structured way following a well-defined software development lifecycle
[
5
]
, supported by specialized tools
[
1
]
. Given the limited availability of quantum hardware, the development process begins on quantum simulators. Subsequently, as the program or algorithm matures, its execution is performed on the actual hardware. Due to the unique nature of quantum environments, developers must collect relevant data to guide each development stage. Early on, the focus is on the program or algorithm itself, but once executed on a QPU, data collection expands to include hardware-specific information such as calibration and qubit quality.

In this paper, we propose a quantum experiment tracking system built on MLflow, an open-source platform widely adopted in ML/AI development. By leveraging its’s existing capabilities, we focus on developing quantum-specific extensions while benefiting from its mature ecosystem and the operational expertise of an already skilled workforce.

II
Background and Motivation

Experiment tracking
[
7
]
was introduced as a tool that addresses the challenges faced by machine learning (ML) developers in the following four areas: multitude of tools, experiment tracking, reproducibility, and production deployment. We can observe that quantum software development has some similarities with ML/AI development. For example, developers have the option to use several quantum software development toolkits (e.g. Qiskit
1
1

1

https://www.ibm.com/quantum/qiskit
, PennyLane
2
2

2

https://pennylane.ai
, Qrisp
3
3

3

https://www.qrisp.eu
, etc.) that enables them to interact with a multitude of hardware vendors in order to execute their quantum routines. During this process, developers have to collect a plethora of software and hardware related data to steer the software development activities in the right direction.

Fig. 1:
Quantum software development activities supported by experiment tracking

Experiment tracking fundamentally involves collecting and logging data about the software and hardware used. QProv
[
6
]
introduces a quantum provenance model with a data schema that captures four key categories: quantum circuit, quantum computer, compilation, and execution. These form the core of experiment tracking and can be extended with application-specific artifacts. Given the experimental nature of current quantum hardware, run data is essential not only for evaluating performance but also for ensuring reproducibility, since hardware reliability can vary between runs, and simulators cannot fully replace real hardware experimentation
[
4
]
. Additionally, the collected data supports progress tracking by providing a structured view of how performance goals are met, helping guide development to subsequent stages
[
1
]
. These artifacts also offer traceability and support decision-making. Finally, since quantum software development is inherently collaborative, experiment tracking enhances result sharing and supports joint development between hardware and software teams, as depicted in Fig.
1
.

III
Quantum Experiment Tracking

Fig. 2:
Experiment setup: the user executes a program on the on a quantum computer exposed via the VTT QX service and tracks the experiment results to the MLflow tracking server operated by its own organization

Since its introduction, MLflow
4
4

4

https://mlflow.org
has become a standard tool for managing the development lifecycle of ML projects, including more complex domains like Generative AI and Large Language Models. In our study, we used MLflow to track quantum experiment data from programs executed on an IQM 50-qubit quantum computer, operated by VTT via the QX service. The user’s organization hosts the MLflow tracking server and UI, while data is logged using the MLflow client integrated into the quantum program. The experiment setup is illustrated in Fig.
2
.

⬇

import

mlflow

mlflow
.
set_experiment
(”
Qx

VTT

Demo

for

QCE
”)

with

mlflow
.
start_run
():

mlflow
.
set_tag
(”
Training

info
”,

”
Qiskit

on

Qx
”)

provider

=

IQMProvider
(”
https
://
qx
.
vtt
.
fi
/
api
/
devices
/
q50
”)

backend

=

provider
.
get_backend
()

shots

=

500

result

=

demo_function
(
backend
,

shots
)

mlflow
.
log_param
(”
shots
”,

shots
)

mlflow
.
log_figure
(
plot_histogram
(
result
.
get_counts
()),

”
results
.
png
”)

calibration_set_id

=

str
(
result
.
results
[0].
calibration_set_id
)

mlflow
.
log_text
(
calibration_set_id
,

”
calibration_set_id
.
txt
”)

calibration_data

=

get_calibration_data
(
backend
.
client
,

calibration_set_id
)

mlflow
.
log_dict
(
calibration_data
,

”
calibration_data
.
json
”)

Fig. 3:
Tracking experiment data with MLflow. The implementation of
demo_function
,
plot_histogram
and
get_calibration_data
functions has been omitted for brevity.

Experiment tracking
data collection is performed using the MLflow client library that is included in the quantum program. MLflow client can name experiments, set tags on individual runs, and log parameters, metrics, or free-form artifacts (e.g. figures, datasets, etc), capabilities that can capture the QProv attributes. A simplified
5
5

5

Full program available at
https://github.com/qubernetes-dev/q8s-examples
program is depicted in the Listing.
3
.

MLflow client library can be used to process
data from multiple experiments
using the search functionality. The result of a query can be used with other popular libraries to create new artifacts that support decision making activities. A simplified program is depicted in the Listing.
4
.

⬇

import

mlflow

import

pandas

as

pd

import

matplotlib
.
pyplot

as

plt

experiment_name

=

”
Qx

VTT

Demo

for

QCE
”

exp

=

mlflow
.
get_experiment_by_name
(
experiment_name
)

runs_df

=

mlflow
.
search_runs
(
experiment_ids
=[
exp
.
experiment_id
])

…

#

Data
-
frame

can

be

further

processed

with

pandas

and

matplotlib

Fig. 4:
Processing experiments data with MLflow

IV
Discussion and Future Work

In this paper, we demonstrated how MLflow can serve as a foundation for quantum experiment tracking. We showed that MLflow is well-suited to quantum research, supporting improved development practices, reproducibility, informed decision-making, and collaboration. Instead of building standalone solutions like the QProv provenance system
[
6
]
or Aqueduct
6
6

6

https://github.com/AqueductHub

Read the complete text