QFOR: A Fidelity-aware Orchestrator for Quantum Computing Environments using Deep Reinforcement Learning CCS: Computer systems organization Quantum computing CCS: Computer systems organization Cloud computing

Hoa T. Nguyen, Muhammad Usman, Rajkumar Buyya · 2025

Read QFOR: A Fidelity-aware Orchestrator for Quantum Computing Environments using Deep Reinforcement Learning CCS: Computer systems organization Quantum computing CCS: Computer systems organization Cloud computing by Hoa T. Nguyen, Muhammad Usman, Rajkumar Buyya (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04974.txt.

Introduction

Hoa Nguyen, Muhammad Usman, and Rajkumar Buyya build a scheduler in 2025 for quantum computers shared through the cloud. Quantum machines differ widely and their qubits are noisy, so sending each job to the right machine matters. Rule-based schedulers adapt poorly when conditions shift, and they balance accuracy against waiting time clumsily.

Their system, named QFOR in the paper, learns scheduling by trial and reward, using real calibration data from IBM machines to estimate noise. Settings let operators favor accuracy or speed as needed. In wide tests, the learned scheduler improved accuracy a great deal over rule-based rivals while keeping run times about the same. The authors say this makes costly quantum time go further.

Catalog record

CREATORHoa T. Nguyen, Muhammad Usman, Rajkumar Buyya
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-04974

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

QFOR: A Fidelity-aware Orchestrator for Quantum Computing Environments using Deep Reinforcement Learning CCS: Computer systems organization Quantum computing CCS: Computer systems organization Cloud computing Hoa T. Nguyen, Muhammad Usman, Rajkumar Buyya Abstract . Quantum cloud computing enables remote access to quantum processors, yet the heterogeneity and noise of available quantum hardware create significant challenges for efficient resource orchestration. These issues complicate the optimization of quantum task allocation and scheduling, as existing heuristic methods fall short in adapting to dynamic conditions or effectively balancing execution fidelity and time. Here, we propose QFOR, a Q uantum F idelity-aware O rchestration of tasks across heterogeneous quantum nodes in cloud-based environments using Deep R einforcement learning. We model the quantum task orchestration as a Markov Decision Process and employ the Proximal Policy Optimization algorithm to learn adaptive scheduling policies, using IBM quantum processor calibration data for noise-aware performance estimation. Our configurable framework balances overall quantum task execution fidelity and time, enabling adaptation to different operational priorities. Extensive evaluation demonstrates that QFOR is adaptive and achieves significant performance with 29.5-84% improvements in relative fidelity performance over heuristic baselines. Furthermore, it maintains comparable quantum execution times, contributing to cost-efficient use of quantum computation resources. 1. Introduction The rapid advancement of quantum computing promises to solve computationally intractable problems across critical technology domains, including cryptography ( Portmann and Renner 2022 ) , drug discovery ( Zinner et al. 2021 ) , optimization ( Lotshaw et al. 2022 ) , and machine learning ( Biamonte et al. 2017 ) . However, given the significant challenges associated with operating physical quantum hardware, such as stringent environmental requirements and high costs, Quantum Cloud Computing (QCC) has emerged as an access paradigm ( Nguyen et al. 2024a ) . QCC platforms, offered by major providers like IBM Quantum, Amazon Braket, Google Cloud, and Microsoft Azure, democratize access to Quantum Processing Units (QPUs) in a Quantum-as-a-Service (QaaS) model. This allows users to execute quantum applications remotely without the need for on-premise hardware. Notably, current QPUs are not fully fault-tolerant processors and operate within the constraints of the Noisy Intermediate-Scale Quantum (NISQ) era ( Preskill 2018 ) , and executing quantum applications on them is a hybrid process, involving both classical and quantum execution. For instance, Variational Quantum Algorithms (VQAs) necessitate a classical optimisation step for convergence ( Moll et al. 2018 ) . Even fully quantum algorithms require classical transpilation to be compatible with the qubit topology and native gate set of the targeted QPU. Furthermore, realizing quantum advantage requires seamless integration with classical high-performance computing (HPC) infrastructure to form hybrid quantum-classical systems ( Saurabh et al. 2023 ; Beck et al. 2024 ) . These hybrid systems leverage classical HPC resources for pre-processing, optimization, and post-processing while utilizing quantum processing units (QPUs) for quantum-specific computations. Figure 1 presents a high-level architecture of a quantum-classical hybrid cloud system, wherein user requests are routed via an API gateway to a corresponding service or application deployment at the middleware layer. Classical tasks for pre-processing and post-processing are queued and dispatched to CPUs and GPUs, while quantum tasks are orchestrated by a quantum task orchestrator component (for example, our proposed QFOR orchestrator in this work), which manages quantum processing units (QPUs) through dedicated queues and APIs. Figure 1. High-level view of a Quantum-HPC system in the cloud-based environment. The QFOR Orchestrator (proposed in this work) manages quantum task scheduling and coordination across quantum processing units (QPUs). In these hybrid quantum cloud computing environments, effective quantum task orchestration is crucial for three key reasons. First, quantum computation resources exhibit extreme scarcity as quantum hardware development is still in its early stages ( Nguyen et al. 2024a ) . Second, quantum resources incur costs significantly higher than equivalent classical compute time, making efficient utilization economically critical. For example, each minute of quantum execution on IBM Quantum hardware costs $96 USD 1 1 1 https://www.ibm.com/quantum/pricing , while each hour of IonQ device reservation on Amazon Braket costs $7,000 USD 2 2 2 https://aws.amazon.com/braket/pricing/ (as of June 2025). Third, quantum fidelity degradation due to poor scheduling can invalidate entire hybrid computations, regardless of classical processing quality ( Kurlej et al. 2024 ; Giortamis et al. 2024 ) . Current quantum hardware exhibits significant variability across multiple dimensions that directly impact quantum task execution ( Nguyen et al. 2024a ) . Multiple QPU technologies exist, including superconducting qubits, trapped ions, and neutral atoms, each with distinct performance and noise characteristics. Even within the same technology, different QPU models possess varied qubit layouts, native gate sets, and qubit connectivity. Architecturally, devices differ in qubit connectivity constraints how quantum circuits can be efficiently mapped and executed. Additionally, gate durations and error rates vary not only between devices but also over time due to calibration cycles and environmental factors ( Chen et al. 2023 ; Resch and Karpuzcu 2022 ) . Device availability is another critical consideration, as queue times can fluctuate based on user demand and system maintenance ( Ravi et al. 2021 ) . These factors collectively introduce substantial heterogeneity and uncertainty into the quantum cloud environment. As a result, effective orchestration must be both fidelity-aware, dynamically select quantum computation nodes that optimize for execution reliability while maintaining efficiency with reasonable execution time. This orchestration approach is essential for harnessing the potential of quantum cloud resources and ensuring consistent, high-quality results and cost efficiency for users. Despite the increasing interest in QCC, existing research in quantum cloud resource management exhibits several critical gaps, particularly concerning heterogeneous quantum computation resources and noise-aware execution fidelity ( Nguyen et al. 2024a ) . Traditional resource management approaches fall into two categories, both with critical limitations. Traditional HPC scheduling algorithms excel at managing classical computation resources but can struggle to account for quantum-specific constraints such as fidelity optimization, decoherence, and calibration-dependent performance ( Esposito et al. 2023 ; Beck et al. 2024 ) . Conversely, quantum-specific heuristics ( Ravi et al. 2021 ; Li et al. 2025 ; Nguyen et al. 2024c ; Nguyen et al. 2024d ) are inherently limited in their ability to adapt to the dynamic and uncertain nature of quantum cloud environments. Recent AI-driven approaches, such as deep reinforcement learning (DRL), have shown promise for addressing this problem with several successful cases in the classical cloud-edge ( Goudarzi et al. 2021 ; Fan et al. 2022 ) and high-performance computing domain ( Yi et al. 2020 ; Zhang et al. 2022 ) , as it is well-suited for sequential decision-making in environments with incomplete information and stochastic dynamics. However, DRL approaches for quantum cloud orchestration remain limited in scope. Existing works mainly focused on completion time ( Nguyen et al. 2024b ) and device allocation ( Li and Zhao 2024 ) or overall fidelity of the targeted quantum device ( Luo et al. 2025 ) . To our knowledge, no existing work considers the trade-off between circuit execution fidelity, time, and complexity of quantum tasks using DRL-based approaches with real quantum circuit workload. Furthermore, as quantum cloud resources are scarce and limited, designing and evaluating resource management in a practical environment is extremely challenging. Therefore, simulation frameworks ( Nguyen et al. 2024c ; Nguyen et al. 2025 ; Luo et al.

Read the complete text