Quantum Processing Unit (QPU) processing time Prediction with Machine Learning
Lucy Xing, Sanjay Vishwakarma, David Kremer, Francisco Martín-Fernández, Ismael Faro and Juan Cruz-Benito · 2025
Read Quantum Processing Unit (QPU) processing time Prediction with Machine Learning by Lucy Xing, Sanjay Vishwakarma, David Kremer, Francisco Martín-Fernández, Ismael Faro and Juan Cruz-Benito (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20630.txt.
Introduction
Lucy Xing and five co-authors explore machine learning models that predict how long a quantum processing unit will take to run a submitted quantum job. Better processing time forecasts can improve resource management and scheduling on shared quantum systems. Their dataset contains about one hundred fifty thousand jobs following the IBM Quantum schema, giving the models a realistic spread of real workloads to learn from.
Gradient boosting with the LightGBM library drives the predictors, with data preprocessing steps added to improve accuracy. The results demonstrate that machine learning can effectively forecast quantum job processing times on this operational data. The authors frame the work as a foundation for integrating artificial intelligence tools into the day-to-day operations of advanced quantum computing centers.
Catalog record
| CREATOR | Lucy Xing, Sanjay Vishwakarma, David Kremer, Francisco Martín-Fernández, Ismael Faro and Juan Cruz-Benito |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20630
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Quantum Processing Unit (QPU) processing time Prediction with Machine Learning Lucy Xing, Sanjay Vishwakarma, David Kremer, Francisco Martín-Fernández, Ismael Faro and Juan Cruz-Benito Abstract This paper explores the application of machine learning (ML) techniques in predicting the QPU processing time of quantum jobs. By leveraging ML algorithms, this study introduces predictive models that are designed to enhance operational efficiency in quantum computing systems. Using a dataset of about 150,000 jobs that follow the IBM Quantum schema, we employ ML methods based on Gradient-Boosting (LightGBM) to predict the QPU processing times, incorporating data preprocessing methods to improve model accuracy. The results demonstrate the effectiveness of ML in forecasting quantum jobs. This improvement can have implications on improving resource management and scheduling within quantum computing frameworks. This research not only highlights the potential of ML in refining quantum job predictions but also sets a foundation for integrating AI-driven tools in advanced quantum computing operations. I Introduction The nature of quantum computing becomes increasingly relevant in the core of data-center operations due to a paradigm shift in computational processing, prioritization, and execution. At the intersection of advanced quantum computing and intricate software architecture lies a complex, heterogeneous landscape of resources. In this context, the QPU plays a pivotal role. Each distinct component of the software and hardware stack influences how a quantum job can be executed, and designing efficient systems is a challenging task [ 1 ] . Furthermore, as the quantum computing field advances, there is a growing need for systems that are more robust, responsive, resilient, or adaptable to various execution modes and user needs, among other requirements. To some extent, quantum computing systems and stacks are expected to broaden the scope of current software design and architectural definitions [ 2 , 3 , 4 , 5 , 6 ] to accommodate the unique characteristics and challenges of this new computing paradigm. Among the features that quantum computing systems may have, we can identify the integration of intelligent capabilities. These new smart features enable systems to respond to various events, enhance the user experience, optimize the resources required for quantum computing jobs, prevent internal errors, and guarantee that users’ quantum programs perform efficiently and effectively within the stack, in terms of both performance and efficiency. This current work fits in the area of new smart features that could help the improvement of existing quantum computing systems and stacks. Traditional models used to estimate computational time and resource requirements fall short in quantum environments, where the job execution time of computational primitives may depend on information learned at runtime. The diversity and complexity of quantum job behavior, combined with the evolving landscape of quantum programming techniques and hardware advancements, require a more flexible and complex approach to predict it to improve other existing methods which may not be accurate [ 7 ] . ML emerges as an useful technique in this scenario, where patterns and data analysis comes to navigate the quantum computing ecosystem. By harnessing ML, we can derive predictive insights that are both nuanced and dynamic, catering to the unique attributes of quantum jobs and ensuring that the software architecture remains robust and efficient in the face of quantum computing’s challenges and opportunities. In this paper, we specifically examine the distinct patterns generated by quantum jobs in the given environment to anticipate their behavior in advance. To demonstrate its potential, we present novel methods for predicting QPU processing time for quantum jobs. To clarify, QPU time refers to the duration that the QPU is locked to execute a particular quantum computing job. QPU time is a crucial factor in assessing the overall performance and efficiency of quantum computing systems. This paper aims to highlight the path towards an AI-driven approach to job behavior prediction for quantum jobs, offering a comprehensive analysis that bridges the gap between its potential and practical application. The primary objective of this research is to illustrate the application of Artificial Intelligence (AI) in anticipating quantum job behavior, specifically in relation to QPU time. The secondary goal is to discuss how these features could enhance existing quantum computing systems by improving their performance, efficiency, and overall capabilities. The paper is organized as follows: Section II presents the materials and methods used for this paper. Section III presents the main results related to predicting job’s QPU time. Section IV discusses the results, presents some conclusions and future directions for this work. II Materials and methods II-A Materials II-A 1 Data Collection The dataset utilized in this study consists of anonymized data from genuine quantum jobs sourced from IBM Quantum’s database. This dataset excludes any personal information or personal identifiable information. Quantum jobs data are accumulated daily, pre-processed and archived in pickle files for further analysis. The data used in this research was gathered between 2025-03-05 and 2025-03-21. In total, 166,143 quantum jobs were utilized for QPU time prediction. Each quantum job is recorded with 43 distinct data fields. These fields encompass elements such as the IBM Quantum backend the job will run on, the primitive id of the job (sampler/estimator), the total number of requested shots, and error suppression and correction methods, among others. Metadata such as the total number of executions and the number of batches are used as a proxy to determine the approximate job size and play a significant role in the prediction of QPU times. To train the models, a configuration file is utilized to define the parameters 1 1 1 LightGBM parameters for the input features (X) and the output feature (Y). In this instance, the input features for X consist of the quantum job metadata, while the output feature for Y is the QPU time. The X column parameters are categorized into various data types, such as numerical and categorical, for encoding purposes, which will be elaborated in the Methods section. II-A 2 Model We trained a ML model to predict QPU time using the Light Gradient-Boosting Machine (LightGBM) library [ 8 ] . LightGBM is an open-source gradient-boosting framework based on decision trees, and designed to be highly efficient. LightGBM uses histogram-based algorithms in combination with leaf-wise tree growth algorithms that has the advantage of faster training, being highly accurate, and reducing memory usage --- factors that are critical for datasets of larger scale 2 2 2 LightGBM features . In addition, LightGBM also allows for weights to be set on the training data. Since recent data more closely resemble the latest quantum job behavior in terms of QPU time taken, we assigned higher weights to more recent data and comparatively lower weights to older data when training our model. Based on our feature importance analysis for predicting QPU execution time, presented below is a small subset of the most important features that our model uses: • backend – The QPU type significantly influences execution time due to hardware-specific latencies and queuing behavior. • primitive_id – Identifies a sampler or estimator primitive. • sum_shots – The total number of shots strongly correlates with execution duration, as more measurements lead to longer QPU usage. • sum_durations_per_pub – Aggregated the duration of each Primitive Unified Bloc (PUB) 3 3 3 Primitive inputs and outputs , which takes circuit depth into consideration. • has_options