Benchmarking gate-based quantum devices via certification of qubit von Neumann measurements

Paulina Lewandowska, Martin Beseda, * · 2025

Read Benchmarking gate-based quantum devices via certification of qubit von Neumann measurements by Paulina Lewandowska, Martin Beseda, * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-03514.txt.

Introduction

Benchmarking a quantum computer means checking its measurements, not just its gates. Paulina Lewandowska and Martin Beseda present an updated PyQBench, an open-source Python library for that task. It certifies qubit von Neumann measurements on today's noisy devices. The new version adds a scheme that scores measurement accuracy directly. The original discrimination tests remain. A command-line tool and library API let users add custom schemes and error models.

The release targets IBM Q hardware through the Qiskit toolkit. Benchmarks can run on real machines without extra plumbing. The authors aim the library at the noisy era's core need: trustworthy numbers for measurement quality. Community contributions are invited under an open license.

Catalog record

CREATORPaulina Lewandowska, Martin Beseda, *
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-03514

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Benchmarking gate-based quantum devices via certification of qubit von Neumann measurements Paulina Lewandowska, Martin Beseda, * Abstract We present an updated version of PyQBench, an open-source Python library designed for benchmarking gate-based quantum computers, with a focus on certifying qubit von Neumann measurements. This version extends PyQBench’s capabilities by incorporating a certification scheme of quantum measurements that evaluates the accuracy on Noisy Intermediate-Scale Quantum devices, alongside its original functionality of von Neumann measurements’ discrimination. PyQBench offers a user-friendly command-line interface and Python library integration, allowing users to implement custom measurement schemes and error models for more advanced benchmarking tasks. The new version is specifically designed to support IBM Q devices through integration with the Qiskit library, enabling seamless benchmarking on real quantum hardware. By providing flexible benchmarking tools, PyQBench addresses the critical need for reliable performance metrics in the NISQ era, contributing to the development of error mitigation techniques and the verification of quantum measurement fidelity. The source code is available on GitHub under an open-source license, encouraging community collaboration and further advancements in quantum hardware benchmarking. Keywords. Quantum computing, Benchmarking, Certification, Open-source, Python, IBM Q devices, Qiskit 1 Introduction Noisy Intermediate-Scale Quantum (NISQ) devices, as outlined by Preskill [ 1 ] , are rapidly developing, built on a variety of architectures and supported by a growing ecosystem of software solutions. Public access to gate-based quantum devices is provided by several hardware vendors, including Rigetti [ 2 ] , IBM [ 3 ] , IonQ [ 4 ] , and Xanadu [ 5 ] . Each of these vendors typically offers its own software stack and application programming interfaces (APIs) for interacting with their devices. For example, IBM Q devices can be accessed via the Qiskit library [ 6 ] or through the IBM Quantum Experience web interface [ 7 ] . However, as NISQ devices are still in the early stages of development, they are often characterized by significant noise, errors, and limited qubit counts, which pose challenges for the reliability of quantum computations. Consequently, there is an increasing need for robust benchmarking methodologies to assess their performance. Benchmarking NISQ devices involves the evaluation of key performance metrics, including quantum gate fidelity, coherence times, error rates, and computational accuracy. These metrics enable researchers and developers to assess how well a quantum device performs under real-world conditions, guiding the optimization of both hardware and algorithms for near-term quantum applications. Given the inherent noise in NISQ devices, benchmarking also focuses on understanding how errors propagate through quantum circuits, the effects of noise on computational outcomes, and the effectiveness of error mitigation techniques [ 8 ] . Several well-established benchmarking techniques are currently employed. One widely used method is randomized benchmarking, which assesses quantum gate error rates by applying random sequences of operations and measuring their success rate [ 9 ] . This approach has been implemented in libraries such as Qiskit [ 10 ] and PyQuil [ 11 ] . Another significant method is cross-entropy benchmarking, which evaluates the precision of quantum computations by comparing the output of a quantum algorithm with a corresponding classical simulation [ 12 ] . Additionally, the quantum volume metric has become a key tool for characterizing the overall capacity of a quantum device to solve computational problems. Quantum volume takes into account factors such as qubit count, connectivity, and measurement errors, and can be measured using tools like Qiskit [ 13 ] . While these methods provide valuable insights into the performance of quantum devices, they focus primarily on gate-level errors or device-specific characteristics. Recently, an alternative benchmarking approach was introduced in [ 14 ] , focusing on the certification of qubit von Neumann measurements. This approach offers a more direct evaluation of a device’s ability to accurately discriminate between quantum measurements. The authors developed PyQBench, an open-source Python library for benchmarking gate-based quantum computers, which assesses the ability of NISQ devices to perform qubit von Neumann measurement discrimination [ 15 ] . PyQBench supports any device available through the Qiskit library, allowing users to benchmark hardware from providers such as IBM Q [ 3 ] and Amazon Braket [ 16 ] . The library offers a command-line interface (CLI) for running predefined benchmarking scenarios based on the parametrized Fourier family of qubit von Neumann measurements. In this paper, we build upon the PyQBench framework by incorporating a certication scheme for qubit von Neumann measurements, as described in [ 17 ] . We provide a simplified CLI for executing benchmarks certifying the predefined parametrized Fourier family of measurements. Furthermore, for more advanced use cases, PyQBench can be employed as a Python library, allowing users to define custom measurement schemes or integrate error models for a more comprehensive evaluation. The new certification scheme is specifically designed for IBM Q devices and is integrated with the Qiskit library. Additionally, all the functionalities of PyQBench for the discrimination scheme of von Neumann measurements have also been updated to the new version of Qiskit. The source code for PyQBench is publicly available on GitHub 1 1 1 https://github.com/iitis/PyQBench under an open-source license, enabling users to adapt and extend the package for their specific research needs. By providing this tool, we aim to facilitate the benchmarking of NISQ devices across a range of quantum computing platforms and contribute to the development of reliable quality metrics for near-term quantum technologies. This paper is organized as follows. Section 2 presents the necessary mathematical preliminaries. Section 3 introduces the binary certification scheme for qubit von Neumann measurements, and Section 4 discusses its realization on NISQ devices. In Section 5 , we present the certification scheme for the parametrized Fourier family of qubit measurements. Details regarding the software functionalities are provided in Section 6 , where Section 6.1 focuses on PyQBench’s Python library interface, and Section 6.2 details the CLI functionalities. The certification results obtained on IBM Q platform are evaluated and discussed in Section 7 both with and without noise mitigation applied. Finally, Section 8 summarizes the main contributions and results of this work. Technical details and examples of YAML configuration files used in our experiments are included in the appendices. 2 Mathematical preliminaries Consider two complex Euclidean spaces and denote them by \mathcal{X},\mathcal{Y} . Let \mathrm{L}(\mathcal{X},\mathcal{Y}) be the set of all linear operators of the form M:\mathcal{X}\rightarrow\mathcal{Y} . From now on, let L(X)\mathrel{\mathop{:}}=L(X,X) , as a shorthand. The set of quantum states, that is, positive semidefinite operators that trace equal to one, will be denoted by \Omega(\mathcal{X}) . An operator U\in\mathrm{L}\left(\mathcal{X}\right) is unitary if it satisfies the equation UU^{\dagger}=U^{\dagger}U={\rm 1\hskip-2.56073ptl} . The notation \mathrm{U}\left(\mathcal{X}\right) will be used to denote the set of all unitary operators. We will distinguish the special class of unitary matrices that is diagonal. This subset will be denoted by \mathrm{DU}(\mathcal{X}) . A general quantum measurement, that is, a positive operator-valued measure (POVM) \mathcal{P} is a finite collection of positive semidefinite operators \{E_{0},\ldots,E_{m}\} called effects, which sum up to identity, i.e. \sum_{i=0}^{m}E_{i}={\rm 1\hskip-2.56073ptl} . If all the effects are rank-one projection operators, then such a measurement is called a von Neumann measurement. Every von Neumann measurement can be parametrized by a unitary matrix. If U is a unitary matrix, one can construct a von Neumann measurement \mathcal{P}_{U} by taking

Read the complete text