Benign Overfitting with Quantum Kernels

Joachim Tomasi, Sandrine Anthoine, Hachem Kadri · 2025

Read Benign Overfitting with Quantum Kernels by Joachim Tomasi, Sandrine Anthoine, Hachem Kadri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17020.txt.

Introduction

Joachim Tomasi, Sandrine Anthoine, and Hachem Kadri design a new kind of quantum kernel for machine learning, in a research paper from 2025. Kernels judge how alike two inputs are. Quantum versions encode data into quantum states, which may capture patterns that classical tools miss.

Many quantum kernels blur out, so the model memorizes training data and fails on new data. The team borrows an idea from classical learning where some overfitting can be harmless. Their design mixes a local part, from small pieces of the system, with a global part, from the whole system. Theory and tests show this mix learns well without the usual collapse.

Catalog record

CREATORJoachim Tomasi, Sandrine Anthoine, Hachem Kadri
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-17020

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Benign Overfitting with Quantum Kernels Joachim Tomasi, Sandrine Anthoine, Hachem Kadri Abstract Kernel methods compare inputs through feature maps. Quantum kernels follow the same principle: input data are encoded into quantum states, which define quantum feature representations in Hilbert spaces. Kernel values are then obtained by estimating inner products between these states using suitable quantum circuit measurements. As a result, quantum kernels may be intractable to compute classically 1 1 1 Here, ’classical’ refers to methods or computations that do not rely on quantum computing resources. while remaining efficiently computable on quantum hardware, potentially leading to a quantum advantage. However, designing effective quantum kernels remains a major challenge. Many quantum kernels, such as the fidelity kernel, suffer from exponential concentration. This results in near-identity kernel matrices that fail to capture meaningful data correlations and lead to overfitting and poor generalization. In this paper, we propose a novel strategy for constructing quantum kernels that achieve good generalization performance, drawing inspiration from benign overfitting in classical machine learning. We introduce the concept of Local-Global quantum kernels, which combine two components: a local quantum kernel based on measurements of small subsystems, and a global quantum kernel derived from full-system measurements. To support the effectiveness of the proposed construction, we show theoretically and empirically that Local-Global quantum kernels exhibit benign overfitting. 1 Introduction Quantum machine learning (QML) has recently attracted significant attention [ Biamonte et al., 2017 , Ciliberto et al., 2018 , Huang et al., 2021 , Cerezo et al., 2022 ] , particularly as Noisy Intermediate-Scale Quantum (NISQ) devices have become increasingly accessible [ Preskill, 2018 ] . Variational Quantum Algorithms (VQAs), which operate under a hybrid quantum-classical paradigm, have received considerable interest, mainly due to the possibility of achieving quantum advantage under NISQ constraints [ Peruzzo et al., 2014 , Farhi et al., 2014 , Du et al., 2020 ] . These algorithms utilize Parameterized Quantum Circuits (PQCs) to compute expectation values of quantum circuit measurements, which are then processed classically to update circuit parameters and optimize cost functions, enabling PQCs to serve as machine learning models [ Benedetti et al., 2019 , Mitarai et al., 2018 ] . Quantum kernels, such as quantum fidelity, offer alternative approaches that align with the constraints of NISQ-compatible hardware [ Havlíček et al., 2019 , Schuld and Killoran, 2019 , Schuld, 2021 ] . Data are encoded into quantum systems through parameterized unitary gates that maps classical data into quantum states. This mapping, known as a quantum feature map, is the basis of the concept of quantum kernels : by encoding classical data into quantum feature states, the quantum fidelity kernel function is defined as the squared magnitude of the inner product between the feature states. This can be regarded as a quantum analog of the kernel trick. All quantum operations in the quantum kernel space remain linear, akin to classical kernel methods that exploit linear separability in kernel feature spaces [ Havlíček et al., 2019 , Schuld and Killoran, 2019 ] . The kernel trick enables nonlinear decision boundaries in the original data space while avoiding explicit computation of high-dimensional features. While VQAs optimize explicit parameterized models, quantum kernels act as their implicit counterparts, leveraging the inner products of embedded quantum states. This duality establishes a theoretical bridge between certain VQA architectures and kernel methods [ Schuld, 2021 , Huang et al., 2021 , Jerbi et al., 2023 ] . Quantum kernel methods are founded on the potential to achieve a computational advantage in feature representations [ Mengoni and Di Pierro, 2019 ] . In this paradigm, certain quantum feature maps are proposed to encode data into high-dimensional Hilbert spaces that are classically intractable but remain efficiently computable on quantum hardware [ Liu et al., 2021 , Kübler et al., 2021 , Havlíček et al., 2019 , Schuld and Killoran, 2019 ] . For example, as shown in Liu et al. [2021] , specific quantum circuits can generate feature maps with provable classical intractability under complexity-theoretic assumptions, potentially enabling learning tasks that are beyond the reach of conventional classical methods. Furthermore, recent work has shown that quantum kernels can approximate broad classes of functions [ Gil-Fuster et al., 2024b ] . However, despite their computational promise, it remains unclear whether quantum advantages in quantum kernels directly translate into practical improvements in learning performance. One concern is that quantum-enhanced features do not necessarily capture the intrinsic structure of the target learning problems. While these quantum models exhibit high expressivity, they often give rise to challenges such as the exponential concentration of kernel values near zero, resulting in kernel matrices that closely approximate the identity matrix [ Thanasilp et al., 2024 ] . Such behavior undermines the model’s ability to capture meaningful data correlations and thus limits its generalization capability. To achieve generalization in the context of quantum kernels, some research has focused on mitigating overfitting through regularization techniques that avoid mere training set interpolation. For example, methods for tuning kernel bandwidths in quantum kernels and reducing the dimensionality of the quantum feature space have been proposed [ Shaydulin and Wild, 2022 , Canatar et al., 2023 , Huang et al., 2021 , Kübler et al., 2021 ] . Another promising direction for mitigating overfitting is to leverage PQCs to learn task-adapted quantum feature maps with the aim of improving generalization performance in quantum kernel methods [ Hubregtsen et al., 2022 , Rodriguez-Grasa et al., 2025 ] . In this work, we study how to enable generalization in interpolating quantum kernel machines, drawing inspiration from recent advances in the modern classical literature where overparameterized models could generalize well despite achieving near-zero training error. Very few studies have examined the generalization abilities of overparameterized quantum models [ Gil-Fuster et al., 2024a ] . Larocca et al. [2023] have investigated the generalization of overparameterized quantum neural networks (QNNs), while Kempkes et al. [2026] and Kamisoyama et al. [2026] have studied the double descent phenomenon in least-squares linear regression within quantum features. Peters and Schuld [2023] have examined benign overfitting in linear quantum models for uniformly spaced training data. In our work, we advance this line of research by proposing a framework for quantum kernels that inherently promotes benign overfitting . Drawing on the concept of spiky-smooth kernels [ Haas et al., 2023 ] , we propose a Local-Global quantum kernel constructed as a weighted sum of two quantum kernels. One component is derived from a local measurement (i.e., low-dimensional relative to the full quantum embedding space) that mimics the smooth kernel behavior, while the other comes from a global measurement of the entire quantum feature space, mimicking the spiky component. This Local-Global quantum kernel allows the learned model to have good generalization even when it interpolates training data, giving rise to benign overfitting. Contributions. This work introduces benign overfitting as a design principle for quantum kernels. In classical machine learning, benign overfitting is typically studied as a phenomenon explaining how highly overparameterized models can generalize despite interpolating training data [ Bartlett et al., 2020 ] . In quantum kernel methods, however, interpolation can arise naturally from kernel concentration: as the number of qubits increases, highly expressive quantum kernels may approach the identity matrix [ Thanasilp et al.,

Read the complete text