On the importance of hyperparameters in initializing parameterized quantum circuits
Ankit Kulshrestha, Sarvagya Upadhyay · 2026
Read On the importance of hyperparameters in initializing parameterized quantum circuits by Ankit Kulshrestha, Sarvagya Upadhyay (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21266.txt.
Introduction
Ankit Kulshrestha and Sarvagya Upadhyay hunt for good starting parameters for parameterized quantum circuits, a choice that shapes training success. Rather than picking a distribution, their evolutionary search tunes the distribution's hyperparameters for each circuit and task. Tests show the tuned starts converge faster and perform better, without worsening the barren-plateau problem, the fading of gradient signals that plagues large circuits.
Catalog record
| CREATOR | Ankit Kulshrestha, Sarvagya Upadhyay |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32811 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.21266
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On the importance of hyperparameters in initializing parameterized quantum circuits Ankit Kulshrestha, Sarvagya Upadhyay Abstract There has been intensive research on increasing the utility and performance of Parameterized Quantum Circuits (PQCs) in the past couple of years. Owing to this research, there are now several inductive biases available to a quantum algorithms researchers to design a good circuit for their chosen task. In this paper, we focus on the problem of finding performant initial parameters for a given PQC. Different from previous research that focuses on finding the right distribution , we focus on finding the hyperparameters for any given distribution. To that end we introduce an evolutionary-search based algorithm that finds optimal hyperparameter given a PQC and quantum task. Our empirical results indicate that our algorithm consistently leads to selection of performant initial parameters tuned specifically to the ansatz and the quantum task leading to faster convergence and performance. More importantly, our algorithm does not negatively affect the barren plateau phenomenon. In other words, the initial parameters suggested by algorithm do not worsen the gradient variance scaling for a given initializing distribution. I Introduction The quest for a workable quantum computer continues to drive both theoretical practitioners and engineers to overcome formidable obstacles in the way. In a few short years, the field has gone from being a theoretical possibility to a practical implementation. While the industry is actively focusing on developing techniques for so-called Early Fault Tolerant Quantum (EFTQC) devices, there has been tremendous development of hybrid quantum-classical algorithms that can run on so-called Noisy Intermediate-Scale Quantum (NISQ) devices. These algorithms called Variational Quantum Algorithms (VQAs) involve running parameterized quantum circuits (PQCs) whose parameters are optimized on classical computers. Designing PQCs is both an art and science. There are many inductive biases that an algorithm designer can choose to create an effective PQC for a given quantum computing task. Some examples of inductive bias include the choice of rotation gate, number of control gates, entanglement patterns, etc. One important inductive design is that of the initializing distribution for the parameters of the circuit. The choice of initializing distribution has a subtle impact on the performance of the circuit. McClean et al [ 1 ] show that for any Haar random distribution we can expect the circuit to be in a flat landscape even for small sizes. Mitigation strategies for this effect from an initialization perspective have been studied in the literature [ 2 , 3 , 4 , 5 ] . Through these works it has been gradually established that distributions other than (unmodified) uniform often work better for quantum circuits. One important question that arises from studying initializing distributions is whether we can find good “hyperparameters” (e.g. \alpha,\beta for Beta, \mu,\sigma for Gaussian) for a given initializing distribution and a given ansatz? Surprisingly, we did not find any literature that deals with this specific question. To establish the importance of hyperparameters, we performed a small experiment with a five layer and four qubit Hardware Efficient Ansatz (HEA) [ 6 ] . Specifically, we profiled the gradient distribution when parameters are drawn from Gaussian and Beta distributions. The distributions are shown in Figure 1 . The top panel shows gradient distribution with manually selected hyperparameters and the bottom panel shows the distribution when the hyperparameters are perturbed by a small \delta . There is a drastic change between the panels in the gradient distributions. The drastic difference is an indication that for parametric distributions, hyperparameter selection is an important and often overlooked inductive bias. Motivated by this experiment, we asked whether there was a way to find optimal hyperparameters for any given ansatz and quantum task. To answer this question, we outline an evolutionary search (ES) driven algorithm that finds optimal hyperparameters given an ansatz and a quantum task. We further study the effectiveness of different “score functions” (also presented in this work) for different distributions and task settings. In brief, we make the following contributions in our paper: • We study the role of initializing distribution hyperparameters and their subtle contribution to overall performance of PQCs across different quantum tasks. • We propose an evolutionary search based algorithm to estimate hyperparameters for any given PQC and quantum task. Our algorithm is engineered to consume less resources and be fast with access to parallel programming. • We also study the impact of finding optimal hyperparameters on the barren plateau phenomenon in PQCs. (a) \bm{\theta}\sim\text{Beta}(\alpha=0.1,\beta=1.5 ) (b) \bm{\theta}\sim\text{Beta}(\alpha=0.1+\delta,\beta=1.5+\delta ) (c) \bm{\theta}\sim\mathcal{N}(\mu=0.0,\sigma=0.5 ) (d) \bm{\theta}\sim\mathcal{N}(\mu=0.0+\delta,\sigma=0.5+\delta ) Fig. 1 : Normalized histogram of gradient magnitude distribution of initial parameters across different layers in a 5 layer, 4 qubit Hardware Efficient Ansatz (HEA). The hyperparameters for the distribution are perturbed by \delta=0.05 . The figures show that even a small change in hyperparameters of initializing distribution can lead to drastically different gradient distribution across layers of a quantum circuit. II Hyperparameter Optimization Algorithm II-A Score Functions Hyperparameter search is an indirect optimization problem in the sense that we cannot directly choose the best hyperparameter through a cost function. This leads us to the concept of “score functions”. Abstractly, a score function \mathcal{S}:\mathbb{R}^{d}\mapsto\mathbb{R} is a class of functions that assign scalar values indicating the utility of the chosen hyperparameters. The role of score functions in general is to help us assess the usefulness of the input. In classical machine learning, the score functions are often modeled as the negative log likelihood loss function. In the case of PQCs however, there are two tightly coupled components. The first is the parameterized circuit which produces an output \rho({\bm{\theta}}) and the second is the chosen observable O . If we choose the obvious score function, i.e., \mathcal{S}(\bm{\theta})=Tr[\rho(\bm{\theta})O] then we implicitly condition the score on both the chosen parameters and the choice of the observable . Clearly, there are infinitely many ways to combine different hyperparameters and observables. Any search algorithm cannot clearly terminate in reasonable time for such a combinatorial search space. We propose to utilize a score function that can be tied to the ansatz instead of the choice of observable. This reduces the complexity of search space and enables a search algorithm to finish in reasonable time. We can additionally pair such a score function with some metric that quantifies the performance on the given quantum task. The combined information then represents an interpolation between the inductive biases specific to the ansatz and it’s performance given a particular observable and cost function. One attractive metric for the ansatz specific score function is the Quantum Fisher Information Matrix(QFIM) [ 7 ] . For a pure parameterized state |\psi(\bm{\theta})\rangle , the QFIM is four times the Quantum Metric Tensor(QMT): \mathcal{F}_{\mu\nu}(\bm{\theta})=4Re\big(\langle\partial_{\mu}\psi|\partial_{\nu}\psi\rangle-\langle\partial_{\mu}\psi|\psi\rangle\langle\psi|\partial_{\nu}\psi\rangle\big) (1) Where |\partial_{\mu}\psi\rangle=\frac{\partial}{\partial\theta_{\mu}}|\psi(\bm{\theta})\rangle is the derivative w.r.t the \mu^{th} component of the parameter vector and |\psi\rangle represents the parameterized state |\psi(\bm{\theta})\rangle . For a mixed state \rho(\bm{\theta}) , the QFIM is: \displaystyle\mathcal{F}_{\mu\nu}(\bm{\theta}) \displaystyle=\frac{1}{2}Tr[\rho(\bm{\theta})\{\mathcal{L}_{\mu},\mathcal{L}_{\nu}\}] \displaystyle=\sum_{m,n(\lambda_{m}+\lambda_{n}>0)}2\frac{Re\big(\langle m|\partial_{\mu}\rho|n\rangle\langle m|\partial_{\nu}\rho|n\rangle\big)}{\lambda_{m}+\lambda_{n}} (2) Here \lambda_{m},\lambda_{n} are the eigenvalues in the spectral basis of \rho(\bm{\theta}) . The key property of QFIM (that we are interested in) is that for unbiased estimators \hat{\bm{\theta}} : Cov(\hat{\bm{\theta}})\geq(\mathcal{F}_{\mu\nu}^{O_{x}})^{-1}\geq(\mathcal{F}_{\mu\nu})^{-1} (3) Where \mathcal{F}_{\mu\nu}^{O_{x}} is the QFIM associated with an observable O_{x}\in\{O_{1},O_{2}\dots O_{N}\} . The relation tells us that \mathcal{F}_{\mu\nu}=\sup_{O}\mathcal{F}_{\mu\nu}^{O} . The upshot of the discussion is this: QFIM allows