Trainability Beyond Linearity in Variational Quantum Objectives
Gordon Ma, Xiufan Li · 2026
Read Trainability Beyond Linearity in Variational Quantum Objectives by Gordon Ma, Xiufan Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18846.txt.
Introduction
Ma and Li address trainability in variational quantum objectives beyond the standard barren plateau template. They show it admits a fixed observable representation exactly when the loss is affine in the measured statistics. This marks the boundary of the standard concentration based proof template. Beyond the affine regime, a chain rule decomposition reveals three governing factors: model responsivity, loss side signal, and transmittance. Bounded gradient losses inherit suppression, while amplification capable losses can counteract it.
Catalog record
| CREATOR | Gordon Ma, Xiufan Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80660 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18846
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Trainability Beyond Linearity in Variational Quantum Objectives Gordon Ma, Xiufan Li Abstract Barren-plateau results have established exponential gradient suppression as a widely cited obstacle to the scalability of variational quantum algorithms. When and whether these results extend to a given objective has been addressed through loss-specific arguments, but a general structural characterization has remained open. We show that the objective itself admits a fixed-observable representation if and only if the loss is affine in the measured statistics, thereby identifying the exact boundary of the standard concentration-based proof template. Existing transfer results for non-affine losses achieve this reduction under additional assumptions; our characterization implies that such a reduction is not structurally available for a class of non-affine objectives, placing them outside the automatic reach of the existing proof template. Beyond the affine regime, a chain-rule decomposition reveals three governing factors—model responsivity, loss-side signal, and transmittance—and induces a loss-class dichotomy: bounded-gradient losses inherit suppression, while amplification-capable losses can in principle counteract it. In the exponentially wide setting, both classes fail, but for different structural reasons. When the interface is instead designed at polynomial width—exposing coarse-grained statistics rather than individual bitstring probabilities—the exponential-dimensional obstruction is relaxed and the dichotomy plays a genuine role. In a numerical demonstration on a charge-conserving quantum system, the amplification-capable objective produces resolved gradients several orders of magnitude larger than affine and Lipschitz baselines at comparable shot budgets. Over the tested interval, its scaling trend is statistically distinguished from the exponential trend of both alternatives. The boundary is affine; what lies beyond it is a representation-design problem. A cage went in search of a bird. —Franz Kafka, The Zürau Aphorisms I Introduction Barren-plateau theorems concern gradients of expectation-value objectives 13 ; 6 ; 11 . Usually the loss has the form L(\theta)=\operatorname{Tr}\{H\,\rho(\theta)\}, for a fixed observable H and each \theta_{k}\in[0,2\pi) . In this setting each gradient component \partial_{\theta_{k}}L can be written as the expectation of a fixed operator H_{k} . Under deep random circuits, matrix elements of fixed operators concentrate, and gradients decay exponentially. Despite this, many objectives are non-linear in measured statistics — divergences 10 , likelihoods 7 ; 21 , risk functionals 2 . Considerable effort has extended the linear proof machinery to cover specific non-linear losses, typically through bounded-sensitivity assumptions that allow gradient-level transfer from underlying linear expectations 19 . These results are important but non-exhaustive: they establish inheritance for particular loss families under particular conditions, not a universal reduction. The broader question — for which objectives is the fixed-observable reduction structurally available, and what governs gradients when it is not — has remained largely implicit. The structure of the paper is as follows. A fixed-observable representation exists if and only if the loss is affine in measured statistics, relative to a chosen measurement interface (Theorem 1 ). Beyond the affine boundary, gradients are governed by a chain-rule decomposition into three factors: model responsivity, loss-side signal, and transmittance (Section III ). This framework induces a loss-class dichotomy. Bounded-gradient losses inherit suppression from the underlying Jacobian; losses whose feature-space gradients can grow without bound are not subject to the same inheritance and can, in principle, counteract it through the chain rule (Corollary 5 ). But non-linearity alone is not enough: when the measurement interface spans all 2^{n} outcomes, both loss classes fail — the exponentially wide interface itself enforces suppression. Compressing the interface to polynomial width lifts the dimensional obstruction and brings the dichotomy into play. As a numerical demonstration, we showcase the capability of an amplification-capable objective on a charge-conserving quantum system, which produces materially different gradient behavior than affine and Lipschitz baselines, while model-side responsivity emerges as the binding constraint. This frames a representation-design question: under what conditions does the amplification regime become accessible for natural tasks? II The Structural Boundary We formalize when the fixed-observable structure exists. Setup. Let F_{j}(\rho)\mathrel{\mathop{\mathchar 58\relax}}=\operatorname{Tr}(\rho\,O_{j}),\qquad j=1,\dots,m, and collect these expectations into F(\rho)\mathrel{\mathop{\mathchar 58\relax}}=\big(F_{1}(\rho),\dots,F_{m}(\rho)\big)\in\mathbb{R}^{m}. The map F encodes a design choice: it specifies which linear statistics of the quantum state the objective is allowed to depend on. Different choices of \{O_{j}\} expose different summaries of \rho to the classical loss. We refer to this chosen family of statistics as the measurement interface . For a differentiable ansatz \rho(\theta) with parameters \theta\in\mathbb{R}^{P} , define L(\theta)=f(F(\rho(\theta))). We say that f is affine on a region U\subset\mathbb{R}^{m} if there exist a\in\mathbb{R}^{m} and c\in\mathbb{R} such that f(F)=a^{\top}F+c\qquad\text{for all }F\in U. Otherwise, f is non-affine on U . In the special case c=0 , affineness reduces to linearity. We use “affine” rather than “linear” because the fixed-observable template tolerates an additive constant without modification, and the distinction plays no structural role in what follows. Throughout, affineness and non-affineness are understood relative to the chosen measurement interface. Theorem 1 . Let U\subset\mathbb{R}^{m} be a non-empty open set explored by the ansatz, i.e. U\;\subset\;\{F(\rho(\theta))\mathrel{\mathop{\mathchar 58\relax}}\theta\in\mathbb{R}^{P}\}. Then the following are equivalent: 1. There exist H\in\mathrm{span}\{O_{1},\dots,O_{m}\} and c\in\mathbb{R} such that L(\theta)=\operatorname{Tr}(H\,\rho(\theta))+c for all \theta with F(\rho(\theta))\in U . 2. f is affine on U , i.e. there exist a\in\mathbb{R}^{m} and c\in\mathbb{R} such that f(F)=a^{\top}F+c\qquad\text{for all }F\in U. In particular, if f is non-affine on U , then L admits no fixed-observable representation on U relative to the chosen interface. Proof. The direction (2) \Rightarrow (1) is immediate: define H\mathrel{\mathop{\mathchar 58\relax}}=\sum_{j}a_{j}O_{j} and evaluate. We prove the contrapositive of (1) \Rightarrow (2). Suppose, for contradiction, that f is non-affine on U and there exist H\in\mathrm{span}\{O_{1},\dots,O_{m}\} and c\in\mathbb{R} such that L(\theta)=\operatorname{Tr}(H\,\rho(\theta))+c for all \theta with F(\rho(\theta))\in U . Write H=\sum_{j=1}^{m}a_{j}O_{j} for some a\in\mathbb{R}^{m} . Then for every such \theta , f(F(\rho(\theta)))\;=\;L(\theta)\;=\;\operatorname{Tr}(H\,\rho(\theta))+c\;=\;\sum_{j=1}^{m}a_{j}\,\operatorname{Tr}(O_{j}\,\rho(\theta))+c\;=\;a^{\top}F(\rho(\theta))+c. Because the ansatz explores U , every F\in U is attained as F(\rho(\theta)) for some \theta . Hence f(F)=a^{\top}F+c\qquad\text{for all }F\in U, so f is affine on U , contradicting the assumption. \sqcap \sqcup Scope. We restrict throughout to observables fixed a priori —the setting of concentration-based barren-plateau proofs. Theorem 1 identifies the exact boundary of that template relative to the chosen measurement interface: fixed-observable structure exists exactly in the affine regime. Non-affine losses lie on the other side of that boundary. Allowing parameter-dependent observables moves to a different regime: such operators can be constructed post hoc to reproduce local gradients, but they do not provide structural counterexamples to concentration-based plateau theory (Appendix A , Remark A.3 ). Remark. A convenient sufficient condition for the open-region hypothesis is that the feature Jacobian J_{F}(\theta)\mathrel{\mathop{\mathchar 58\relax}}=\partial F/\partial\theta(\theta) have full row rank on an open parameter region; then F is locally open onto feature space, so the ansatz explores an open set of features. Appendix A records the interface-relative formalization and related scope remarks. Prior work and the structural boundary. Prior work around barren plateaus can be read through four interlinked layers. First, a large mitigation literature studies how concentration can be avoided within the standard fixed-observable template, through shallow circuits, local observables, symmetry-preserving ansätze, and systematic initialization strategies 6 ; 20 ; 15 ; 8 ; 12 . Second, a deeper concern has emerged about this program: many provably BP-free constructions appear to owe their trainability to restriction to classically manageable polynomial operator subspaces, effective shallowness, or other classically tame descriptions, while others exhibit superpolynomially few good local minima despite the absence of plateaus, calling into question whether provable BP-freedom inside the