Post-processing optimization and optimal bounds for non-adaptive shadow tomography

Andrea Caprotti, Joshua Morris, Borivoje Dakić · 2026

Read Post-processing optimization and optimal bounds for non-adaptive shadow tomography by Andrea Caprotti, Joshua Morris, Borivoje Dakić (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16266.txt.

Introduction

Andrea Caprotti, Joshua Morris and Borivoje Dakić study free choice in shadow sums. Their 2026 preprint deals with shadow tomography, a way to learn state traits from few reads. Rich read sets give more traits than the least set can. They also leave a pure classic free choice in the rebuild. The same trait can be built in end less ways from the same data.

The team seeks the best choice for a set task. Best means the least noise in the trait read from data. A good post step can lift gains with no new reads. That gain is free in gear terms and pure in code. The work sharpens a cheap step in quantum reads.

Catalog record

CREATORAndrea Caprotti, Joshua Morris, Borivoje Dakić
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-16266

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Post-processing optimization and optimal bounds for non-adaptive shadow tomography Andrea Caprotti, Joshua Morris, Borivoje Dakić Abstract Informationally overcomplete POVMs are known to outperform minimally complete measurements in many tomography and estimation tasks, and they also leave a purely classical freedom in shadow tomography: the same observable admits infinitely many unbiased linear reconstructions from identical measurement data. We formulate the choice of reconstruction coefficients as a convex minimax problem and give an algorithm with guaranteed convergence that returns the tightest state-independent variance bound achievable by post-processing for a fixed POVM and observable. Numerical examples show that the resulting estimators can dramatically reduce sampling complexity relative to standard (canonical) reconstructions, and can even improve the qualitative scaling with system size for structured noncommuting targets. I Introduction Quantum state tomography 12 remains crucial for the characterization of quantum states in multipartite systems, but is hindered in practicality by the prohibitive resource requirements 38 ; 17 ; 1 ; 28 . Shadow tomography 1 , and the subsequent adaptation with classical shadows 21 ; 33 , have been proposed as an alternative to characterizing multiple properties of the state simultaneously, following a “measure first, ask questions later” paradigm. While many adaptations akin to this spirit 19 ; 13 ; 22 ; 36 ; 9 ; 7 ; 18 ; 51 ; 41 ; 48 ; 30 ; 4 ; 8 ; 3 ; 27 ; 32 ; 29 ; 24 ; 35 ; 14 ; 49 have been proposed to further improve the computational and experimental overhead, these mostly consider the “measure first” aspect, aiming to optimize the demand on quantum operations 40 ; 2 ; 20 ; 37 ; 50 ; 45 ; 43 ; 25 ; 34 ; 16 ; 44 ; 47 . Only recently has there been a growing interest concerning the “ask questions later”, with the realization that there are different strategies to answer the same question from previously sampled data 5 ; 23 ; 31 ; 15 . This freedom in data processing is used to adapt the measurement analysis based on the specific task in order to reduce estimator variance, and constitutes an indirect way of reducing the overall degree of quantum information processing demanded. This work expands on the concept of post-processing optimization and determining optimal estimators based on the target by introducing a robust convex optimization algorithm for constructing the estimator itself, forming a task-adaptive design problem that can be solved after data acquisition. Once a measurement scheme has been chosen and corresponding measurements have been sampled, we show that any remaining degrees of freedom in the problem live entirely within the post-processing space . One is then free to choose among infinitely many coefficient vectors \vec{x} that satisfy O=\sum_{j}x_{j}E_{j} for some observable O without modifying the underlying experiment (for the case of overcomplete measurements). From classical statistics bounds, the variance of this estimator determines the amount of copies of the state to be prepared and sampled: it therefore represents the ideal figure of merit for an optimization protocol to determine the ideal construction of the estimator. We thus formulate a procedure to identify optimal variance as a minimax convex problem with guaranteed convergence , thereby producing the tightest non-adaptive, state-independent variance bound attainable by classical post-processing for a fixed measurement scheme. Our numerical examples indicate that variance-optimal post-processing can change not only prefactors but also the scaling of sampling complexity with system size, including regimes with pronounced qualitative improvements over canonical estimators 11 . In particular, we identify regimes where the variance bound exhibits sub-exponential scaling, in contrast to the exponential behavior predicted by canonical estimators. The paper is structured as follows: Section II is dedicated to the role of post-processing in linear estimation, where in particular in Section II.1 we describe the current attempts at post-processing optimization, in Section II.2 we highlight the reconstruction freedom in the context of the classical shadow protocol and in Section II.3 we present the algorithm which uses the identified freedom to determine the optimal post-processing procedure for a given linear estimation task. Then, relevant results are introduced: in Section III.1 we show the optimal estimation of product observables with a restricted POVM, which presents an exponential improvement compared to the canonical reconstruction; moreover, in Section III.2 we present the case of the sum of local observables on a spin chain. Finally, Section IV gives an outlook on the possible extensions of the current algorithm to a wider range of post-processing tasks. II Post-processing optimization II.1 State-of-the-Art In linear tomography, the experimental layer fixes a measurement scheme -typically a POVM \{E_{j}\}_{j=1}^{n} - while the final estimate of a target quantity is produced by classical data processing. The central observation behind post-processing optimization is that, once the POVM is fixed and outcomes have been sampled, the mapping from the observed frequencies \hat{f}_{j} into an estimator \hat{o}=\sum_{j=1}^{n}\hat{f}_{j}\,x_{j} generally allows a nontrivial freedom, as the coefficients x_{j} are not unique as long as the set of POVM effects are linearly dependent (overcomplete). In other words, overcompleteness induces a “gauge freedom” in post-processing which can be exploited without any change to the experiment. The relevance of optimizing this classical layer predates classical shadows. In the seminal works on linear estimation by D’Ariano 10 ; 11 , the problem is framed explicitly as the choice of data-processing functions (reconstruction coefficients) for POVMs and it is shown how one can reduce estimation noise by optimizing the processing of redundant measurements within the family of unbiased reconstructions. This line of work established that “how we reconstruct” is part of the experimental design space, even when the hardware is fixed. A key message for full-state estimation was later sharpened by Zhu 52 : informationally overcomplete POVMs can yield a quantitative advantage over minimal informationally complete measurements. The further relevant point is that the target-agnostic “canonical” estimator does not appear to be optimal, with optimality being heavily dependent on the figure of merit (e.g. estimator variance). The measurement-frame formulation developed in 37 ; 23 collects and further hones these ideas, also bringing the classical shadow protocol 21 ; 33 under such unified framework. The standard classical-shadows estimator corresponds in fact to the canonical choice of reconstruction, which is natural and broadly applicable but generally non-optimal for any given target. Only recently has overcompleteness systematically begun to be exploited as an effective optimization resource 5 ; 31 ; 15 . These works emphasize the complementary aspects: (i) explicit parameterizations of the homogeneous freedom in the inversion map and observable-dependent optimization leading to sharp improvements and scaling separations 5 , (ii) data-driven (empirical) optimization of duals tailored to target tasks, including practical strategies to avoid bias when the same data is used for tuning and estimation 31 , and (iii) systematic investigations of families of optimized approximate dual frames -including marginal constructions and regularized empirical duals- aimed at achieving improvements under realistic computational constraints 15 . Taken together, these results establish that “measure first, ask later” should be complemented by “ process later, but process optimally .” In the classical-shadows context, much of the literature uses the shadow norm 21 as a convenient, state-independent upper bound controlling sample complexity. While powerful, such bounds may be loose for a given

Read the complete text