Theory of direct measurement of the quantum pseudo-distribution via its characteristic function Andrew N. Jordan, David R. M. Arvidsson-Shukur, Aephraim M. Steinberg Abstract We propose a method for directly measuring the quantum mechanical pseudo-distribution of observable properties via its characteristic function. Vandermonde matrices of the eigenvalues play a central role in the theory. This proposal directly finds the pseudo-distribution using weak measurements of the generator of position moments (momentum translations). While the pseudo-distribution can be extracted from the data in a theory-agnostic way, it is shown that under quantum-mechanical formalism, the predicted pseudo-distribution is identified with the Kirkwood-Dirac pseudo-distribution. We discuss the construction of both the joint pseudo-distribution and a conditional pseudo-distribution, which is closely connected to weak-value physics. By permuting position and momentum measurements, we give a prescription to directly probe the canonical commutation relation and verify it for any quantum state. This work establishes the theory of a characteristic function approach to pseudo-distributions, as well as providing a constructive approach to measuring them directly. I Introduction The non-commutation of certain observables in quantum physics indicates that the joint assignment of their properties cannot be made unambiguously — a measurement of one observable is guaranteed to modify the value of the other Jordan and Siddiqi 2024 . Consequently, one generally cannot describe a quantum state as a joint probability distribution with respect to several observables. One can, however represent a quantum state by a pseudo-distribution with respect to non-commuting observables. A pseudo-distribution is similar to a joint probability distribution: it normalises to 1 and it produces the correct Born-rule probabilities. However, a pseudo-distribution may have negative or non-real entries. There are many pseudo-distributions. Examples include the Wigner function Wigner 1932 , the Kirkwood-Dirac Kirkwood 1933 ; Terletsky 1937 ; Dirac 1945 distributions, the Husimi “Q” function Husimi 1940 , and the Glauber-Sudarshan “P” function Glauber 1963 ; Sudarshan 1963 . A pseudo-distribution, together with a corresponding description of transformations and measurements, forms a representation of quantum experiments. Such pseudo-probability descriptions have been found useful in a wide variety of contexts, including “direct” measurements of the wavefunction Lundeen et al. 2011 and density matrix Thekkadath et al. 2016 , quantum metrology Hofmann 2011 ; Arvidsson-Shukur et al. 2020 ; lup , weak value amplification Aharonov et al. 1988 ; Hosten and Kwiat 2008 ; Dixon et al. 2009 ; Dressel 2015 ; Dressel et al. 2014 ; Jordan and Siddiqi 2024 , quantum thermodynamics Yunger Halpern 2017 ; Levy and Lostaglio 2020 , quantum optics in phase space sha ; Schleich 2015 , and foundational issues in quantum mechanics mir ; Williams and Jordan 2008 ; Bednorz et al. 2012 ; Pusey 2014 ; Kunjwal et al. 2019 . For a detailed recent review of the Kirkwood-Dirac distribution and its applications, see Ref. Arvidsson-Shukur et al. 2020 . While pseudo-probabilistic representations of quantum mechanics have been of tremendous use, several puzzles remain. First, why are there many of them? When analyzing quantum experiments, which pseudo-distribution should be applied? These questions are particularly interesting with respect to a well known result connecting genuine non-classical phenomena (in the form of generalised contextuality Spekkens 2005 ) to negativity in quasi-probabilistic representations. If an experiment’s preparation, transformation and measurement cannot be described by any positive quasi-probabilistic representation, then that experiment is genuinely non-classical Spekkens 2008 . In general, this result is hard to apply; there are an infinite number of pseudo-distribution to check. However, might some experiments admit a theory-independent way to reconstruct a unique pseudo-distribution from measured data, without a priori assumptions of its form? We consider an experiment with three consecutive events in time: prepare, measure, and re-measure. (1) A quantum system is prepared in an initial state \psi . (2) A non-invasive generalized measurement (e.g. a “weak measurement” Aharonov et al. 1988 ) measures the expectation value \langle\hat{A}^{n}\rangle of some power n of an observable \hat{A} . We label the physical (eigen)values (assumed non-degenerate) of the operator by a_{i} . (3) The system is subject to a projective fine-grained measurement in some basis \{|b_{j}\rangle\} . Further, we allow the experimentalist to post-select the data conditioned on the outcomes from the final measurement, thus applying a final boundary condition. In other words, the experimentalist can ask: What is the expectation value of observable \hat{A}^{n} conditioned on preparation in state |\psi\rangle and a final outcome corresponding to |\phi\rangle=|b_{j^{\prime}}\rangle ? If the experiment were classical, one would describe the pre- and post-selected system with some conditional probability distribution P_{i|j}(\psi) . For all n , the conditional expectation values would be given by \sum_{i}P_{i|j}(\psi)a_{i}^{n} . In quantum mechanics, instead, the pre- and post-selected system can be described by a conditional pseudo-distribution Q_{i|j}(\psi) . But what specific form does Q_{i|j}(\psi) take? And how can we infer the generally complex-valued Q_{i|j}(\psi) from experiments? In this Article, we address both these questions. We show that if one requires that the form of the classical conditional expectation value apply also to the quantum scenario, then Q_{i|j}(\psi) takes a unique form. In other words, if the conditional expectation value of \hat{A}^{n} is to be given by \sum_{i}Q_{i|j}(\psi)a_{i}^{n} , then we predict that the experimental data forces Q_{i|j}(\psi) to be a Kirkwood-Dirac pseudo-distribution (defined below). Furthermore, we detail how measurements of the powers of an operator enable the determination of the underlying quasi-probabilistic characteristic function. This enables the direct inference of the the underlying pseudo-distribution. We then extend our analysis from conditioned expectation values to general correlation functions, and give a prescription to uniquely determine more general pseudo-distributions. Our efficient method is in contrast to previous methods to measure pseudo-distributions, which relied on scanning weak measurements over all eigenprojectors of \hat{A} and sharp measurements in the \{|b_{j}\rangle\} basis Arvidsson-Shukur et al. 2024 . The remainder of this article is organized as follows. In Sec. II we review some important background information about properties of pseudo-distributions in quantum physics, focusing on the Kirkwood-Dirac distribution. In Sec. III , we explore finite dimensional Hilbert spaces, and make an analysis of constructing pseudo-distributions using data from a finite set of moment measurements of a given observable. Connections to weak values are made. In subsection III.1 , a qubit example is given to illustrate the theory, and we show how the conditional pseudo-distribution is related to weak values of eigenstate projectors. In subsection III.2 , we extend the analysis to measuring moments of two (non-commuting) observables and finding the joint pseudo-distribution of the two outcomes. Generalizations are made to an arbitrary number of measurements in subsection III.3 . In Sec. IV , we consider continuous variable systems and develop a generalization of our discrete variable method. We show how a characteristic function can be defined and that the pseudo-distribution can be calculated via its Fourier transform. In Sec. V an experiment is proposed that directly measures the generating function of moments of position, with a subsequent measurement of momentum. Methods for finding both conditional and joint pseudo-distributions are given. We also give a prescription for validating the canonical commutation relation for any state. II Background Before we present our analysis, we outline some theoretical background material. For now, we work on a finite Hilbert space \mathcal{H} of dimensionality d . Extensions to continuous-variable systems are straightforward. Consider two non-degenerate observables represented by the Hermitian operators \hat{A}=\sum_{i}a_{i}|a_{i}\rangle\langle a_{i}| and \hat{B}=\sum_{j}b_{j}|b_{j}\rangle\langle b_{j}| . Here, a_{i} and b_{j} denote eigenvalues and |a_{i}\rangle and |b_{j}\rangle their corresponding eigenvectors. In what follows, we assume for simplicity that \hat{A} and \hat{B} are fully incompatible in the sense that \langle a_{i}|b_{j}\rangle\neq 0 for all i,j . Violations of this assumption can be handled by infinitesimal tilts of the operators. The observable bases of \hat{A} and \hat{B} provide alternative ways of representing a quantum state \hat{\rho} . For example, one can define two related bases, known as the primary frame and the dual frame , for operators on \mathcal{H} : \hat{F}_{i,j}=|a_{i}\rangle\langle a_{i}|b_{j}\rangle\langle b_{j}|,\;\text{and}\;\hat{G}_{i,j}=\frac{|a_{i}\rangle\langle b_{j}|}{\langle b_{j}|a_{i}\rangle}. (1) We note that \text{Tr}(\hat{F}_{i,j}\hat{G}^{\dagger}_{i^{\prime},j^{\prime}})=\delta_{i,i^{\prime}}\delta_{j,j^{\prime}} . The Kirkwood-Dirac pseudo-probability representations for a state \hat{\rho} and an observable \hat{X} are then given by K_{i,j}(\hat{\rho})=\text{Tr}(\hat{F}_{i,j}^{\dagger}\hat{\rho})=\langle b_{j}|a_{i}\rangle\langle a_{i}|\hat{\rho}|b_{j}\rangle, (2) and T_{i,j}(\hat{X})=\text{Tr}(\hat{G}_{i,j}^{\dagger}\hat{X})=\frac{\langle a_{i}|\hat{X}|b_{j}\rangle}{\langle a_{i}|b_{j}\rangle}, (3) respectively. K_{i,j}(\hat{\rho}) and T_{i,j}(\hat{X}) are informationally complete. For example, if one knows K_{i,j}(\hat{\rho}) , one can reconstruct \hat{\rho} : \hat{\rho}=\sum_{i,j}K_{i,j}(\hat{\rho})\hat{G}_{i,j}. (4) K_{i,j}(\hat{\rho}) is normalized and produces the correct Born-rule probabilities: \sum_{j}K_{i,j}(\hat{\rho})=\langle a_{i}|\hat{\rho}|a_{i}\rangle,\ \sum_{i}K_{i,j}(\hat{\rho})=\langle b_{j}|\hat{\rho}|b_{j}\rangle, (5) and the joint sum giving unity. Moreover, the expectation value of \hat{X} with respect to \hat{\rho} is given by a quasi-probabilistic weighted average: \text{Tr}(\hat{X}\hat{\rho})=\sum_{i,j}T_{i,j}^{\dagger}(\hat{X})K_{i,j}(\hat{\rho}). (6) For some states, K_{i,j}(\hat{\rho})\in[0,1] for all i,j . Then, K_{i,j}(\hat{\rho}) equals a standard joint probability distribution. However, in general, K_{i,j}(\hat{\rho}) takes values in the complex unit disc. Non-real and negative values in K_{i,j}(\hat{\rho}) have been connected to a range of non-classical phenomena Arvidsson-Shukur et al. 2024 . The Kirkwood-Dirac distribution K_{i,j} satisfies a quasi-probabilistic version of Bayes’ theorem (different to the version exhibited by SIC-POVMs Med ). One can condition K_{i,j} on a specific eigenvalue of the \hat{B} observable. The conditional distribution is K_{i|j}(\hat{\rho})=K_{i,j}(\hat{\rho})/\langle b_{j}|\hat{\rho}|b_{j}\rangle. (7) If \hat{\rho}=|\psi\rangle\langle\psi| is pure, then K_{i|j}(\psi)=\frac{\langle b_{j}|a_{i}\rangle\langle a_{i}|\psi\rangle}{\langle b_{j}|\psi\rangle}. (8) K_{i|j}(\psi) is a weak value of the projector observable |a_{i}\rangle\langle a_{i}| Aharonov et al. 1988 ; Dressel et al. 2014 ; Jordan and Siddiqi 2024 . Conceptually, K_{i|j}(\psi) represents the conditional expectation value of |a_{i}\rangle\langle a_{i}| with respect to an initial state |\psi\rangle that is post-selected to be in the state |b_{j}\rangle . The weak value of a general observable \hat{C} is \langle\hat{C}\rangle^{\psi}_{b_{j}}=\frac{\langle b_{j}|\hat{C}|\psi\rangle}{\langle b_{j}|\psi\rangle}. (9) Weak values can be measured as conditioned averages in the weak measurement limit Aharonov et al. 1988 ; Dressel et al. 2014 ; Jordan and Siddiqi 2024 . From Eq. ( 7 ) it is clear that if one measured K_{i|j}(\hat{\rho}) for all i,j and the marginal probabilities \langle b_{j}|\rho|b_{j}\rangle , then one could reconstruct K_{i,j}(\hat{\rho}) , and thus \hat{\rho} . However, this requires the estimation of the d\times d combinations of all i and j . Below, we will outline a methodology for measuring d-1 post-selected expectation values of the powers of \hat{A} . This methodology uniquely determines all the entries of any reasonable choice of Q_{i,j} to represent the data. Moreover, we find that this unique choice of Q_{i,j} is the Kirkwood-Dirac distribution K_{i,j} . III Pseudo-Distribution Construction method We consider many repetitions of the following three-step experiment. First, we prepare a quantum system in an initial state |\psi\rangle . Second, we conduct a weak (infinitesimally perturbing) measurement of the system’s expectation value \langle\hat{A}^{n}\rangle , where we vary n from 0 to d-1 , where d is the dimensionality of the Hilbert space. Third, we conduct a strong measurement of the observable \hat{B} such that the quantum system is projected onto a vector in the \{|b_{j}\rangle\} basis. Quantum theory tells us that the observed expectation value of \hat{A}^{n} with respect to an initial state |\psi\rangle and a final state |b_{j}\rangle is given by Eq. ( 9 ) with {\hat{C}}={\hat{A}}^{n} . Classically, a conditional expectation value of \hat{A}^{n} is \langle{\hat{A}}^{n}\rangle^{\psi}_{b_{j}}=\sum_{i=1}^{d}(a_{i})^{n}P_{i|j} for all n . Here, P_{i|j} is the classical system’s conditional probability distribution. Consequently, if we wish to describe the quantum-mechanical conditional expectation value of any moment of an operator [Eq. ( 9 )] with a pseudo-statistical theory where Q_{i|j} takes the role of P_{i|j} , then we have that \displaystyle\langle{\hat{A}}^{n}\rangle^{\psi}_{b_{j}}=\sum_{i=1}^{d}(a_{i})^{n}Q_{i|j}=\frac{\langle b_{j}|{\hat{A}}^{n}|\psi\rangle}{\langle b_{j}|\psi\rangle},\text{ for all }n, (10) Here, the first equality follows from the assumption that any conditional pseudo-distribution exists, while the second follows from quantum weak-value theory. Next, we show that such a Q_{i|j} exists that reproduces the data from our three-step experiment. Moreover, we show how to use our experiment to uniquely determine Q_{i|j} . Equation ( 10 ) can be represented as a matrix equation. Let us define a d -dimensional column vector {\vec{A}} that we use the organize the conditioned data. The k th element of {\vec{A}} is the (conditioned) average of \hat{A}^{k-1} [Eq. ( 9 )]. That is, {\vec{A}}_{k}=\langle{\hat{A}}^{k-1}\rangle^{\psi}_{b_{j}} , where k\in[1,\ldots,d] . Similarly, we define the column vector {\vec{Q}} such that \vec{Q}_{k}=Q_{k|j} , where k\in[1,\ldots,d] are the elements of the pseudo-distribution. We then have the matrix equation {\vec{A}}={\bf V}\cdot{\vec{Q}}. (11) Here, we have defined a real-valued Vandermonde matrix {\bf V} Macon and Spitzbart 1958 consisting of powers of the eigenvalues a_{i} : {\bf V}=\begin{pmatrix}1&1&\ldots&1\\ a_{1}&a_{2}&\ldots&a_{d}\\ a_{1}^{2}&a_{2}^{2}&\ldots&a_{d}^{2}\\ \vdots&\vdots&&\vdots\\ a_{1}^{d-1}&a_{2}^{d-1}&\ldots&a_{d}^{d-1}\end{pmatrix} (12) That is, we have \begin{pmatrix}1\\ \langle{\hat{A}}\rangle^{\psi}_{b_{j}}\\ \langle{\hat{A}}^{2}\rangle^{\psi}_{b_{j}}\\ \vdots\\ \langle{\hat{A}}^{d-1}\rangle^{\psi}_{b_{j}}\end{pmatrix}=\begin{pmatrix}1&1&\ldots&1\\ a_{1}&a_{2}&\ldots&a_{d}\\ a_{1}^{2}&a_{2}^{2}&\ldots&a_{d}^{2}\\ \vdots&\vdots&&\vdots\\ a_{1}^{d-1}&a_{2}^{d-1}&\ldots&a_{d}^{d-1}\end{pmatrix}\begin{pmatrix}Q_{1|j}\\ Q_{2|j}\\ Q_{3|j}\\ \vdots\\ Q_{d|j}\end{pmatrix}. (13) Given empirical data of the real and imaginary parts of {\vec{A}} , we can then make a matrix inversion in order to find the empirical pseudo-distribution: {\vec{Q}}={\bf V}^{-1}\vec{A}. (14) {\bf V} is invertible if its Vandermonde determinate, V=\prod_{1\leq i