ShadowGPT: Learning to Solve Quantum Many-Body Problems from Randomized Measurements

Jian Yao, Yi-Zhuang You · 2024

Read ShadowGPT: Learning to Solve Quantum Many-Body Problems from Randomized Measurements by Jian Yao, Yi-Zhuang You (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-03285.txt.

Description

Abstract We propose ShadowGPT, a novel approach for solving quantum many-body problems by learning from randomized measurement data collected from quantum experiments. The model is a generative pretrained transformer (GPT) trained on simulated classical shadow data of ground states of quantum Hamiltonians, obtained through randomized Pauli measurements.

Catalog record

CREATORJian Yao, Yi-Zhuang You
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-03285

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ShadowGPT: Learning to Solve Quantum Many-Body Problems from Randomized Measurements Jian Yao, Yi-Zhuang You Abstract We propose ShadowGPT, a novel approach for solving quantum many-body problems by learning from randomized measurement data collected from quantum experiments. The model is a generative pretrained transformer (GPT) trained on simulated classical shadow data of ground states of quantum Hamiltonians, obtained through randomized Pauli measurements. Once trained, the model can predict a range of ground state properties across the Hamiltonian parameter space. We demonstrate its effectiveness on the transverse-field Ising model and the ℤ 2 × ℤ 2 \mathbb{Z}_{2}\times\mathbb{Z}_{2} cluster-Ising model, accurately predicting ground state energy, correlation functions, and entanglement entropy. This approach highlights the potential of combining quantum data with classical machine learning to address complex quantum many-body challenges. Introduction. — The quantum many-body problem, such as predicting the ground state properties of a given many-body Hamiltonian, is a central challenge in physics. Traditional numerical methods [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 ] have been developed to tackle these problems from first principles, leveraging fundamental quantum mechanics principles to calculate results from scratch. These methods have achieved remarkable success within their specific application domains. However, challenges remains in general cases due to the inherent complexity of representing generic quantum many-body states on classical computers. Recent advancements in quantum computation, especially with the development of quantum devices and simulators, have illuminated an exciting avenue for tackling quantum many-body problems: using quantum computers to (approximately) prepare ground states of given Hamiltonians, using techniques such as adiabatic state preparation [ 10 , 11 ] or variational quantum eigensolvers [ 12 , 13 , 14 , 15 ] , and then study their physical properties by measurements. Nevertheless, operating these quantum algorithms demands expensive resources, making quantum experimental data highly valuable yet underutilized in terms of its full potential. Recent study [ 16 ] has shown a provable advantage in incorporating quantum data into classical computation. Some quantum many-body problems, challenging or even intractable for classical algorithms alone, can become manageable when augmented by quantum experimental data. This points to a fundamental gap between simulability and learnability —certain quantum systems, while difficult to simulate classically, can have their behaviors efficiently predicted by classical machine learning trained on quantum data. This work aims to explore the possibility of learning from randomized measurement data collected from quantum experiments to build classical predictive model for solving quantum many-body problems. Of course, it should be acknowledged that classical machine learning has its limitations and cannot resolve every aspect of quantum systems. For example, quantum chaotic systems are conjectured to be unlearnable [ 17 , 18 , 19 ] , under the intuition that chaotic behavior is unpredictable, and the learnability transition [ 20 , 21 ] has became an interesting topic of research. Figure 1: Overview of the ShadowGPT approach. Given a Hamiltonian H({\bm{g}}) parametrized by {\bm{g}} , a quantum device prepares the ground state \rho({\bm{g}}) by variational quantum eigensolver (VQE), and measures it by classical shadow tomography (CST) to obtain the shadow data ({\bm{P}},{\bm{b}}) , where {\bm{P}} is the sequence of random Pauli observables and {\bm{b}} is the sequence of measurement outcomes. This data, ({\bm{g}},{\bm{P}},{\bm{b}}) , is then used to train a GPT model to estimate the conditional distribution p_{\text{mdl}}({\bm{b}}|{\bm{P}},{\bm{g}}) , enabling classical machine to generate classical shadows that mimics the quantum device, effectively solving quantum many-body problems in the parameter space. Nevertheless, in this work, we will focus on classically learnable problems [ 22 ] . We assume access to quantum experiments capable of preparing ground states for a family of Hamiltonians and performing randomized measurements [ 23 , 24 , 25 ] on such states. With this setup, can we construct a classical learning algorithm that, based on these quantum-generated data, can predict ground state properties for this family of Hamiltonians? Previous studies, such as those in Ref. 16 , have addressed similar questions but focused on a discriminative task—predicting quantum phase labels from classical shadow [ 26 ] representations of quantum states. Our approach diverges from this by tackling a more challenging generative task, akin to an inverse problem: generating the classical shadow data of an underlying ground state when given the parameters of the parent Hamiltonian. This generative task closely parallels tasks in natural language processing (NLP), specifically in generative modeling of sequential data, making Generative Pre-trained Transformer (GPT) [ 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 , 36 , 37 , 38 , 39 , 40 , 19 ] , a natural candidate for this context. We developed a model, ShadowGPT, trained on simulated ground state classical shadow data for a range of quantum Hamiltonians, as illustrated in Fig. 1 . Once trained, ShadowGPT is capable of extrapolating to unseen Hamiltonians outside its training set, predicting ground state properties via classical shadow tomography. Our model demonstrates solid performance across various predictive tasks, including ground state energy, correlation functions, and entanglement entropy. As a proof-of-principle theoretical study, we generated our training data through simulation rather than quantum experimentation, so our examples do not fully demonstrate the unique advantages of learning from quantum data. However, our approach is extendable in principle to scenarios where simulations are impractical or inefficient, thereby allowing learning to realize its full potential in future quantum-enhanced applications. Task Description. — We consider a family of Hamiltonians H({\bm{g}}) of an N -qubit quantum system, parameterized by a set of parameters {\bm{g}}=(g_{1},g_{2},\cdots) , whose specific form will be examplified later. Let \rho({\bm{g}})=\lim_{\beta\to\infty}\mathrm{e}^{-\beta H({\bm{g}})}/\operatorname{Tr}\mathrm{e}^{-\beta H({\bm{g}})} be the ground state of the Hamiltonian H({\bm{g}}) . We assume access to a quantum device capable of repeatedly preparing \rho({\bm{g}}) for any specified parameter {\bm{g}} and performing measurements on designated observables. Our goal is to use a limited number of quantum experiments (selecting only a few parameter points, with limited samples of quantum states and amounts of measurements) to collect data and train a model on a classical computer that predicts various physical properties of the ground state \rho({\bm{g}}) across the parameter space. Our challenge lies in predicting general properties of \rho({\bm{g}}) without prior knowledge of which properties will ultimately be queried. In the worst-case scenario, this would require learning a full mapping from {\bm{g}} to \rho({\bm{g}}) , which becomes impractical as the complexity of the density matrix scales exponentially with system size. A major breakthrough in recent years, known as classical shadow tomography [ 26 , 41 ] , addresses this issue by utilizing randomized measurement schemes to efficiently learn multiple low-complexity properties of quantum states in a scalable manner. These advances lay the foundation for our proposed approach. Classical Shadow Representation. — Consider the randomized Pauli measurement protocol [ 26 ] , the simplest form of classical shadow tomography, starting with an N -qubit quantum state \rho prepared on a quantum device. Each qubit is independently measured in a randomly chosen Pauli observable P_{i} (for i=1,2,\cdots,N ), where each observable P_{i} is selected from {X,Y,Z} with equal probability. Let the sequence of chosen Pauli observables be denoted as {\bm{P}}=(P_{1},P_{2},\cdots,P_{N}) . This measurement produces a corresponding sequence of outcomes {\bm{b}}=(b_{1},b_{2},\cdots,b_{N}) , where each binary variable b_{i}=\pm 1

Read the complete text