Autoregressive pairwise Graphical Models efficiently find ground state representations of stoquastic Hamiltonians

Yuchen Pang ∗, Abhijith Jayakumar ∗, Evan McKinney, Carleton Coffrin, Marc Vuffray, Andrey Y. Lokhov · 2025

Read Autoregressive pairwise Graphical Models efficiently find ground state representations of stoquastic Hamiltonians by Yuchen Pang ∗, Abhijith Jayakumar ∗, Evan McKinney, Carleton Coffrin, Marc Vuffray, Andrey Y. Lokhov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06798.txt.

Introduction

Yuchen Pang and five co-authors model quantum ground states in a 2025 physics paper. Many quantum systems settle into a lowest energy pattern. Writing that pattern in compact form is a core task for simulators. Their model builds the pattern step by step, one part at a time.

Tests on small systems show pair links carry most of the weight. Guided by that, the team used simple pair based models for larger systems. Cheap gradient training often beat fancier models trained at higher cost. Frustrated systems, where demands clash, also yielded to the simple model. It reached the energy floor faster under tight computing budgets. The authors pitch the approach for near term quantum simulation work.

Catalog record

CREATORYuchen Pang ∗, Abhijith Jayakumar ∗, Evan McKinney, Carleton Coffrin, Marc Vuffray, Andrey Y. Lokhov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-06798

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Autoregressive pairwise Graphical Models efficiently find ground state representations of stoquastic Hamiltonians Yuchen Pang ∗, Abhijith Jayakumar ∗, Evan McKinney, Carleton Coffrin, Marc Vuffray, Andrey Y. Lokhov Abstract We introduce Autoregressive Graphical Models (AGMs) as an Ansatz for modeling the ground states of stoquastic Hamiltonians. Exact learning of these models for smaller systems show the dominance of the pairwise terms in the autoregressive decomposition, which informs our modeling choices when the Ansatz is used to find representations for ground states of larger systems. We find that simple AGMs with pairwise energy functions trained using first-order stochastic gradient methods often outperform more complex non-linear models trained using the more expensive stochastic reconfiguration method. We also test our models on Hamiltonians with frustration and observe that the simpler linear model used here shows faster convergence to the variational minimum in a resource-limited setting. § § footnotetext: Equal contribution I Introduction Approximating ground states of many-body quantum systems, in general, is known to become computationally intractable as the number of particles in the system increases. Nevertheless, computational methods currently remain the only feasible way to study the ground state properties of most quantum models. In the recent years, researchers have adopted and extended methods from machine learning to tackle this specific problem. The most popular of these approaches involves using a neural network (NN) as a variational Ansatz for the ground state wave function. The variational parameters of the net are then optimized using the well-known Variational Monte Carlo (VMC) method [ 5 , 41 , 31 , 6 ] . Unlike tensor network based methods, neural network quantum states have been observed to be capable of efficiently representing states that have a volume law entanglement [ 13 ] . This makes these neural nets an effective, complementary approach to tensor network methods for the problem of finding ground states. The success of this type of methods depend crucially on choosing the right neural net to represent the state. The network must be able to approximate the true ground state for some choice of the variational parameters. While the universal approximation theorem for neural nets guarantees that this condition will be satisfied if we take a large enough network [ 49 ] , it is unclear if an effective representation for ground states can be learned using a simpler Ansatz that could be advantageous in data-limited setting. The use of neural nets as a variational Ansatz was pioneered by Carleo and Troyer [ 5 ] , who used a Restricted Boltzmann machine architecture to find the ground states of spin Hamiltonians using VMC. Since then there have been a vast number of works that used the framework proposed in [ 5 ] , with different NN architectures on a variety of related problems [ 26 , 10 , 8 , 9 , 42 , 25 ] . Notably, many NN architectures have been introduced which implicitly respect symmetries of the model being solved [ 46 , 37 ] , like the use of CNNs for models with translational invariance [ 10 ] . Since no single Ansatz can be expected to work well for all models and for all regimes, it is important to look at these methods more carefully and understand their drawbacks [ 39 , 44 ] . For instance, an MPS Ansatz for a state can be expected to perform poorly near a quantum critical point where long-range correlations are be present. NNs are not easy to understand in this regard as they are essentially black boxes. Given a specific NN architecture it would be difficult to assess why it performs better in one case as opposed to another. Ideally, there must exist some way to choose an Ansatz without performing a painstaking search over architectures. We would like this search to be replaced by some simpler procedure that would guide our intuition. Recently, classical energy-based representations have been proposed to model the ground states of quantum multi-body Hamiltonians [ 20 ] . This classical Gibbs representation is tightly connected to the concept of undirected graphical models. In these models, a graph encodes conditional independence relationships in the following way: any single variable in the model is conditionally independent of the rest of the graph given its neighbors. This conditional dependency structure thus allows us to represent these distributions using very few parameters [ 32 , 12 ] . This is a desirable property, because physical systems often display such sparsity properties at the level of the Hamiltonian while this sparsity might not be evident when looking at the probability distribution representing these systems. Moreover, these classical thermal distributions are explicitly learnable using low-complexity algorithms [ 48 , 27 , 47 , 17 , 19 ] , and the emerging effective temperature of the learned energy function serves as a metric that quantifies the hardness of learning of different classes of quantum states [ 20 ] . In energy-based modeling, energy functions can be specified by a small number of parameters using an explicit low-degree polynomial or a generic parametric family such as neural nets. These choices naturally provide a trade-off between simplicity and generality of the representation. One of the main drawbacks of using Graphical Models in representing probability distributions is the lack of exact sampling algorithms that can efficiently produce uncorrelated samples from the model. Learned energy-based representations directly produce conditional probabilities that can be directly used in Markov chain Monte Carlo methods [ 20 ] . However, commonly used Markov chain methods can often take an exponentially long time to produce independent samples. This issue is especially severe for models with frustration where the Markov chain can get stuck in meta-stable states far from the stationary distribution [ 29 , 24 ] . On the other hand autoregressive models [ 42 , 52 ] , provide a way to model distributions such that independent samples can be efficiently produced. But these models are generally constructed using a non-local marginalization procedure that usually doesn’t respect the conditional independence structure of the distribution. In this work, we build on the energy-based modeling approach and propose a new variational Ansatz for stoquastic Hamiltonians that we call Autoregressive Graphical Model (AGM). With the AGM model, we will combine both the representation power of GMs and the sampling efficiency of the autoregressive models. This representation is flexible enough to incorporate non-linear parametrizations like neural networks [ 20 ] , but the focus of this work will be on explicit polynomial modeling of the energy function that provides interpretability. We use an exact learning procedure to find the true autoregressive model corresponding to the ground states of smaller systems. The information obtained from these smaller experiments can then be used to understand the applicability of this Ansatz for larger systems. We find from exact learning that autoregressive model representing ground states of different models are dominated by pairwise interactions. Subsequently, we show that a simple pairwise energy Ansatz used in the autoregressive framework is sufficient to capture the ground state properties of a variety of stoquastic quantum models including those with frustration. Interestingly, the resulting emerging model is reminiscent of the well-studied Jastrow wavefunction Ansatz which has been used to model correlations in

Read the complete text