Hybrid between biologically inspired and quantum inspired many-body states

Miha Srdinšek, Xavier Waintal · 2025

Read Hybrid between biologically inspired and quantum inspired many-body states by Miha Srdinšek, Xavier Waintal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-05050.txt.

Introduction

Miha Srdinšek and Xavier Waintal mixed two state-building styles in two thousand twenty-five into a hybrid for quantum many-body problems. Neural networks can express complex quantum states but are loosely structured. Tensor networks are structured and easy to tune, yet costly in two or more dimensions. Their hybrid unit, the perceptrain, borrows from both.

A network of perceptrains forms the trial state, with local tuning in the style of tensor methods, room to grow during tuning, and a compression option. On a ten-by-ten quantum Ising model tied to cold-atom annealers, the method hit very high accuracy for ground state energy with tiny ranks, even near the phase transition.

Catalog record

CREATORMiha Srdinšek, Xavier Waintal
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-05050

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hybrid between biologically inspired and quantum inspired many-body states Miha Srdinšek, Xavier Waintal Abstract Deep neural networks can represent very different sorts of functions, including complex quantum many-body states. Tensor networks can also represent these states, have more structure and are easier to optimize. However, they can be prohibitively costly computationally in two or higher dimensions. Here, we propose a generalization of the perceptron - the perceptrain - which borrows features from the two different formalisms. We construct variational many-body ansatz from a simple network of perceptrains. The network can be thought of as a neural network with a few distinct features inherited from tensor networks. These include efficient local optimization akin to the density matrix renormalization algorithm, instead of optimizing of all the parameters at once; the possibility to dynamically increase the number of parameters during the optimization; the possibility to compress the state to avoid overfitting; and a structure that remains quantum-inspired. We showcase the ansatz using a combination of Variational Monte-Carlo (VMC) and Green Function Monte-Carlo (GFMC) on a 10 × 10 10\times 10 transverse field quantum Ising model with a long range 1 / r 6 1/r^{6} antiferromagnetic interaction. The model corresponds to the Rydberg (cold) atoms platform proposed for quantum annealing. We consistently find a very high relative accuracy for the ground state energy, around 10 − 5 10^{-5} for VMC and 10 − 6 10^{-6} for GFMC in all regimes of parameters, including in the vicinity of the quantum phase transition. We used very small ranks ( ∼ 2 − 5 \sim 2-5 ) of perceptrains, as opposed to multiples of thousand used in matrix product states. The optimization of the energy was robust with respect to the choice of initial conditions and hyper-parameters, in contrast to a common experience when using neural network wave functions. I Introduction Two different sorts of networks are profoundly reshaping the landscape of numerical computations. On one hand, neural networks (biologically inspired) lie at the core of artificial intelligence Vaswani et al. 2023 . On the other hand, tensor networks (quantum inspired), a natural framework to describe complex quantum states, are being increasingly applied in unrelated fields ranging from Plasma physics to turbulence and optimization Nunez Fernandez et al. 2025 . Very roughly speaking, neural networks promise generality and an algorithmic paradigm shift, since a large part of the learning process is still not understood. They seem to have boundless range of applications. Instead, tensor networks promise access to exponentially large objects in a highly structured way. They are built on a well understood data compression, based on entanglement. Tensor networks are perhaps less general than neural networks, but when they can be applied, their internal structure makes them much more powerful. The goal of this article is to explore hybrid networks that retain some of the interesting properties of tensor networks in exchange for some of the added generality of the neural networks. More specifically, both types of networks have been highly successful as variational ansätze for describing the ground states of quantum many-body systems. For one dimensional (1D) systems, Matrix Product States (MPS), also known as tensor trains, together with the associated Density Matrix Renormalization Group algorithm (DMRG) White 1992 ; White and Noack 1992 have allowed one to essentially solve a number of problems with machine precision. MPS are the most studied tensor networks. Their extension to two dimensional (2D) systems, Projected Entangled-Pair States (PEPS), are theoretically very promising but their practical application is hindered by a large computational cost Corboz et al. 2010 , so that two dimensional systems remain in practice very challenging. One could say that these techniques are on the verge of being able to tackle 2D correlated systems Xu et al. 2024 , a central goal of contemporary computational many-body physics. Using neural networks to represent many-body states, the so-called Neural Network Quantum States (NNQS), is much more recent, yet quite significant successes have been demonstrated Carleo and Troyer 2017 ; Kim et al. 2023 ; Lovato et al. 2022 ; Robledo Moreno et al. 2022 ; Vicentini et al. 2019 ; Hibat-Allah et al. 2020 ; Choo et al. 2019 ; Nomura et al. 2017 . These ansätze are very general. The absence of tensor network structure means that one has to resort to Variational Monte Carlo (VMC) to sample the wave function and estimate its energy and gradient with respect to the ansatz parameters. The ground state is found through some variant of (noisy) gradient descent. Although these ansätze are believed to be general enough to capture the ground state accurately, the challenge is in the optimization which can become a very challenging task Chen and Heyl 2024 . This is a consequence of the non-physicality, a.k.a. over generality, of the ansatz, with up to hundreds of thousands of parameters. Also, the structure of the ansatz is typically fixed at the beginning of the calculation, and it is not straightforward to dynamically change the number of parameters of the ansatz Dash et al. 2025 , a feature at the root of the success of DMRG. Overall, variational ansätze used in VMC seem to follow some sort of ”expressivity-trainability” duality: the more general (”expressivity”) the ansatz in terms of its (lack of) structure and bare number of parameters, the more likely it will be able to approach an arbitrary ground state, but at a cost of being more difficult to optimize (”trainability”). In that respect, there is probably some room between the rigid structure of MPS and the highly general neural networks such as transformers which are expressive enough to represent a many-body ground state and a large language model. To try and address this interplay, we build what we shall call a ”perceptrain”, a sort of perceptron that uses internally a tensor train. Then we make a simple many-body ansatz by building a simple neural network of perceptrains. This work bares some similarities with other recent VMC calculations including tensor networks ansätze such as PEPS Sandvik and Vidal 2007 ; Liu et al. 2021 ; Naumann et al. 2024 , Tensorial Neural Networks (TNN) Wang et al. 2023 , MPS Sandvik and Vidal 2007 , and also with the so-called String Bond States (SBS) ansatz Sfondrini et al. 2010 ; Schuch et al. 2008 ; Glasser et al. 2018 . The paper is structured as follows. In Section II we introduce the perceptrain and comment on the new features it brings to a network. In Section III we discuss how several perceptrains can be used to construct many-body wave functions. We propose a tailored optimization path for these ansätze, reminiscent of the DMRG algorithm. In Section IV we use the ansatz to solve a 10\times 10 transverse field quantum Ising model. In Section V we explain more technical details about spontaneous symmetry breaking in VMC, our GFMC benchmark, and compare different optimization approaches. Finally, in Section VI we share our concluding remarks. II From perceptron to perceptrain II.1 Notations for perceptrons and MPS. The basic building block of deep neural networks is the perceptron which mimics a biological neuron that ”fires” when its depolarization potential reaches a certain threshold. The perceptron is a non-linear function \phi(\bm{x}) of n

Read the complete text