Neural network as low-cost surrogates for impurity solvers in quantum embedding methods
Rohan Nain, Philip M. Dee, Kipton Barros, Steven Johnston, Thomas A. Maier · 2026
Read Neural network as low-cost surrogates for impurity solvers in quantum embedding methods by Rohan Nain, Philip M. Dee, Kipton Barros, Steven Johnston, Thomas A. Maier (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25557.txt.
Introduction
Nain and co-authors replace a costly quantum solver with a neural net trained on very few examples. Impurity solvers are the bottleneck in dynamical mean-field studies of correlated electrons. Their net learns from one to two orders fewer samples than past work. Inside the training range it matches Monte Carlo accuracy. Outside it, at colder temperatures, its guesses still seed the exact solver well. That head start cuts total solve time by up to five times. The trick suits fast scans of phase space.
Catalog record
| CREATOR | Rohan Nain, Philip M. Dee, Kipton Barros, Steven Johnston, Thomas A. Maier |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34108 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.25557
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural network as low-cost surrogates for impurity solvers in quantum embedding methods Rohan Nain, Philip M. Dee, Kipton Barros, Steven Johnston, Thomas A. Maier Abstract A promising application of machine learning (ML) is in creating low-cost surrogate models to replace computational bottlenecks in quantum many-body simulations. Here, we explore whether a neural network (NN) can be trained in the low-data regime, with one to two orders of magnitude fewer training examples than previous works, as an efficient substitute for the impurity solver in dynamical mean field theory (DMFT) simulations of correlated electron models. We show that the NN solver achieves accuracy comparable to popular continuous-time QMC (CT-QMC) impurity solvers when interpolating between samples within the training set. While the NN ’s performance decreases notably when extrapolating to lower temperatures outside the training distribution, its output still provides an excellent initial guess for input to more accurate CT-QMC impurity solvers, thus accelerating the time to solution up to a factor of five. We discuss our results in the context of rapid phase-space exploration. I Introduction Machine learning (ML) methods are being used increasingly across scientific research. In particular, these methods are being actively explored as research tools in condensed matter physics Carleo et al. 2019 ; Carrasquilla 2020 ; Bedolla et al. 2020 ; Johnston et al. 2022 . One alluring application is the acceleration of many-body simulations, where one trains low-cost surrogate models to replace computationally intensive components of the simulation. Two notable examples are ML interatomic potentials for force field predictions in molecular dynamics simulations Jinnouchi et al. 2019 ; Noé et al. 2020 ; Prašnikar et al. 2024 and self-learning Monte Carlo (SLMC) algorithms Liu et al. 2017 ; Pan et al. 2025 , where ML surrogates are used to effectively sample configuration space Huang and Wang 2017 ; Liu et al. 2017 ; Nagai et al. 2017 ; Shen et al. 2018 ; Chen et al. 2018 ; Li et al. 2019 ; Bakshi et al. 2026 ; Pan et al. 2025 . A particularly important class of many-body algorithms is quantum embedding methods, like dynamical mean field theory (DMFT) or its cluster extensions Georges et al. 1996 ; Maier et al. 2005 . These methods have been instrumental in shaping our early understanding of strongly correlated phenomena like the Mott transition Rozenberg et al. 1994 ; Bulla et al. 2001 ; Joo and Oudovenko 2001 , unconventional superconductivity, and pseudogap behavior Maier et al. 2006 ; Gull et al. 2013 ; Dong et al. 2022 ; Mai et al. 2022 ; Kumar et al. 2025 . They are being used increasingly in ab initio electronic structure calculations of strongly correlated materials Kotliar et al. 2006 and systems driven out of equilibrium Aoki et al. 2014 . Given the importance and computational expense of these methods, there has been significant interest in ML acceleration Nagai et al. 2017 ; Arsenault et al. 2014 ; Rogers et al. 2021 ; Sheridan et al. 2021 ; Agapov et al. 2024 ; Lee et al. 2025 . The DMFT algorithm is shown in Fig. 1 (a). It starts with an initial guess for the bath parameters encoded in the effective medium Green’s function G_{0}(\tau) . An accurate method like quantum Monte Carlo (QMC) is then used to compute the interacting Green’s function G(\tau) of a quantum impurity problem defined by G_{0}(\tau) . The resulting impurity Green’s function G(\tau) is then used to update G_{0}(\tau) in the next iteration, and this process is iterated until a self-consistency condition is reached. The computationally expensive part is the “impurity solver,” which calculates G(\tau) for the interacting impurity problem. Traditionally, numerically exact methods like continuous-time QMC (CT-QMC) Gull et al. 2011 , exact diagonalization (ED) Liebsch and Ishida 2011 , or numerical renormalization group (NRG) Bulla et al. 2008 are used; however, these can be computationally prohibitive, particularly at low temperatures and when generalized to multi-orbital problems. For example, popular CT-QMC solvers scale as the cube of the inverse temperature and number of orbitals O(N^{3}\beta^{3}) Gull et al. 2011 , making them costly at low temperatures and on large systems. Conversely, ED -based solvers discretize the mean-field bath and face an exponential growth of the Hilbert space when solving the many-body impurity problem. As mentioned, various ML approaches have been explored to accelerate the DMFT loop. For example, Ref. Arsenault et al. 2014 trained a neural network (NN) model to predict correlation functions and quasiparticle weights for the three-dimensional Hubbard model using the initial hybridization function as an input. Similarly, Sheridan et al . Sheridan et al. 2021 built a ML solver for the Anderson impurity model (AIM) framed as a \Delta -learning problem, where the NN learned to predict the error corrections to computational inexpensive estimates for the impurity Green’s function. More recently, Lee et al . Lee et al. 2025 expanded on this approach using a modified transformer architecture to map low‑cost Matsubara Green’s functions to high‑accuracy impurity Green’s functions. Agapov et al . Agapov et al. 2024 trained a NN on 2{,}000 training examples to predict G(\tau) for two-dimensional lattices. They argued that their approach could replace the impurity solver within the DMFT loop but found it faced some difficulties in converging to accurate solutions without fine tuning. Figure 1: (a) Left: The DMFT self-consistency loop. The computationally expensive part is the many-body calculation used to solve the impurity problem. Our goal is to replace this solver with an efficient ML architecture. Right: The NN used to replace the impurity solver in the DMFT loop, consists of 4 fully-connected dense layers of neurons with GELU activations. It accepts the Weiss mean-field Green’s function G_{0}(\tau) , with the inverse temperature \beta and the Hubbard interaction strength U as input features, and predicts the impurity site’s self-energy \Sigma(\tau) . (b) Illustration of the data generation by the single shot impurity CT-QMC solver for a fixed (U_{i},\beta_{i}) grid for 10 synthetic Weiss fields G_{0}^{n} generated by finite pole expansion and the corresponding self-energies \Sigma^{(n)}(\tau) , both in terms of their Legendre coefficients G_{0,i}^{l=0,2,\dots,58} and \Sigma_{i}^{l=0,2,\dots,58} , respectively, forming the features and target pairs for training of the NN (\hat{{X}}_{32},\hat{{Y}}_{30}) . In general, these prior studies have found that appropriately trained ML surrogates could indeed replace more expensive numerically exact impurity solvers and reduce the time to solution. However, in all cases they used relatively large training data sets that are expensive to generate. This aspect poses challenges for generalizing this approach to multi-orbital models and, in particular, cluster extensions of DMFT , where generating sufficient amounts of high-quality training data will be computationally demanding. Motivated by this, here we examine the extent to which a NN can be efficiently trained as a low-cost but accurate surrogate for the impurity problem in a DMFT calculation. Focusing on the half-filled Hubbard model, we show that a well-trained NN , trained on a fairly feasible 500 samples synthetic data set, can predict the impurity self-energy \Sigma^{(n)}(\tau) (for a given iteration n ), from which the impurity Green’s function G^{(n)}(\tau) is obtained via Dyson’s equation, using Hubbard U , inverse temperature \beta=1/T ( k_{\mathrm{B}}=1 ), and G_{0}^{(n)}(\tau) as input features. Within the parameter regime that is well covered