Essentially No Energy Barrier Between Independent Fermionic Neural Quantum State Minima
David D. Dai, Marin Soljačić · 2026
Read Essentially No Energy Barrier Between Independent Fermionic Neural Quantum State Minima by David D. Dai, Marin Soljačić (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06939.txt.
Introduction
David D. Dai and co-authors published a 2026 arXiv preprint. The preprint covers essentially no energy barrier between independent fermionic neural quantum state minima. It appeared in the arXiv PAPERS collection for 2026. Neural quantum states (NQS) have proven highly effective in representing quantum many-body wavefunctions, but their loss landscape remains poorly understood and debated.
Here, we show that the NQS loss landscape is more benign and similar to conventional deep learning than previously thought. Exhibiting mode connectivity: independently trained NQS are connected by paths in parameter space with essentially no energy barrier. The preprint gives researchers a focused account of the problem and the approach the authors take.
Catalog record
| CREATOR | David D. Dai, Marin Soljačić |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-06939
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Essentially No Energy Barrier Between Independent Fermionic Neural Quantum State Minima David D. Dai, Marin Soljačić Abstract Neural quantum states (NQS) have proven highly effective in representing quantum many-body wavefunctions, but their loss landscape remains poorly understood and debated. Here, we demonstrate that the NQS loss landscape is more benign and similar to conventional deep learning than previously thought, exhibiting mode connectivity: independently trained NQS are connected by paths in parameter space with essentially no energy barrier. To construct these paths, we develop GeoNEB, a path optimizer integrating efficient stochastic reconfiguration with the nudged elastic band method for constructing minimum energy paths. For the strongly interacting six-electron quantum dot modeled by a 1.6 1.6 M-parameter Psiformer, we find two independent minima with expected energy barrier ∼ 10 − 5 \sim 10^{-5} times smaller than the system’s overall energy scale and ∼ 10 − 3 \sim 10^{-3} times smaller than the linear path’s barrier. The path respects physical symmetry in addition to achieving low energy, with the angular momentum remaining well quantized throughout. Our work is the first to construct optimized paths between independently trained NQS, and it suggests that the NQS loss landscape may not be as pathological as once feared. I Introduction Deep neural networks have introduced a new paradigm for solving the quantum many-body problem. Neural quantum states (NQS) Carleo and Troyer 2017 ; Nomura et al. 2017 ; Carleo et al. 2019 ; Choo et al. 2019 ; Sharir et al. 2020 ; Pfau et al. 2020 ; Hermann et al. 2020 ; Viteritti et al. 2023 ; von Glehn et al. 2023 ; Hermann et al. 2023 ; Lange et al. 2024 parameterize the wavefunction as a deep neural network \Psi_{\theta} and train the parameters \theta without external data by minimizing the expected energy of the ansatz Feynman 1954 ; McMillan 1965 ; Ceperley et al. 1977 ; Ceperley and Alder 1980 ; Tanatar and Ceperley 1989 ; Foulkes et al. 2001 ; Needs et al. 2009 . Recent architectures such as FermiNet Pfau et al. 2020 ; Spencer et al. 2020 and Psiformer von Glehn et al. 2023 for continuum fermions can achieve chemical accuracy and surpass traditional methods on atomic and molecular systems Pfau et al. 2020 ; Spencer et al. 2020 ; von Glehn et al. 2023 . It is currently unclear how transferable intuitions and patterns from conventional deep learning are to NQS Moss et al. 2025 . While first-order optimizers such as SGD Sutskever et al. 2013 or Adam Kingma and Ba 2015 are standard and sufficient in natural language processing and computer vision LeCun et al. 2015 , NQS usually require sophisticated second-order optimizers Amari 1998 ; Sorella 1998 ; Sorella 2001 ; Martens and Grosse 2015 ; Stokes et al. 2020 to achieve best results. For example, training FermiNet and Psiformer using Adam instead of KFAC (Kronecker-factored approximate curvature) yields significantly worse energies Pfau et al. 2020 ; von Glehn et al. 2023 . This uncertainty has led to opposing views regarding the NQS loss landscape’s structure. One view posits that with a sufficiently capable optimizer such as stochastic reconfiguration or KFAC, one can train and benefit from large and flexible models Pfau et al. 2020 ; von Glehn et al. 2023 . Others argue that NQS optimization is hindered by an “in general rugged and complicated loss landscape” Lange et al. 2025 and call for physically constrained ansatz instead Moss et al. 2025 . In this Letter, we investigate the NQS loss landscape through the lens of mode connectivity . In conventional deep learning, such as image classification, it is well-established that independently trained local minima are connected by continuous paths of near-constant low loss Garipov et al. 2018 ; Draxler et al. 2018 . We extend this analysis to the quantum setting. NQS optimization requires sampling from persistent Markov chains and preconditioning by the quantum geometric tensor, ruling out many path-finding methods from conventional deep learning. To address these NQS-specific challenges, we introduce GeoNEB: Quantum Geometric Tensor-Informed Nudged Elastic Band. It combines the nudged elastic band method Draxler et al. 2018 ; Jónsson et al. 1998 ; Kolsbjerg et al. 2016 with exact natural gradient descent implemented efficiently using the kernel trick Chen and Heyl 2024 ; Rende et al. 2024 , explicitly respecting the quantum geometry of the parameter space. For the strongly interacting six-electron quantum dot, we demonstrate two independently trained 1.6 M-parameter Psiformer models connected by a nonlinear path with energy barrier 7.2\times 10^{-4}\text{ Ha} compared to the massive 40.817\text{ Ha} ground state energy and the 1.86\text{ Ha} barrier of the linear path. We further show that the path respects physical symmetries, with angular momentum variance remaining small throughout the entire path. The presented results were achieved for the first pair of minima trained, with minimal hyperparameter tuning. The discovery of mode connectivity provides strong empirical evidence against the “rugged landscape” intuition, and it suggests that the NQS loss landscape is connected and reasonably accessible via stochastic reconfiguration. II Neural Quantum States Figure 1: Schematic of the Psiformer architecture. Electron coordinates are embedded and processed through transformer layers. A determinant enforces antisymmetry, while Jastrow and envelope factors handle cusps and boundary conditions. We are concerned with N -electron Hamiltonians \displaystyle H=-\frac{1}{2}\sum_{i}\nabla_{i}^{2}+\sum_{i<j}V_{\text{int}}(\mathbf{r}_{i}-\mathbf{r}_{j})+\sum_{i}V_{\text{ext}}(\mathbf{r}_{i}). (1) The ansatz \Psi_{\theta}(\mathbf{R}) must be antisymmetric under particle exchange, satisfy a cusp condition as two electrons approach each other, and obey the correct boundary conditions at infinity. We employ a modification of the Psiformer architecture (Fig. 1 ) von Glehn et al. 2023 , an adaptation of the Transformer models so successful in natural language processing Vaswani et al. 2017 and computer vision Dosovitskiy et al. 2021 . Transformer Backbone. The input configuration \mathbf{R}=\{\mathbf{r}_{1},\dots,\mathbf{r}_{N}\} is embedded into feature vectors \mathbf{h}_{i}^{0} using the raw Cartesian coordinates and “soft radius”: \mathbf{h}_{i}^{0}=\mathbf{W}_{\text{embed}}\left(x_{i},y_{i},\sqrt{1+r_{i}^{2}}\right). (2) For the quantum dot, we found that using the soft radius \sqrt{1+r_{i}^{2}} was essential. Using the raw radius r_{i} introduces an artificial cusp at the origin that causes divergent local energy, while removing radial information entirely deprives the network of an important feature. Treating each electron as a token, these features pass through L unmasked transformer layers. Each layer applies multi-head self-attention (MHSA) followed by a GELU-activation multilayer perceptron (MLP) applying layer normalization (LN) before both sublayers Xiong et al. 2020 ; He et al. 2016 : \displaystyle\tilde{\mathbf{h}}^{\ell} \displaystyle=\mathbf{h}^{\ell-1}+\text{MHSA}\left(\text{LN}\left(\mathbf{h}^{\ell-1}\right)\right), (3) \displaystyle\mathbf{h}^{\ell} \displaystyle=\tilde{\mathbf{h}}^{\ell}+\text{MLP}\left(\text{LN}\left(\tilde{\mathbf{h}}^{\ell}\right)\right). (4) Jastrow and Envelope. The transformer output passes through an LN and then a linear layer to form the many-body orbitals used in the generalized Slater determinant. We multiply the determinant by a Jastrow factor to enforce the electron-electron cusps and an envelope to enforce r\rightarrow\infty boundary conditions: \displaystyle\Phi \displaystyle=\mathbf{W}_{\text{orbital}}\text{LN}\left(\textbf{h}^{L}\right)+\textbf{b}_{\text{orbital}}, (5) \displaystyle\Psi_{\theta}(\mathbf{R}) \displaystyle=\det\left[\Phi\right]\times e^{-\sum_{i<j}\mathcal{J}(\mathbf{r}_{i}-\mathbf{r}_{j})}\times\prod_{i}\mathcal{K}(\mathbf{r}_{i}). The Jastrow and envelope forms for the quantum dot are \mathcal{J}(\mathbf{r})=\frac{\beta\alpha^{2}}{\alpha+r},\,\mathcal{K}(\mathbf{r})=e^{-\frac{r^{2}}{2}}, (6) where \alpha is trainable and \beta is fixed and matched to the spatial dimension and coupling strength. Algorithm 1: GeoNEB (QGT-Informed NEB) 0: \theta_{L},\theta_{R} (Minima), N (Initial Pivots) 1: Initialize: N pivots linearly between \theta_{L},\theta_{R} 2: while not converged do 3: for i=1,\dots,N do 4: \mathbf{R}_{i}\leftarrow MCMC sampling from |\Psi_{\theta_{i}}|^{2} 5: \mathbf{g}_{\text{nat}}\leftarrow\text{SR}(\theta_{i},\mathbf{R}_{i}) {Eq. 8 } 6: \hat{\tau}\leftarrow\text{Normalize}(\theta_{i+1}-\theta_{i-1}) 7: \mathbf{g}_{\perp}\leftarrow\mathbf{g}_{\text{nat}}-(\mathbf{g}_{\text{nat}}\cdot\hat{\tau})\hat{\tau} 8: \mathbf{g}_{\parallel}\leftarrow k((2\theta_{i}-\theta_{i-1}-\theta_{i+1})\cdot\hat{\tau})\hat{\tau} 9: \theta_{i}\leftarrow\theta_{i}-\eta(\mathbf{g}_{\perp}+\mathbf{g}_{\parallel}) 10: end for 11: if iteration % T_{\text{insert}}==0 then 12: