Is Variational Monte Carlo Robust? Sharp Moment Thresholds and Heavy-tailed Stochastic Optimization
Philipp Grohs 1,2 and Davide Nobile 1 · 2026
Read Is Variational Monte Carlo Robust? Sharp Moment Thresholds and Heavy-tailed Stochastic Optimization by Philipp Grohs 1,2 and Davide Nobile 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26009.txt.
Introduction
Philipp Grohs and Davide Nobile ask whether variational Monte Carlo is robust. The method hunts quantum ground states by stochastic energy minimization. Neural wave functions like FermiNet have revived interest in it. Trouble hides in the estimators. Local energy and gradient estimates can be heavy-tailed. The nodal geometry of the wave function, where it crosses zero, governs that behaviour.
Broad ansatz classes make the problem concrete. For Slater-Jastrow wave functions with flexible orbitals, the estimators generically lack higher moments. General analytic ansätze admit only weak moment bounds. Precise thresholds separate the regimes, and nodal structure decides which side a model lands on. A robust variant answers the diagnosis. PS-Clip-VMC clips both the local energy and the gradient variable. It provably converges in the weak-moment regime, in expectation and with high probability. Early FermiNet tests on atoms up to eighteen electrons look markedly sturdier.
Catalog record
| CREATOR | Philipp Grohs 1,2 and Davide Nobile 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 115 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26009
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Is Variational Monte Carlo Robust? Sharp Moment Thresholds and Heavy-tailed Stochastic Optimization Philipp Grohs 1,2 and Davide Nobile 1 Abstract Variational Monte Carlo (VMC) is a central algorithm in electronic structure theory and has gained renewed importance through modern neural-network ansätze such as FermiNet. At its core, VMC seeks ground states by minimizing the Rayleigh quotient by stochastic optimization. In this work, we show that the resulting stochastic optimization problem is intrinsically governed by the nodal geometry of the underlying wave function. More precisely, we establish that properties of the nodal set determine the integrability of the local energy and gradient estimators that drive VMC. For broad and practically relevant ansatz classes, including Slater-Jastrow wave functions with variable-exponent Slater-type orbitals, we prove that these estimators are generically heavy-tailed and fail to admit higher moments. At the same time, for general analytic ansätze, we prove weak moment bounds for the relevant estimators and identify precise low-moment regimes, showing how generic and degenerate nodal structures lead to different integrability thresholds. Building on this analysis, we introduce a new robust variant of VMC – coined PS-Clip-VMC – which is based on clipping both the local energy and the gradient random variable. We prove that PS-Clip-VMC converges both in expectation and with high probability in the weak moment regime of VMC. Preliminary experiments for training FermiNet on Atoms with up to 18 electrons suggest that PS-Clip-VMC is significantly more robust than standard methods. 1 Introduction 1.1 Motivation A central computational problem in quantum chemistry concerns the approximation of ground states and ground state energies of many-particle Hamiltonians. If \mathcal{H}:\ H^{2}(\Omega)\to L^{2}(\Omega) is a self-adjoint Hamiltonian bounded from below, its ground-state energy E_{0} is characterized by the Rayleigh–Ritz variational principle E_{0}:=\inf_{\psi\in\mathfrak{d}(\mathcal{H})\setminus\{0\}}\frac{\langle\mathcal{H}\psi,\psi\rangle}{\|\psi\|_{L^{2}}^{2}}, (1) with \mathfrak{d}(\mathcal{H}) the form-domain of \mathcal{H} ; typically we have \mathfrak{d}(\mathcal{H})=H^{1}(\Omega) [ 41 ] . If the infimum is attained, then every minimizer is an eigenfunction associated with the lowest eigenvalue of \mathcal{H} – a so-called ground state . In many-particle systems we usually have that \Omega=\mathbb{R}^{d\times N} (with d the particle dimension and N the number of particles) and (in dimensionless units) \mathcal{H}=-\Delta+\sum_{i,j=1}^{N}V(x_{i},x_{j})+\sum_{i=1}^{N}V_{\mbox{ext}}(x_{i}) , where V:\mathbb{R}^{d}\times\mathbb{R}^{d}\to\mathbb{R} describes particle interactions and V_{\mbox{ext}}:\mathbb{R}^{d}\to\mathbb{R} describes an external potential. If the particles are indistinguishable and fermionic, there is an additional restriction, namely \psi\in H^{1}_{a}(\mathbb{R}^{d\times N}) , where we denote by H_{a}^{1}(\mathbb{R}^{d\times N}) the space of all functions \psi\in H^{1}(\mathbb{R}^{3\times N}) with \psi(x_{\pi(1)},\dots,x_{\pi(N)})=\mathrm{sgn}(\pi)\psi(x_{1},\dots,x_{N}) for all permutations \pi of \{1,\dots,N\} , all (x_{1},\dots,x_{N})\in\mathbb{R}^{d\times N} and \mathrm{sgn}(\pi) denoting the signature of the permutation \pi . We generally refer to multi-particle systems restricted to the space of antisymmetric functions as fermionic multi-particle systems and note that for such systems, the problem ( 1 ) amounts to computing E_{0}:=\inf_{\psi\in H^{1}_{a}(\mathbb{R}^{3\times N})\setminus\{0\}}\frac{\langle\mathcal{H}\psi,\psi\rangle}{\|\psi\|_{L^{2}}^{2}}. (2) A particularly important example is given by the (Born-Oppenheimer) multi-electron Hamiltonian \mathcal{H}^{BO}:=-\Delta+\sum_{i,j=1}^{N}\frac{1-\delta_{ij}}{|x_{i}-x_{j}|}+\sum_{I,J=1}^{M}\frac{Z_{I}Z_{J}(1-\delta_{IJ})}{|R_{I}-R_{J}|}-\sum_{i=1}^{N}\sum_{I=1}^{M}\frac{Z_{I}}{|x_{i}-R_{I}|} (3) which describes electronic properties of a molecule with M nuclei (R_{1},\dots,R_{M})\in\mathbb{R}^{3\times M} and charges (Z_{1},\dots,Z_{M})\in\mathbb{N}^{M} . The multi-electron Hamiltonian acts on the electronic wavefunction \psi\in H^{2}(\mathbb{R}^{3\times N}) which depends on the n electron coordinates (x_{1},\dots,x_{N})\in\mathbb{R}^{3\times N} [ 17 , 40 ] . Since electrons are indistinguishable fermionic particles, (and ignoring spin) the electronic wavefunction is antisymmetric with respect to permutations of the electron coordinates. Finding efficient algorithms to accurately compute the ground-state energies and ground states of ( 3 ) (along with excited states corresponding to higher eigenvalues and eigenvectors) is one of the key open problems in computational chemistry. Its solution would enable the simulation and prediction of all nonrelativistic properties of molecules from first principles without resorting to expensive and time-consuming experiments. In the case of the Born-Oppenheimer multi-electron Hamiltonian ( 3 ), the solution of ( 2 ) poses formidable challenges: First, the dimension of the problem scales linearly in the number of electrons. This means that even for small molecules with only tens or hundreds of electrons, solving ( 2 ) requires solving a PDE eigenvalue problem on a computational domain with hundreds or even thousands of dimensions . Second, many chemical applications require exceedingly accurate approximations of E_{0} to within a few \mathrm{mHa} (millihartree) while the absolute energy E_{0} may be of the order of several hundred Hartree. In other words, practically useful computations often need to approximate E_{0} to within a relative accuracy of 6-7 digits [ 11 ] . In recent years, so-called variational monte-carlo (VMC) algorithms have emerged as a new state of the art in terms of accuracy, see for example [ 30 , 18 , 33 , 36 , 35 , 37 , 34 , 12 , 11 , 13 , 19 , 8 , 9 , 10 ] . These algorithms build on a parametric function class \Psi=\{\psi_{\theta}:\ \theta\in\Theta\}\subset H^{1}_{a}(\mathbb{R}^{3\times N})\setminus\{0\} and \Theta\subset\mathbb{R}^{P} (for example consisting of neural networks) and approximate the true ground state and ground-state energy by minimizing the loss L(\theta):=\frac{\langle\mathcal{H}\psi_{\theta},\psi_{\theta}\rangle}{\|\psi_{\theta}\|_{L^{2}}^{2}}. (4) Since evaluating L(\theta) or \nabla_{\theta}L(\theta) requires the calculation of high-dimensional integrals, stochastic representations and corresponding stochastic optimization algorithms have to be used: with X_{\theta}\sim\frac{|\psi_{\theta}(x_{1},\dots,x_{N})|^{2}}{\|\psi_{\theta}\|_{L^{2}}^{2}},\ E_{\theta}:=\frac{\mathcal{H}\psi_{\theta}(X_{\theta})}{\psi_{\theta}(X_{\theta})},\ W_{\theta}:=\frac{\nabla_{\theta}\psi_{\theta}(X_{\theta})}{\psi_{\theta}(X_{\theta})}\ \mbox{and}\ Z_{\theta}:=E_{\theta}\cdot W_{\theta}-\mathbb{E}\left[E_{\theta}\right]\cdot\mathbb{E}\left[W_{\theta}\right] we have that L(\theta)=\mathbb{E}[E_{\theta}]\quad\mbox{and}\quad\nabla_{\theta}L(\theta)=2\mathbb{E}[Z_{\theta}]. VMC algorithms leverage these stochastic representations by first sampling from X_{\theta} via MCMC and then estimating \nabla L(\theta) from suitable finite sample estimators of \mathbb{E}[Z_{\theta}] to compute parameter updates [ 42 , 5 ] . The success of this approach hinges on the quality with which the true gradient can be approximated by its respective stochastic approximation. Indeed, if the random variables E_{\theta} and Z_{\theta} satisfy sufficient moment assumptions, [ 1 ] recently proved convergence of VMC to stationary points of L . 1.2 Contributions The main contributions of this paper follow three threads which we now summarize. 1.2.1 Non-Existence of Moments Our first main result uncovers yet another challenge in VMC: the moment assumptions of [ 1 ] are in general not satisfied and both E_{\theta} and Z_{\theta} are severely heavy-tailed. More precisely, in Theorem 2.4 we prove that even for the simple case of \Psi consisting of any (sufficiently expressive) Slater-Jastrow Ansatz with Slater-Type orbitals [ 33 ] the set of parameters with heavy tails on E_{\theta} and Z_{\theta} is residual (in fact, we show that it contains a dense open subset). For h_{1},\dots,h_{N}\in C(\mathbb{R}^{3}) and (x_{1},\dots,x_{N})\in\mathbb{R}^{3\times N} we write |h_{1},\dots,h_{N}\rangle(x_{1},\dots,x_{N}):=\det\begin{pmatrix}h_{1}(x_{1})&\dots&h_{N}(x_{1})\\ \vdots&\ddots&\vdots\\ h_{1}(x_{N})&\dots&h_{N}(x_{N})\end{pmatrix}. Then, we have the following result. Theorem 1.1 (Colloquial Version of Theorem 2.4 ) . With Y_{l,m} denoting the spherical harmonics and \bm{\alpha}\in[0,\infty)^{I} , \mathbf{c}=\left(c_{l,m,k,i}\right)_{l=0,\dots,L,\ m=-l,\dots,l,\ k=0,\dots,K-1,\ i=1,\dots,I}\in\mathbb{R}^{(L+1)^{2}KI} denote h_{(\bm{\alpha},\mathbf{c})}(x):=\sum_{l,m,k,i}c_{l,m,k,i}Y_{l,m}\left(\frac{x}{|x|}\right)|x|^{l+k}e^{-\alpha_{i}|x|}, the corresponding Slater-Type orbital and let \mathcal{J}_{\beta} be a symmetric and positive Jastrow factor , parametrized by \beta\in\mathbb{R}^{J} . For \theta:=\left(\beta,((\bm{\alpha}_{a}^{b},\mathbf{c}_{a}^{b}))_{a=1,\dots,N,\ b=1,\dots,B}\right)\in\mathbb{R}^{J}\times[0,\infty)^{NBI}\times\mathbb{R}^{NB(L+1)^{2}KL}=:\Theta denote \psi_{\theta}(\mathbf{x})\coloneqq\mathcal{J}_{\beta}(\mathbf{x})\cdot\left(\sum_{b=1}^{B}|h_{(\bm{\alpha}_{1}^{b},\mathbf{c}_{1}^{b})},\dots,h_{(\bm{\alpha}_{N}^{b},\mathbf{c}_{N}^{b})}\rangle(\mathbf{x})\right). Then, whenever L\geq 1 and KI\geq 3N-3 , the set \left\{\theta\in\Theta:\ \mathbb{E}[|E_{\theta}|^{3}]=\infty\quad\land\quad\mathbb{E}[|Z_{\theta}|^{3/2}]=\infty\right\} is residual. Our result in particular shows that the gradient random variable Z_{\theta} generically does not possess finite variance, rendering standard stochastic approximations insufficient. The main difficulty in the proof of Theorem 2.4 is to show that every neighbourhood of every \theta in \Theta contains a parameter \mu such that \psi_{\mu} has a regular zero (x_{1},\dots,x_{n})\in\mathbb{R}^{3\times n} with \Delta\psi_{\mu}(x_{1},\dots,x_{n})\neq 0 and \nabla_{\theta}\psi_{\mu}(x_{1},\dots,x_{n})\neq 0 , see Lemma 2.11 . Having established this, the lack of moments follows from asymptotically expanding the local energy \frac{\mathcal{H}\psi_{\mu}}{\psi_{\mu}} and gradient random variable \frac{\mathcal{H}\psi_{\mu}}{\psi_{\mu}}\cdot\frac{\nabla_{\theta}\psi_{\mu}}{\psi_{\mu}} around this zero, see Lemma 2.5 . Remark 1.2 . Theorem 2.4 holds for any Hamiltonian. In particular, the