Understanding the sign problem from an exact Path Integral Monte Carlo model of interacting harmonic fermions

Siu A. Chin · 2026

Read Understanding the sign problem from an exact Path Integral Monte Carlo model of interacting harmonic fermions by Siu A. Chin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22559.txt.

Introduction

Siu Chin shows that a neat identity for the harmonic oscillator opens an exact model of the Monte Carlo sign problem. The sign problem plagues simulations of fermions, particles that refuse to share a state. His 2026 preprint applies the identity to fermions in any number of dimensions.

The result is a rare case that can be solved in full. With exact answers in hand, scholars can see what the sign problem truly does to energy reads. That view can guide fixes for the general case. The work is a small, sharp window into a big wall.

Catalog record

CREATORSiu A. Chin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22559

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Understanding the sign problem from an exact Path Integral Monte Carlo model of interacting harmonic fermions Siu A. Chin Abstract This work shows that the recently discovered operator contraction identity for solving the discreet Path Integral of the harmonic oscillator can be applied equally to fermions in any dimension. This then yields an exactly solvable model for studying the sign problem where the Path Integral Monte Carlo energy at any time step for any number of fermions is known analytically, or can be computed numerically. It is found that repulsive/attractive pairwise interaction shifts the sign problem to larger/smaller imaginary time, but does not make it more severe than the non-interacting case. More surprisingly, for closed-shell number of fermions, the sign problem goes away at large imaginary time. Fourth-order and newly found variable-bead algorithms are used to compute ground state energies of quantum dots with up to 110 electrons and compared to results obtained by modern neural networks. I Introduction Recent advances in Path Integral Monte Carlo (PIMC) continue to be the use of parameterized fourth-order propagators to optimize PIMC’s convergence at the fewest number of beads/time-slices for both bosons jan01 ; sak09 ; zil10 ; kam16 ; kap16 ; yan17 ; lin18 ; wan22 and fermions chin15 ; dor15 ; dor18 . While this increase in efficiency is useful for both, it is of crucial importance for fermions because its sign problem worsens with increasing number of beads. However, because there is no simple model for understanding PIMC for fermions at each time step, one’s knowledge of the sign problem remains scant. For example, it is well known since Takahashi and Imada’s calculation tak84a 40 years ago that PIMC has no sign problem in one dimension. Yet, an explicit proof chin24 of this has only appeared recently. The technique used in that proof can now be generalized to explain why there is no sign problem for closed-shell particle states at large imaginary time. (See Sect. VII below.) In a previous work chin23a , because of an operator contraction identity, this author discovered the universal PIMC discrete propagator for the harmonic oscillator, which has the same functional form for all initial short-time propagators. Each short-time propagator only modifies the argument of the universal coefficient functions. This then makes it possible to obtain physical observables in closed forms for all short-time propagators at once. In particular, one can compute the thermodynamic and Hamiltonian energies analytically at each discrete imaginary time step for any short-time propagator chin23b . This work now shows that this contraction identity remains valid for the anti-symmetric determinant fermion propagator at all dimensions and for any number of fermions. Therefore, one has a completely solvable PIMC model of harmonic fermions with analytical thermodynamic and Hamiltonian energies. Moreover, the model remains solvable if the pairwise interaction is also harmonic. Therefore, the sign problem can be examined in detail, with and without interactions. Figure 1: (color online) Left: The Hamiltonian energy of a 90-electron unpolarized quantum dot as a function of imaginary time \tau . Algorithm VB2’s energy of 396.69(6) at \tau=3 , is only 0.5% above Ref. nor23 ’s SJ neural network energy of 394.621(4). Right: The Hamiltonian energy for a 110-electron unpolarized quantum dot. Algorithm VB2’s energy at \tau=2.5 is 556.5(6). See Sect. X for details. In Section II , we review the contraction identity for the harmonic oscillator in one dimension, then generalize it to any number of fermions in any dimension. By use of this contraction, Sect. III summaries the universal discrete PIMC propagator for harmonic fermions. Sect. IV derives the analytical form of the discrete partition function at each time-step for all short-time propagators. Sect. V gives the analytical thermodynamic and Hamiltonian fermion energies at each discrete time-step verified by direct PIMC simulation. Sect. VI discusses the PIMC fermion sign problem and the empirical finding that there is no sign problem for closed-shell particle states at large imaginary time. Sect. VII explains the surprising connection between the absence of the sign problem in one dimension and in closed-shell particle states. Sect. VIII shows how pairwise interactions, both harmonic and Coulombic, modify the sign problem from the non-interacting case. For spin-balanced quantum dots, Sect. IX shows that fourth-order algorithms give excellent ground state energies for less than 30 electrons, provided that the Coulomb interaction is sufficiently repulsive. Larger quantum dots necessitate the use of a new class of Variable-Bead algorithms in Sect. X . The ensuing energy for a 90 -electron quantum dot is compared to modern neural network nor23 results in Fig. 1 . Some concluding remarks are given in Sect. XI . II Free fermion propagator contractions For the dimensionless harmonic oscillator Hamiltonian in 1D given by \hat{H}=-\frac{1}{2}\frac{d^{2}}{dx^{2}}+\frac{1}{2}x^{2}\equiv\hat{T}+\hat{V}, (1) as shown in Ref. chin23a , the Gaussian integral needed to compute the discrete path integral is given by \displaystyle\langle x^{\prime}|{\rm e}^{-a\hat{T}}{\rm e}^{-b\hat{V}}{\rm e}^{-c\hat{T}}|x^{*}\rangle \displaystyle= \displaystyle\frac{1}{\sqrt{2\pi a}}\frac{1}{\sqrt{2\pi c}}\int_{-\infty}^{\infty}dx\,{\rm e}^{-\frac{1}{2a}(x^{\prime}-x)^{2}-b\frac{1}{2}x^{2}-\frac{1}{2c}(x-x^{*})^{2}} (2) \displaystyle= \displaystyle\frac{1}{\sqrt{2\pi\kappa}}{\rm e}^{-\nu\frac{1}{2}x^{\prime 2}}{\rm e}^{-\frac{1}{2\kappa}(x^{\prime}-x^{*})^{2}}{\rm e}^{-\mu\frac{1}{2}{x^{*}}^{2}} (3) \displaystyle= \displaystyle\langle x^{\prime}|{\rm e}^{-\nu\hat{V}}{\rm e}^{-\kappa\hat{T}}{\rm e}^{-\mu\hat{V}}|x^{*}\rangle (4) with \kappa=a+abc+c,\quad\nu=\frac{bc}{\kappa},\quad\mu=\frac{ba}{\kappa}. (5) This means that one actually has an operator identity \displaystyle{\rm e}^{-a\hat{T}}{\rm e}^{-b\hat{V}}{\rm e}^{-c\hat{T}} \displaystyle= \displaystyle{\rm e}^{-\nu\hat{V}}{\rm e}^{-\kappa\hat{T}}{\rm e}^{-\mu\hat{V}}, (6) which contracts two free particle propagators {\rm e}^{-a\hat{T}} and {\rm e}^{-c\hat{T}} into one {\rm e}^{-\kappa\hat{T}} . Therefore any discrete path integral of the harmonic oscillator can be contracted down to a single free propagator form and be evaluated analytically as \displaystyle\langle x^{\prime}|{\rm e}^{-A\hat{V}}{\rm e}^{-B\hat{T}}{\rm e}^{-C\hat{V}}|x\rangle={\rm e}^{-A\frac{1}{2}{x^{\prime}}^{2}}\frac{1}{\sqrt{2\pi B}}{\rm e}^{-\frac{1}{2B}(x^{\prime}-x)^{2}}{\rm e}^{-C\frac{1}{2}x^{2}}. (7) Consider the case of n -particles in D -dimension with configuration vector {\bf x}=({\bf r}_{1},{\bf r}_{2}\cdots,{\bf r}_{n}) where each particle position vector is {\bf r}=(x_{1},x_{2},\cdots,x_{D}) . Since the harmonic oscillator is separable in each coordinate, the contraction ( 6 ) now holds for \displaystyle\hat{T}=-\frac{1}{2}\nabla_{{\bf x}}^{2}=-\frac{1}{2}\sum_{i=1}^{n}\nabla_{i}^{2}\qquad{\rm and}\qquad\hat{V}=\frac{1}{2}{\bf x}^{2}=\frac{1}{2}\sum_{i=}^{n}{\bf r}_{i}^{2} (8) where the n -particle free propagator is given by \displaystyle g_{0}({\bf x}^{\prime},{\bf x},{\epsilon}) \displaystyle= \displaystyle\langle{\bf x}^{\prime}|{\rm e}^{-\epsilon\hat{T}}|{\bf x}\rangle (9) \displaystyle= \displaystyle\frac{1}{(2\pi{\epsilon})^{nD/2}}\exp\left[-\frac{1}{2{\epsilon}}({\bf x}^{\prime}-{\bf x})^{2}\right] \displaystyle= \displaystyle\prod_{i=1}^{n}\frac{1}{(2\pi{\epsilon})^{D/2}}\exp\left[-\frac{1}{2{\epsilon}}({\bf r}_{i}^{\prime}-{\bf r}_{i})^{2}\right]. For n fermions, the anti-symmetric free propagator {\rm e}_{\cal A}^{-{\epsilon}\hat{T}} in D dimension is given by the determinant \displaystyle G_{0}({\bf x}^{\prime},{\bf x},{\epsilon}) \displaystyle= \displaystyle\langle{\bf x}^{\prime}|{\rm e}_{\cal A}^{-{\epsilon}\hat{T}}|{\bf x}\rangle (10) \displaystyle= \displaystyle\frac{1}{n!}{\rm det}\left(\frac{1}{(2\pi{\epsilon})^{D/2}}\exp\left[-\frac{1}{2{\epsilon}}({\bf r}_{i}^{\prime}-{\bf r}_{j})^{2}\right]\right) \displaystyle= \displaystyle\frac{1}{n!}\sum_{p}(-1)^{P}g_{0}({\bf x}^{\prime}_{p},{\bf x},{\epsilon}) (11) \displaystyle= \displaystyle\frac{1}{n!}\sum_{p}(-1)^{P}g_{0}({\bf x}^{\prime},{\bf x}_{p},{\epsilon}) (12) where {\bf x}_{p} is a particle permutation of {\bf x} with P=0 for even permutations and P=1 for odd permutations. From from ( 10 ), G_{0}({\bf x}^{\prime},{\bf x},{\epsilon}) is antisymmetric in {\bf x}^{\prime} and in {\bf x} . The contraction of two free fermion propagators gives \displaystyle\langle{\bf x}^{\prime}|{\rm e}_{\cal A}^{-a\hat{T}}{\rm e}^{-b\hat{V}}{\rm e}_{\cal A}^{-c\hat{T}}|{\bf x}^{*}\rangle=\int d{\bf x}\,G_{0}({\bf x}^{\prime},{\bf x},a){\rm e}^{-b\frac{1}{2}{\bf x}^{2}}G_{0}({\bf x},{\bf x}^{*},c) \displaystyle\qquad=\frac{1}{(n!)^{2}}\sum_{p,q}(-1)^{P+Q}\int d{\bf x}\,g_{0}({\bf x}^{\prime}_{p},{\bf x},a){\rm e}^{-b\frac{1}{2}{\bf x}^{2}}g_{0}({\bf x},{\bf x}^{*}_{q},c) \displaystyle\qquad=\frac{1}{(n!)^{2}}\sum_{p,q}(-1)^{P+Q}\langle{\bf x}^{\prime}|{\rm e}^{-a\hat{T}}{\rm e}^{-b\hat{V}}{\rm e}^{-c\hat{T}}|{\bf x}^{*}\rangle. (13) Since the contraction holds for the n -particle free propagator, the above is just \displaystyle\langle{\bf x}^{\prime}|{\rm e}_{\cal A}^{-a\hat{T}}{\rm e}^{-b\hat{V}}{\rm e}_{\cal A}^{-c\hat{T}}|{\bf x}^{*}\rangle \displaystyle={\rm e}^{-\nu\frac{1}{2}{\bf x}^{\prime 2}-\mu\frac{1}{2}{{\bf x}^{*}}^{2}}\frac{1}{(n!)^{2}}\sum_{p,q}(-1)^{P+Q}g_{0}({\bf x}^{\prime}_{p},{\bf x}^{*}_{q},\kappa) (14) \displaystyle={\rm e}^{-\nu\frac{1}{2}{\bf x}^{\prime 2}-\mu\frac{1}{2}{{\bf x}^{*}}^{2}}\frac{1}{n!}\sum_{p}(-1)^{P}G_{0}({\bf x}^{\prime}_{p},{\bf x}^{*},\kappa). From ( 10 ), any row permutation changes the sign according to G_{0}({\bf x}^{\prime}_{p},{\bf x},{\epsilon})=(-1)^{P}G_{0}({\bf x}^{\prime},{\bf x},{\epsilon}). (15) Hence \displaystyle\langle{\bf x}^{\prime}|{\rm e}_{\cal A}^{-a\hat{T}}{\rm e}^{-b\hat{V}}{\rm e}_{\cal A}^{-c\hat{T}}|{\bf x}^{*}\rangle \displaystyle= \displaystyle{\rm e}^{-\nu\frac{1}{2}{\bf x}^{\prime 2}-\mu\frac{1}{2}{{\bf x}^{*}}^{2}}G_{0}({\bf x}^{\prime},{\bf x}^{*},\kappa) (16) \displaystyle= \displaystyle\langle{\bf x}^{\prime}|{\rm e}^{-\nu\hat{V}}{\rm e}_{\cal A}^{-\kappa\hat{T}}{\rm e}^{-\mu\hat{V}}|{\bf x}^{*}\rangle. Thus we have shown that the operator contraction identity applies equally to free propagators of any number of harmonic fermions in

Read the complete text