Toward Scalable Normalizing Flows for the Hubbard Model
Lorenzo Verzichelli · 2026
Read Toward Scalable Normalizing Flows for the Hubbard Model by Lorenzo Verzichelli (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18273.txt.
Introduction
Lorenzo Verzichelli works on scaling normalizing flows to bigger problems in condensed matter. His 2026 preprint studies the Hubbard model, a basic model of electrons in a lattice. Normalizing flows have recently learned the Boltzmann distribution of that model. That success opens a new route to generative modeling of quantum materials. The open question is how to reach larger lattices and lower temperatures without the training falling apart.
Verzichelli studies the steps needed for that scale-up. Stability and efficiency are his twin focus. Flows that stay sound at low temperature could sample states that other methods reach slowly. The work maps the path from a proof of concept to a working tool.
Catalog record
| CREATOR | Lorenzo Verzichelli |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18273
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Toward Scalable Normalizing Flows for the Hubbard Model Lorenzo Verzichelli Abstract Normalizing flows have recently demonstrated the ability to learn the Boltzmann distribution of the Hubbard model, opening new avenues for generative modeling in condensed matter physics. In this work, we investigate the steps required to extend such simulations to larger lattice sizes and lower temperatures, with a focus on enhancing stability and efficiency. Additionally, we present the scaling behavior of stochastic normalizing flows and non-equilibrium Markov chain Monte Carlo methods for this fermionic system. [a,b]Janik Kreit 1 Introduction The Hubbard model is a central framework in condensed-matter physics for describing strongly correlated electronic systems [ 19 , 2 ] . It can be formulated either in terms of a Hamiltonian or an action, with the latter typically referring to the finite-temperature auxiliary-field formulation. Despite its simple structure, numerical simulations in this formulation are challenging due to the multimodal structure of the Boltzmann distribution and the presence of large potential barriers. As a consequence, standard sampling methods such as Hybrid Monte Carlo (HMC) often suffer from ergodicity violations [ 35 ] , which can lead to biased estimates of physical observables. Generative neural samplers (GNSs), including Normalizing Flows (NFs) [ 28 , 21 ] and autoregressive models [ 32 ] , have shown strong performance in representing Boltzmann distributions across a wide range of physical systems. Often referred to as Boltzmann generators [ 27 ] , they have been applied in lattice quantum field theory [ 1 , 24 , 13 ] , statistical mechanics [ 33 , 25 ] , string theory [ 10 , 11 ] , and quantum chemistry [ 27 , 16 , 17 ] . Beyond accelerating sampling, GNSs enable direct estimates of thermodynamic observables [ 24 ] and entanglement entropies [ 4 , 7 ] . In parallel, non-equilibrium Markov chain Monte Carlo (NE-MCMC) methods [ 12 , 6 , 8 , 5 ] remain effective in regimes where HMC suffers from ergodicity problems and strong autocorrelations [ 26 ] . In this work, we investigate the performance of NE-MCMC methods, NFs, and SNFs for sampling the Boltzmann distribution of the Hubbard model. While NFs provide efficient generative proposals and NE-MCMC methods offer favorable scaling properties, SNFs combine both by augmenting deterministic flow transformations with stochastic updates [ 9 , 8 ] . This unified framework is particularly well suited for addressing ergodicity issues in Hubbard model simulations. Building on earlier work on symmetry-enforced normalizing flows for the Hubbard model at small volumes [ 29 , 22 ] , we extend these studies to larger lattice volumes and lower temperatures by improving the numerical stability of the Hubbard action. We also present initial scaling results for NE-MCMC methods, NFs, and SNFs in this setting. The remainder of these proceedings is organized as follows. In Section 2 , we review the Hubbard model. In Section 3 , we introduce an algorithm to improve numerical stability at low temperatures. The methods of NE-MCMC, NFs, and SNFs are discussed in Section 4 , and their scaling results are presented in Section 5 . Conclusions and an outlook are given in Section 6 . 2 Hubbard Model The Hubbard model is defined by the Hamiltonian H=-\kappa\sum_{\langle x,y\rangle}\left(a_{x,\uparrow}^{\dagger}a_{y,\uparrow}+a^{\dagger}_{x,\downarrow}a_{y,\downarrow}\right)-\frac{U}{2}\sum_{x}\left(n_{x,\uparrow}-n_{x,\downarrow}\right)^{2}\,, (1) where a^{\dagger}_{x,\sigma} ( a_{x,\sigma} ) denotes the fermionic creation (annihilation) operator for a particle with spin \sigma\in\{\uparrow,\downarrow\} at lattice site x , and n_{x,\sigma}\equiv a^{\dagger}_{x,\sigma}a_{x,\sigma} is the corresponding number operator. The first term in Eq. 1 describes nearest-neighbor hopping with amplitude \kappa , while the second term represents an on-site interaction with coupling strength U>0 . In the following, we consider hexagonal, half-filled lattices which correspond to zero chemical potential. For all simulations, we set \kappa=1 . Applying a Suzuki–Trotter decomposition [ 31 , 30 ] and a Hubbard–Stratonovich transformation [ 18 ] to the Hamiltonian, the model can be expressed in terms of an action S , S[\phi]=\sum_{x,t\in\Lambda}\frac{\phi_{xt}^{2}}{2\delta U}-\log\det M[\phi]-\log\det M[-\phi]\,. (2) Here, \phi\in\mathbb{R}^{\Lambda} is a bosonic auxiliary field defined on the lattice \Lambda=N_{x}\times N_{t} , with physical sites N_{x} and artificial sites N_{t} arising from the Suzuki–Trotter decomposition. This decomposition introduces an error of \mathcal{O}(\delta^{2}) , where \delta=\beta/N_{t} and \beta is the inverse temperature. Fermionic dynamics are encoded in the fermion matrix M\in\mathbb{R}^{N_{x}N_{t}\times N_{x}N_{t}} , whose elements are M\left[\phi\right]_{x\textquoteright t\textquoteright,xt}=\delta_{x\textquoteright x}\delta_{t\textquoteright t}-[e^{\delta h}]_{x\textquoteright x}e^{\phi_{xt}}\mathcal{B}_{t\textquoteright}\delta_{t\textquoteright,t+1}\,, (3) where h is the hoping matrix, and \mathcal{B}_{t}=1 for 1<t\leq N_{t} and \mathcal{B}_{1}=-1 implements anti-periodic temporal boundary conditions. Owing to the sparsity of M , its determinant can be evaluated using an LU decomposition, \det M=\det L\cdot\det U\,. (4) As shown in Ref. [ 35 ] , the triangular structure of L and U allows an equivalent formulation: \det M=\det\left(\mathbbm{1}+A_{1}A_{2}\dots A_{N_{t}}\right)\,, (5) where the product of matrices A_{t}\in\mathbb{R}^{N_{x}\times N_{x}} is referred to as the sausage of matrices . The individual matrices are given by \displaystyle A_{t}=e^{\delta h}F_{t}\qquad\text{with}\qquad[F_{t}]_{xx\textquoteright}=e^{\phi_{x,N_{t}-t}}\delta_{xx\textquoteright}\,. (6) 3 Enhancing Numerical Stability with QR Decompositions In Eq. 6 , the matrices A_{t} depend exponentially on the auxiliary field \phi and the hopping matrix h . Consequently, the product A\equiv A_{1}A_{2}\dots A_{N_{t}} develops a wide range of eigenvalues, resulting in a large condition number. While this behavior is mathematically well defined, it leads to numerical instabilities due to the accumulation of rounding errors during matrix multiplications. These instabilities propagate into the evaluation of the action and can produce unstable estimates of physical observables. To mitigate this problem, we perform intermediate QR decompositions [ 15 ] during the computation of the matrix product. Here, Q is an orthogonal matrix with unit condition number, while the triangular matrix R contains the ill-conditioned part. This approach was previously employed in Ref. [ 3 ] , and we select the QR decomposition over a singular value decomposition due to its significantly lower computational cost. Applying this procedure to the sausage of matrices, as shown in Algorithm 1 , yields QR=A\,. (7) Rewriting the determinant from Eq. 5 in terms of Q and R , \det\left(\mathbbm{1}+QR\right)=\det Q\cdot\det\left(Q^{T}+R\right)\,, (8) enables a numerically stable evaluation. The same technique can also be used to compute the inverse of \mathbbm{1}+QR , which is required for several observables, including the gradient \frac{\partial S}{\partial\phi_{xt}} used in HMC and in the training loop of the NF. Algorithm 1 Stable multiplication of a chain of matrices using QR decomposition 1: Q\leftarrow\mathbbm{1}_{N_{x}\times N_{x}} 2: R\leftarrow\mathbbm{1}_{N_{x}\times N_{x}} 3: for each A_{t} in [A_{1},A_{2},\dots,A_{N_{t}}] do 4: R\leftarrow R\cdot A_{t} 5: Q_{\text{help}},R\leftarrow QRDecomposition( R ) 6: Q\leftarrow Q\cdot Q_{\text{help}} 7: end for 4 Methods 4.1 Non-Equilibrium Markov Chain Monte Carlo NE-MCMC is based on Jarzynski’s equality [ 20 ] , which relates the free-energy difference \Delta F between an initial and a final macrostate of a statistical system undergoing an out-of-equilibrium evolution to an ensemble average, \langle e^{-W}\rangle_{\mathrm{f}}=e^{-\Delta F}\,. (9) Here, W denotes the work performed on the system during the non-equilibrium process, and \langle\cdot\rangle_{\mathrm{f}} indicates an average over all possible non-equilibrium trajectories. Starting from an equilibrium Boltzmann distribution, a non-equilibrium Markov chain is constructed by updating the configuration using transition probabilities P_{s(n)} . The latter depends on a parameter s of the action, which is varied at each step n of the evolution. In particular, P_{s(n)}(z_{n-1}\to z_{n}) , used to generate the configuration z_{n} from z_{n-1} , satisfies detailed balance