Transferable SCF-Acceleration through Solver-Aligned Initialization Learning

Eike S. Eberhard, Viktor Kotsev, Timm Güthle, Stephan Günnemann[0.5em] [email protected], [0.3em] Technical University of Munich (TUM) · 2026

Read Transferable SCF-Acceleration through Solver-Aligned Initialization Learning by Eike S. Eberhard, Viktor Kotsev, Timm Güthle, Stephan Günnemann[0.5em] [email protected], [0.3em] Technical University of Munich (TUM) (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21657.txt.

Introduction

Eike Eberhard and colleagues speed up Kohn-Sham density functional theory by teaching models to propose solver-aligned starting guesses. Earlier models fit ground-state targets well yet slowed convergence on larger molecules, a supervision failure rather than an extrapolation failure. Their solver-aligned initialization learning fixes this by differentiating through the self-consistent field solver. On molecules far larger than the training set, the method cuts iteration counts by roughly a third and delivers a clear wall-time speedup for large drug-like molecules.

Catalog record

CREATOREike S. Eberhard, Viktor Kotsev, Timm Güthle, Stephan Günnemann[0.5em] [email protected], [0.3em] Technical University of Munich (TUM)
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62291
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21657

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Transferable SCF-Acceleration through Solver-Aligned Initialization Learning Eike S. Eberhard, Viktor Kotsev, Timm Güthle, Stephan Günnemann[0.5em] [email protected], [0.3em] Technical University of Munich (TUM) Abstract The cost of Kohn-Sham density functional theory (KS-DFT) calculations scales with the number of solver iterations, which depends on the quality of the initial guess. Machine learning methods that predict initial guesses from molecular geometry can reduce this cost, but matrix-prediction models fail when extrapolating to larger molecules, degrading rather than accelerating convergence ( 27 ) . We show that this failure is a supervision problem, not an extrapolation problem: models trained on ground-state targets fit those targets well out of distribution, yet produce initial guesses that slow convergence. Solver-Aligned Initialization Learning (SAIL) resolves this for both Hamiltonian and density matrix models by differentiating through the SCF solver end-to-end. We introduce the Effective Relative Iteration Count (ERIC), a correction to the commonly used RIC that accounts for hidden Fock-build overhead. On QM40, containing molecules up to 4 × \times larger than the training distribution, SAIL reduces ERIC by 37% (PBE), 33% (SCAN), and 27% (B3LYP), more than doubling the previous state-of-the-art reduction on B3LYP (10%). On QMugs molecules 10 × \times the training size, SAIL delivers a 1.25 × \times wall-time speedup at the hybrid level of theory, extending ML SCF acceleration to large drug-like molecules. 1 Introduction Self-consistent field (SCF) solvers are the numerical backbone of Hartree-Fock (HF) ( 10 ; 5 ) and KS-DFT calculations ( 13 ; 17 ) . KS-DFT is the most widely used electronic structure method in computational chemistry ( 41 ) , reflected in the hundreds of thousands of publications ( 11 ) and the substantial HPC resources devoted to these calculations ( 1 ; 53 ) . Any reliable method for speeding up SCF calculations increases resource efficiency and accelerates scientific discovery, both directly and through downstream applications such as machine-learned interatomic potentials (MLIPs), where the cost of generating large reference datasets remains a bottleneck ( 19 ) . Moreover, unlike machine-learned surrogates that aim to replace DFT entirely, solver acceleration fully preserves accuracy, enabling practitioners to choose their level of theory and its known limitations , rather than those of a yet-to-be-characterized surrogate. In recent years, ML initialization methods have been proposed to accelerate SCF calculations ( 18 ; 49 ; 4 ) . These methods produce initial guesses conditioned on the molecular point cloud and typically fall into one of three categories. We jointly refer to Hamiltonian and density matrix prediction as matrix-based methods , as both parameterize quadratic basis-set expansions with coefficient matrices \mathbf{X}\in\mathbb{R}^{B\times B} . The third category, the coefficient-based ansatz, predicts the coefficients \mathbf{c}\in\mathbb{R}^{B_{\textrm{aux}}} of a linear auxiliary basis-set expansion. 27 have shown that matrix-based approaches decelerate SCF calculations when extrapolating to larger molecules , a ground-breaking observation given that prior work on matrix-based methods suggested robust out-of-distribution (OOD) performance based on, in hindsight, insufficient extrapolation benchmarks. Hence, they proposed to adopt coefficient-based approaches ( 37 ) , which are limited to Generalized Gradient Approximation (GGA)-type functionals. Unfortunately, the GGA level of theory is insufficient for many practical applications, particularly in organic chemistry, which is dominated by range-separated hybrid functionals ( 14 ; 3 ; 28 ; 22 ) . In this work, we show that the currently prevailing approach of training initial-guess models by fitting ground-state quantities is suboptimal. We address this with Solver-Aligned Initialization Learning (SAIL) , which backpropagates through the SCF algorithm to the ML initial guess, training on solver dynamics rather than ground-state references. This procedure is label-free and requires only molecular geometries. We show that SAIL cures the size-extrapolation issues for matrix-based methods and find that ground-state loss terms degrade under SAIL even as actual SCF convergence improves, revealing a misalignment between ground-state supervision and initial-guess quality . Figure 1: Size extrapolation of SAIL on B3LYP/def2-SVP. Matrix-based models trained on QM9 and evaluated on QM9, QM40, and QMugs, covering molecules with up to 10\times more heavy atoms than any seen during training. The vertical axis is the Effective Relative Iteration Count (ERIC) relative to the traditional baseline (MINAO), with \mathrm{ERIC}<1 indicating speedup and \mathrm{ERIC}>1 indicating slowdown. Baselines trained on ground-state targets degrade outside the training distribution, while SAIL maintains a \sim 25\% speedup across the full range. QMugs samples drug-like molecules while QM9 enumerates small organics, adding an additional chemical shift. 2 Background KS-DFT describes the quantum mechanical ground-state in terms of its electron density \rho^{*}\in\mathcal{D}_{N_{e}}=\{\mathbb{R}^{3}\rightarrow[0,\infty)|\int_{\mathbb{R}^{3}}\rho(\mathbf{r})\>d\mathbf{r}=N_{e}\} and energy E^{*}\in\mathbb{R} to determine most chemical properties of interest. Molecular DFT codes expand \rho in a finite set \{\chi_{\mu}\}_{\mu=1}^{B} of atom-centered basis functions \displaystyle\rho(\mathbf{r})=\sum_{\mu\nu}^{B}\chi_{\mu}(\mathbf{r})\,P_{\mu\nu}\,\chi_{\nu}(\mathbf{r})\>, (1) where \mathbf{P}\in\mathbb{R}^{B\times B} is the density matrix. In this representation, the ground-state energy functional E[\rho]\colon\mathcal{D}_{N_{e}}\rightarrow\mathbb{R} reduces to a function E(\mathbf{P})\colon\mathbb{R}^{B\times B}\rightarrow\mathbb{R} , and finding the ground state becomes an energy minimization problem within the space of valid density matrices ( 20 ) . SCF solvers approach this minimization problem iteratively. Each step computes the energy gradient \mathbf{F}=\partial E/\partial\mathbf{P} , the so-called Fock matrix, and obtains an updated density \mathbf{P}^{(t+1)} by solving a generalized eigenvalue problem (Appendix A ): \displaystyle\mathbf{P}^{(t+1)}=\mathrm{SCF}(\mathbf{P}^{(t)})=\left(\mathcal{M}_{\mathbf{F}\rightarrow\mathbf{P}}\circ\mathcal{M}_{\mathbf{P}\rightarrow\mathbf{F}}\right)(\mathbf{P}^{(t)})\>. (2) Figure 2: SCF cycle wall-time analysis at the B3LYP/def2-SVP level of theory, with jk-density-fitting. Each iteration constructs the Fock matrix \mathbf{F}^{(t)}=\mathcal{M}_{\mathbf{P}\to\mathbf{F}}(\mathbf{P}^{(t)}) and updates the density \mathbf{P}^{(t+1)}=\mathcal{M}_{\mathbf{F}\to\mathbf{P}}(\mathbf{F}^{(t)}) , see Eq. ( 2 ). The Fock build dominates at 97.8% of the iteration cost. Cost measured on a QM40 molecule with 30 heavy atoms using GPU4PySCF ( 24 ) . This map is applied until self-consistency is reached, meaning \mathbf{P}^{*}\simeq\mathrm{SCF}(\mathbf{P}^{*}) . In practice, convergence accelerators such as DIIS augment this fixpoint iteration and drastically alter its dynamics (Appendix A.1 ), but the quality of the initial guess \mathbf{P}^{(0)} remains critical. It determines both whether the solver converges and how many iterations it requires ( 21 ) . The standard initialization in most DFT codes is based on the superposition of atomic densities (SAD) ( 44 ) . Since wall-time reduction is the ultimate goal, understanding how the computational costs of an SCF step are distributed is essential. The Fock build \mathcal{M}_{\mathbf{P}\rightarrow\mathbf{F}} dominates the cost (Fig. 2 ). Its scaling depends on the choice of the exchange-correlation (XC) functional: \mathcal{O}(B^{3}) for semi-local functionals such as PBE and SCAN, and \mathcal{O}(B^{4}) for hybrid functionals like B3LYP ( 31 ) . Density fitting lowers the scaling of the electrostatic contribution to the Fock build from \mathcal{O}(B^{4}) to \mathcal{O}(B^{3}) by approximating the density (Eq. 1 ) as \rho(\mathbf{r})\approx\sum_{\mu}^{B_{\textrm{aux}}}c_{\mu}\,\chi^{(\text{aux})}_{\mu}(\mathbf{r}) , where \mathbf{c}\in\mathbb{R}^{B_{\text{aux}}} are the fitting coefficients and B_{\text{aux}}\ll B^{2} ( 46 ; 43 ) . Apart from enabling the \mathcal{O}(B^{3}) scaling of semi-local functionals, this expansion provides a natural interface between equivariant GNNs and the electron density. Since the auxiliary basis consists of equivariant functions centered on individual nuclei, the coefficients \mathbf{c} are directly predictable from node-level representations ( 37 ; 27 ) , unlike the density matrix representation, which couples basis functions across atom pairs. 3 Related Work Hamiltonian prediction methods are trained to predict the converged Fock matrix 1 1 1 In the context of finite basis sets calculations the Hamiltonian is commonly referred to as the Fock matrix \hat{\mathbf{F}}\approx\mathbf{F}^{*} ( 36 ; 50 ; 49 ; 48 ; 15 ; 16 ) , which can then serve as an SCF initialization

Read the complete text