Predicting energy of the quantum system from one- and two- electron integrals using Deep Learning.

Valerii Chuiko, Paul W. Ayers · 2025

Read Predicting energy of the quantum system from one- and two- electron integrals using Deep Learning. by Valerii Chuiko, Paul W. Ayers (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03849.txt.

Introduction

Valerii Chuiko, Giovanni Da Rosa, and Paul Ayers predict molecule energies with deep learning, in two thousand twenty-five. Their input is not the molecule's shape, but its one- and two-electron integrals, a compact record of its electronic structure. The descriptor they build stays unchanged when the molecule moves, turns, or is reframed.

An attention-based network learns from that descriptor and keeps a key property: energy scales cleanly with system size. Training on small, few-electron systems can thus guide calls on larger ones. They test the method on hydrogen clusters, a hard case where electrons are strongly linked. Results beat geometry-based learning models on accuracy, the authors report.

Catalog record

CREATORValerii Chuiko, Paul W. Ayers
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-03849

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Predicting energy of the quantum system from one- and two- electron integrals using Deep Learning. Preprint: AIP/123-QED Valerii Chuiko, Paul W. Ayers Abstract We propose a descriptor for molecular electronic structure that is based solely on the one- and two-electron integrals but is translationally, rotationally, and unitarily invariant. Then, directly exploiting size consistency, we train and then fine-tune a neural network to predict the energies of strongly-correlated systems, specifically hydrogen clusters. Because our network uses and preserves size-consistency, training on few-electron systems can guide predictions for systems with more electrons. I Introduction Modeling the electronic structure of substances is essential in many scientific disciplines, including materials science Rastogi, Tiwari, and Shrivastava 1993 ; Lin et al. 2014 ; Armstrong and Knott 2006 , pharmaceuticals Arodola and Soliman 2017 ; Fogueri et al. 2013 ; Gordon et al. 2007 , and catalysis Chen et al. 2017 ; Chen et al. 2010 . At its most fundamental level, this requires determining the electronic wavefunction, density matrix, or a descriptor that suffices to determine these quantities. Using the wavefunction/density matrix, researchers can then predict all observable molecular properties, including static properties (e.g., energy levels) and (thermo)dynamic properties (e.g., reaction kinetics). Determining the electronic wavefunction requires solving the Schrödinger equation. The exact solution of Schrödinger equation (within the function space defined by a chosen one-electron basis set) can be calculated using the Full Configuration Interaction (FCI) method. This method represents the wave function as a linear combination of all possible configurations of the system’s electrons. However, FCI suffers from the curse of dimensionality Bellman 1957 , which makes it computationally intractable for the vast majority of chemically-relevant systems. Consequently, traditional wave function methods rely on approximations and assumptions that limit their accuracy and applicability. In recent years, machine learning (ML) and, specifically, neural networks (NN), have emerged as powerful tools for predicting the energy of chemical systems, offering an efficient alternative to traditional electronic structure approaches Fabrizio et al. 2019 ; Muroga, Miki, and Hata 2023 ; Jinich et al. 2019 ; Schütt et al. 2017 ; Schütt et al. 2019 ; Noé et al. 2020 . These techniques can capture complex relationships within molecular data and generalize well to unseen molecules, significantly accelerating the computation of molecular energies and other properties. For example, neural networks can be trained to learn potential energy surfaces Schütt et al. 2017 ; Schütt et al. 2018 ; Schütt, Tkatchenko, and Müller 2018 , IR and Raman Spectra Muroga, Miki, and Hata 2023 , force fields in molecular dynamics simulations Brockherde et al. 2017 ; Zhang et al. 2018 ; Zeng 2023 , and even wavefunctions Schütt et al. 2019 and reduced density matrices Fertitta and Booth 2018 ; Shao et al. 2023 ; Delgado-Granados et al. 2025 . Advanced architectures like deep neural networks (DNNs), convolutional neural networks (CNNs), and graph neural networks (GNNs) have been applied to model molecular properties, leveraging vast datasets to improve their predictive capabilities. However, ML and deep learning (DL) methods have limitations. They require large amounts of high-quality data for training, which can be difficult to obtain, especially for less-studied systems or those involving rare or complex chemical species Dral 2020 . Additionally, these models can be prone to overfitting: they often perform well on training data but poorly on new, unseen, data Dral 2020 ; Huang and Lilienfeld 2021 . Despite these challenges, ML and DL are increasingly being integrated into the workflows of computational chemists and materials scientists, facilitating the discovery and design of new materials and drugs. The aim of this work is to address some of the most significant challenges associated with current deep learning (DL) methods for predicting electronic energies. Specifically, we focus on the need for (a) high-quality datasets, (b) rotational and translational invariance of the input features, and (c) transferability to new systems. These issues are critical for the development of reliable and generalizable DL models that can accurately predict the properties of a wide range of systems. Our methodology combines costly data curation (from FCI calculations), innovative featurization, and advanced recycling of available data. In the first part of this paper we introduce a descriptor of the electronic Hamiltonian that is rotationally, translationally, and unitarily invariant. Using this descriptor, every learned FCI sample can be used to predict the energy of an infinite number of chemically-equivalent systems. This descriptor also ensures that the mapping from the electronic Hamiltonian to the ground-state electronic energy has the correct mathematical properties. In the second part of this paper we use our descriptor to predict molecules’ electronic energy using standard Deep Learning methods. II Methodology As stated above before, our first task is to develop a descriptor that is invariant to changes in the representation of the system. Our descriptor will be based on the one- and two-electron integrals that define the Hamiltonian in second quantized form: \hat{H}=\sum_{pq}h_{pq}a_{p}^{\dagger}a_{q}+\frac{1}{2}\sum_{pqrs}V_{pqrs}a_{p}^{\dagger}a_{q}^{\dagger}a_{s}a_{r} (1) where \displaystyle h_{pq} \displaystyle=\int{\phi_{p}^{*}(\mathbf{r})\left(-\frac{\nabla^{2}}{2}-\sum_{n=1}^{N_{\text{atoms}}}{\frac{Z_{n}}{|\mathbf{r}-\mathbf{R}_{n}|}}\right)\phi_{q}(\mathbf{r})}\,d\mathbf{r} (2a) \displaystyle V_{pqrs} \displaystyle=\iint{\phi_{p}^{*}(\mathbf{r}_{1})\phi_{q}^{*}(\mathbf{r}_{2})\frac{1}{\left|\mathbf{r}_{1}-\mathbf{r}_{2}\right|}\phi_{r}(\mathbf{r}_{1})\phi_{s}(\mathbf{r}_{2})}\,d\mathbf{r}_{1}d\mathbf{r}_{2} (2b) and a_{p}^{\dagger} and a_{p} denote the fermion creation and annihilation operators for an electron in the p th spin-orbital. It is convenient express the one-electron operators as two-electron operators, so that the N -electron Hamiltonian can be described with only one type of term: \begin{split}\hat{H}_{N}&=\sum_{pqrs}\left[\frac{1}{2(N-1)}\left(h_{pq}\delta_{rs}+\delta_{pq}h_{rs}\right)+\frac{1}{2}V_{pqrs}\right]a_{p}^{\dagger}a_{q}^{\dagger}a_{s}a_{r}\\ &=\sum_{pqrs}k_{pqrs}a_{p}^{\dagger}a_{q}^{\dagger}a_{s}a_{r}\end{split} (3) To enforce unitary invariance, we recall that the only unitarily invariant properties of a matrix are its eigenvalues. This motivates us to rewrite the 4-dimensional tensor k_{pqrs} as a matrix. To do this, we project the Hamiltonian onto a geminal basis, where geminal creation and annihilation operators are defined as: \displaystyle g_{A}^{\dagger} \displaystyle=\frac{1}{\sqrt{2}}a_{p}^{\dagger}a_{q}^{\dagger} (4a) \displaystyle g_{A} \displaystyle=\frac{1}{\sqrt{2}}a_{q}a_{p} (4b) Unitary rotation of the geminal encapsulates unitary rotation of the orbitals. Sørensen 2023 Therefore, the eigenvalues of the Hamiltonian matrix elements in the geminal basis, k_{AB} , are the unitarily invariants of the Hamiltonian and therefore contain enough information to determine its eigenvalues. The eigenvalues of k_{AB} are rotationally, translationally, and unitarily invariant, so they are a suitable input for a traditional feed-forward neural network, as discussed in section IV . III Modeled Data We chose hydrogen clusters as test systems because they are extremely challenging for many quantum-mechanical models because of the presence of strong electron correlation, yet computationally tractable for benchmark FCI calculations. Specifically, we examine different geometric families of neutral 2-, 4-, 6-, 8-, and 10-atom hydrogen clusters. For each system we performed FCI calculations with the STO-6G basis set using PySCF Sun et al. 2018 . III.1 \text{H}{\vphantom{\text{X}}}_{\smash[t]{\text{2}}} ; 156 geometries We sampled the potential energy curve of \text{H}{\vphantom{\text{X}}}_{\smash[t]{\text{2}}} molecule from a bond length of 0.2 \mathrm{\SIUnitSymbolAngstrom} to 8 \mathrm{\SIUnitSymbolAngstrom} . III.2 \text{H}{\vphantom{\text{X}}}_{\smash[t]{\text{4}}} 865 geometries We selected three families of \text{H}{\vphantom{\text{X}}}_{\smash[t]{\text{4}}} structures: Paldus’s \text{H}{\vphantom{\text{X}}}_{\smash[t]{\text{4}}} system Li and Paldus 1995 , stretching linear \text{H}{\vphantom{\text{X}}}_{\smash[t]{\text{4}}} , and tetrahedral inversion. As before, the linear \text{H}{\vphantom{\text{X}}}_{\smash[t]{\text{4}}} stretch included interatomic separations from 0.2 \mathrm{\SIUnitSymbolAngstrom} to 8 \mathrm{\SIUnitSymbolAngstrom} . The tetrahedral family represented an inversion of a tetrahedron, with interatomic distances ranging from 1 \mathrm{\SIUnitSymbolAngstrom} to 5 \mathrm{\SIUnitSymbolAngstrom} . Paldus’s \text{H}{\vphantom{\text{X}}}_{\smash[t]{\text{4}}} family Li and Paldus 1995 spanned interatomic distances from 0.5 \mathrm{\SIUnitSymbolAngstrom} to 5 \mathrm{\SIUnitSymbolAngstrom} . III.3 \text{H}{\vphantom{\text{X}}}_{\smash[t]{\text{6}}} ; 1386 geometries We selected three families of \text{H}{\vphantom{\text{X}}}_{\smash[t]{\text{6}}} structures: planar symmetry breaking, a triangular antiprism, and octahedral distortions. To study symmetry-breaking, we overlapped two equilateral triangles in

Read the complete text