Coupled Cluster con MōLe: Molecular Orbital Learning for Neural Wavefunctions Luca Thiede, Abdulrahman Aldossary, Andreas Burger, Jorge Arturo Campos-Gonzalez-Angulo, Ning Wang, Alexander Zook, Melisa Alkan, Kouhei Nakaji, Taylor Lee Patti, Jérôme Florian Gonthier, Mohammad Ghazi Vakili, Alán Aspuru-Guzik Abstract Density functional theory (DFT) is the most widely used method for calculating molecular properties; however, its accuracy is often insufficient for quantitative predictions. Coupled-cluster (CC) theory is the most successful method for achieving accuracy beyond DFT and for predicting properties that closely align with experiment. It is known as the “gold standard” of quantum chemistry. Unfortunately, the high computational cost of CC limits its widespread applicability. In this work, we present the Molecular Orbital Learning (MōLe) architecture, an equivariant machine learning model that directly predicts CC’s core mathematical objects, the excitation amplitudes, from the mean-field Hartree-Fock molecular orbitals as inputs. We test various aspects of our model and demonstrate its remarkable data efficiency and out-of-distribution generalization to larger molecules and off-equilibrium geometries, despite being trained only on small equilibrium geometries. Finally, we also examine its ability to reduce the number of cycles required to converge CC calculations. MōLe can set the foundations for high-accuracy wavefunction-based ML architectures to accelerate molecular design and complement force-field approaches. 1]Department of Computer Science, University of Toronto, Sandford Fleming Building, 10 King’s College Road, ON M5S 3G4, Toronto, Canada 2]Vector Institute for Artificial Intelligence, 661 University Ave. Suite 710, ON M5G 1M1, Toronto, Canada 3]Department of Chemistry, University of Toronto, Lash Miller Chemical Laboratories, 80 St. George Street, ON M5S 3H6, Toronto, Canada 4]Key Lab of Electromagnetic Processing of Materials, Ministry of Education, Northeastern University, 314 Mailbox, Shenyang, 110819, People’s Republic of China 5]NVIDIA, 431 King St W #6th, M5V 1K4, Toronto, Canada 6]Department of Materials Science & Engineering, University of Toronto, 184 College St., M5S 3E4, Toronto, Canada 7]Department of Chemical Engineering & Applied Chemistry, University of Toronto, 200 College St. ON M5S 3E5, Toronto, Canada 8]Acceleration Consortium, 700 University Ave., M7A 2S4, Toronto, Canada 9]Senior Fellow, Canadian Institute for Advanced Research (CIFAR), 661 University Ave., M5G 1M1, Toronto, Canada \contribution [†]Contributed equally to this work. \correspondence Alán Aspuru-Guzik at Computational chemistry aims to predict the properties of molecules in silico , thereby facilitating insight into atomistic processes and advancing fields ranging from materials science to drug discovery. Density functional theory (DFT) has become the mainstream workhorse in computational chemistry, offering a good trade-off between speed and accuracy 28 ; 63 ; 37 . DFT solves a self-consistent field (SCF) problem to obtain the electron density, from which other properties can be derived. To further speed up DFT, recent work uses ML models to predict good initial guesses in the form of Hamiltonian matrices 73 ; 36 ; 25 ; 32 , density matrices 57 ; 20 ; 13 or the electron density 10 ; 29 ; 7 ; 14 ; 23 ; 48 ; 19 ; 34 ; 60 . Aside from DFT acceleration, a rapidly growing class of Machine-Learned Interatomic Potentials (MLIPs) provides accurate (relative to DFT) energies and forces at low cost by learning to imitate DFT properties 39 ; 38 ; 9 ; 2 . However, even the best DFT functionals are limited in accuracy, in turn making MLIPs unreliable for applications that demand a high level of precision. Thus, higher-accuracy ab initio methods are essential for reliably describing molecular properties. Among these methods, coupled cluster (CC) theory with single, double, and perturbative triples [CCSD(T)] is often considered the “gold standard” of quantum chemistry, achieving “chemical accuracy” (errors \lesssim 1.6 mHa) with respect to experimental data across various systems 58 ; 44 ; 11 ; 21 . Unfortunately, the high computational cost of CCSD(T), which scales as \mathcal{O}(N^{7}) with system size limits its routine application to small molecules. Non-perturbative versions of coupled cluster, either excluding triple excitations in CCSD or including triple excitations fully as in CCSDT, result in scalings of \mathcal{O}(N^{6}) and \mathcal{O}(N^{8}) , respectively. To overcome the limitations of DFT and bring down the cost of correlated wavefunction methods, machine learning approaches explored learning from coupled cluster with property prediction with MLIPs 59 ; 22 ; 40 ; 43 , effective hamiltonian matrix prediction 64 , direct prediction with manually designed physics-inspired features with XGBoost and K-Nearest Neighbors 67 ; 66 , neural DFT-functionals 35 ; 16 ; 24 as well as other beyond-DFT targets such as ML Green’s-function representations 68 ; 69 ; 56 , active orbital prediction for selected CI 26 and neural networks as generalizing wavefunction representations 17 ; 54 in variational quantum Monte Carlo. The CC (de-)excitation amplitudes encode the complete correlated response of the electronic system. A model that learns these amplitudes can therefore recover the full CC property manifold. In this work, we propose the Molecular Orbital Learning model (MōLe) that extends the idea of neural surrogates for densities to CC amplitudes. By lowering the complexity barrier of CC methods, we hope to expand their use and enable highly accurate property predictions across more applications than is currently possible. Our contributions are the following: 1. We design the first symmetry-aware neural architecture that takes molecular orbitals as input and outputs CC T-amplitudes. 2. We recalculate the QM7 52 ; 5 dataset at the CCSD/def2-SVP level of theory and several out-of-distribution datasets using out-of-equilibrium geometries and much larger systems compared to QM7. 3. We demonstrate that our model successfully predicts the CCSD amplitudes, resulting in energy errors of \sim 0.1 mHa, electron densities more accurate than MP2, and significantly fewer SCF iterations. 4. We show that, compared to MLIPs, even when trained with \Delta -MP2-learning 49 , our model is more data efficient in- and out-of-distribution. 1 Theory 1.1 Hartree–Fock and molecular orbitals In the Hartree–Fock (HF) approximation 51 ; 63 , the many-electron wavefunction is represented by a single Slater determinant of orthonormal molecular orbitals (MOs) {\psi_{p}(\mathbf{r}|\{\mathbf{R}_{A})\}} , where \{\mathbf{R}_{A}\} are the nuclear coordinates. Each MO \psi_{p}(\mathbf{r}|\{\mathbf{R}_{A}\}) is expanded in an atomic-orbital (AO) basis as \psi_{p}(\mathbf{r})=\sum_{A}\sum_{k\in\mathcal{K}_{A}}\sum_{\ell\in\mathcal{L}_{A,k}}\sum_{m=-\ell}^{\ell}C_{pA,k\ell m}\,\phi_{k\ell}^{m}(\underbrace{\mathbf{r}-\mathbf{R}_{A}}_{:=\mathbf{r}_{A}}). Here, A labels atoms with positions \mathbf{R}_{A} , while k,\ell,m are the principal, azimuthal, and magnetic quantum numbers. The sets \mathcal{K}_{A} and \mathcal{L}_{A,k} refer to the element-dependent shells and sub-shells, respectively, included in the chosen basis on atom A , and C_{pA,k\ell m} are the MO coefficients. There are usually as many molecular spatial orbitals as there are atomic orbitals N_{\text{AO}} . The first N_{\text{electron}} molecular orbitals are called occupied, while the remaining N_{\text{AO}}-N_{\text{electron}} are called virtual orbitals. Throughout the paper, we will use the letters p and q to index all orbitals; i and j refer to occupied orbitals, and a and b to virtual orbitals. \phi_{k\ell}^{m}(\mathbf{r}_{A})=R_{k}(|\mathbf{r}_{A}|)Y_{\ell}^{m}(\hat{\mathbf{r}}_{A}) are constructed from the pre-tabulated radial basis function R_{k}(r) and the spherical harmonic Y_{\ell}^{m}(\hat{\mathbf{r}}) . To calculate the MO coefficients, we solve the Roothaan-Hall equations \mathbf{F}(\mathbf{C})\mathbf{C}=\mathbf{C}\mathbf{\varepsilon}, (1) with \mathbf{F}(\mathbf{C}) the Fock matrix, \mathbf{C} the MO coefficient matrix, and \mathbf{\varepsilon} the diagonal matrix of orbital energies. Since \mathbf{F} depends on \mathbf{C} , this equation is solved iteratively. The columns of \mathbf{C} are eigenvectors, and therefore the MO coefficients are only determined up to an arbitrary sign. See Section B.1 for more details. Intuitively, the Hartree-Fock wavefunction is the best approximate solution to the Schrödinger equation under the assumption that the electronic positions do not explicitly correlate with each other. To move past this limiting assumption, “post-Hartree-Fock” methods build on the Hartree-Fock wavefunction and introduce correlation in a systematically improvable manner. Møller–Plesset perturbation theory (MP n ) and Coupled Cluster are among the most broadly used post-Hartree-Fock correlation methods. 1.2 Møller-Plesset-2 (MP2) MP n 41 ; 63 is a perturbative expansion of the electronic correlation energy around the Hartree–Fock reference up to the n -th order. MP2 is the first nontrivial correction given by: \displaystyle E_{\text{MP2}} \displaystyle=\frac{1}{4}\sum_{i,j,a,b}\underbrace{\frac{\langle ij||ab\rangle}{\varepsilon_{i}+\varepsilon_{j}-\varepsilon_{a}-\varepsilon_{b}}}_{t_{ij,\text{MP2}}^{ab}}\langle ij||ab\rangle, (2) with molecular orbital energies \varepsilon_{p} and \langle ij||ab\rangle , the integral between orbitals i,j,a,b , see Section B.2 for background on integrals. MP2 formally scales as \mathcal{O}(N^{5}) with a relatively small prefactor, since there is no need to solve an equation self-consistently. 1.3 Coupled cluster with single and double excitations The coupled cluster method 46 ; 63 expresses the exact electronic wavefunction as an exponential excitation of a reference Hartree-Fock wavefunction: \ket{\Psi_\text{CC}}=e^{\hat{T}}\ket{\Phi_{\text{HF}}}, (3) where the cluster operator \hat{T}=\hat{T}_{1}+\hat{T}_{2}+\hat{T}_{3}+\cdots generates single, double, triple, and higher excitations out of the reference state. Truncating \hat{T} to a given excitation rank defines a hierarchy of systematically improvable methods: coupled cluster with singles and doubles (CCSD) includes single and double excitations, CCSDT adds triples, CCSDTQ adds quadruples, and so on. Therefore, in CCSD, the correlated wavefunction is \ket{\text{CCSD}}=\exp\!\left(\hat{T}_{1}+\hat{T}_{2}\right)\ket{\Phi_{\text{HF}}}, (4) with \displaystyle\hat{T}_{1}=\sum_{ia}t_{i}^{a}\,\hat{a}^{\dagger}_{a}\hat{a}_{i},\quad\hat{T}_{2}=\tfrac{1}{4}\sum_{ijab}t_{ij}^{ab}\,\hat{a}^{\dagger}_{a}\hat{a}^{\dagger}_{b}\hat{a}_{j}\hat{a}_{i}, (5) with t_{i}^{a} and t_{ij}^{ab} the singles and doubles amplitudes, and \hat{a} and \hat{a}^{\dagger} the Fermionic annihilation and creation operators. The CCSD amplitudes, t_{i}^{a} and t_{ij}^{ab} , are the key objects which we usually obtain by solving a non-linear system of equations, see more in Section B.3 . Solving the CCSD equations formally scales as \mathcal{O}(N^{6}) , with a large prefactor. MP2 can be understood as the first-order approximation to coupled-cluster theory: t_{ij,\text{CCSD}}^{ab}\approx t_{ij,\text{MP}2}^{ab}. (6) Since MP2 is computationally inexpensive compared to CCSD, it is typically used to initialize CCSD calculations. An essential characteristic of the T-amplitudes, t_{i}^{a} and t_{ij}^{ab} , is their asymptotic behavior as a function of the associated molecular orbitals separation: for two infinitely separated, closed shell molecular systems A and B, after localization (see Section 1.4 ), the molecular orbitals will be uniquely associated with either system A or B. Therefore, any excitation amplitude involving orbitals from both noninteracting subsystems A and B vanishes. The CC amplitudes are all that is required to approximately calculate any electronic ground-state property of the system. 30 Most notably, this includes the correlation energy \displaystyle E_{\text{correlation}}=\sum_{ijab}\left(\frac{1}{4}t_{ij}^{ab}+\frac{1}{2}t_{i}^{a}t_{j}^{b}\right)\langle ij||ab\rangle. (7) This expression also holds for higher orders of non-perturbative CC methods, i.e., CCSDT, CCSDTQ, etc. Thus, we only ever need to predict the T_{1} and T_{2} tensors for energies, opening the door for our MōLe model to move beyond CCSD energies in the future. 1.4 Localized Molecular Orbitals Canonical molecular orbitals (MOs), as defined in Eq. 1 , are generally delocalized over the entire molecule. We can transform MOs into a localized representation that leaves all observables invariant, see Appendix D . We hypothesize that locality represents an essential inductive bias 8 that facilitates easier training, which we experimentally confirm in Table S1 in the Appendix. Therefore, we use localized orbitals for all of our models. 2 Equivariance and equivariant models Many mappings of physical properties are equivariant under coordinate-system transformations, meaning they transform predictably. Formally, a function \bm{f}:\bm{X}\rightarrow\bm{Y} is equivariant with respect to the elements g of a group \mathcal{G} , which acts on \bm{X} and \bm{Y} via D_{\bm{X}}(g) and D_{\bm{Y}}(g) , if \bm{f}(D_{\bm{X}}(g)\bm{x})=D_{\bm{Y}}(g)\bm{f}(\bm{x}). (8) Oftentimes, the group \mathcal{G} of interest is \mathrm{SO}(3) the group of rotations in three-dimensional space, denoted by \bm{Q}=\quantity(\alpha,\beta,\gamma) , the Euler angles 65 ; 18 . The irreducible representations (irreps) of this group are known as the Wigner-D matrices, with elements D_{\ell}^{mm^{\prime}}(\mathbf{Q}) , where the parameter \ell is determined by the space they act upon. For example, the Hartree-Fock algorithm is the map that assigns to each molecular geometry \{\mathbf{R}\} a set of angular-momentum–labeled coefficient vectors that represent the molecular orbitals, \mathbf{C}_{pA,k\ell}(\{\mathbf{R\}}):\mathbb{R}^{3N_{\text{Atoms}}}\rightarrow\mathbb{R}^{2\ell+1} . This map is equivariant with respect to spatial rotations: \displaystyle\mathbf{C}_{pA,k\ell}(D_{1}(\mathbf{Q})\{\mathbf{R\}})=D_{\ell}(\mathbf{Q})\mathbf{C}_{pA,k\ell}(\{\mathbf{R\}}). (9) In contrast, the amplitudes t_{i}^{a} and t_{ij}^{ab} are invariant under rotations of the molecule: \displaystyle t_{ij}^{ab}(D_{1}(\mathbf{Q})\{\mathbf{R}\})=t_{ij}^{ab}(\{\mathbf{R}\}) (10) Another important symmetry is sign equivariance: If the signs of one of the molecular orbitals i,j,a or b associated with t_{ij}^{ab} flips, the amplitude also flips its sign. Formally, for the amplitude t_{ij}^{ab}=t(\mathbf{C}_{i},\mathbf{C}_{j},\mathbf{C}_{a},\mathbf{C}_{b}) we have \displaystyle t(-\mathbf{C}_{i},\mathbf{C}_{j},\mathbf{C}_{a},\mathbf{C}_{b}) \displaystyle=t(\mathbf{C}_{i},-\mathbf{C}_{j},\mathbf{C}_{a},\mathbf{C}_{b})=... \displaystyle...=-t(\mathbf{C}_{i},\mathbf{C}_{j},\mathbf{C}_{a},\mathbf{C}_{b}). (11) 2.1 Equivariant Neural Networks Equivariant neural networks are models that, by design, respect the equivariance property in Eq. 8 , often leading to greater data efficiency ( 6 ; 42 ; 62 ) . ML models for atomistic modeling are usually designed to respect the permutation of feature labels and \mathrm{O}(3) symmetries by modeling the system as a graph neural network (GNN) with features \mathbf{h}_{i,k,\ell,m} that carry the \mathrm{O}(3) irreps, and therefore transform under rotation with the Wigner D-matrices. Two symmetry-adapted features, \mathbf{p}_{\ell_{1}} and \mathbf{g}_{\ell_{2}} , can interact with each other while preserving equivariance using the bilinear Clebsch-Gordan tensor product ( 65 ) \displaystyle\mathbf{h}_{\ell_{3}m_{3}}=\sum_{m_{1}=-\ell_{1}}^{\ell_{1}}\sum_{m_{2}=-\ell_{2}}^{\ell_{2}}\mathcal{C}_{\ell_{1}m_{1},\ell_{2}m_{2}}^{\ell_{3}m_{3}}\mathbf{p}_{\ell_{1}m_{1}}\mathbf{g}_{\ell_{2},m_{2}}, (12) where \mathcal{C}_{(\ell_{1},m_{1}),(\ell_{2},m_{2})}^{(\ell_{3},m_{3})} is the Clebsch-Gordan coefficient that implements the \mathrm{O}(3) -equivariant coupling of the irreps \ell_{1} and \ell_{2} into the output irrep \ell_{3} , mapping basis elements \quantity(\ell_1,m_1) and \quantity(\ell_2,m_2) to \quantity(\ell_3,m_3) . Equation 12 is used to build equivariant message passing from irrep-carrying node and edge features. See Appendix A for more details. The MACE architecture 3 is one of the most prominent equivariant message-passing architectures and will be an important component of our model design; see Section 3.2.2 . 3 MōLe architecture Figure 1 : Given a molecule, a Hartree-Fock calculation provides the molecular orbitals represented by their coefficient matrix \mathbf{C} . The coefficient vector is padded for each atom to ensure that they all have the same number of basis coefficients, enabling their embedding in an equivariant neural network. The model then alternates message passing to mix information within the MOs and attention layers to mix information between MOs. Finally, the embeddings are read out by “outer product-like” operations, outputting the T_{1} and T_{2} amplitudes. Our MōLe architecture design is guided by satisfying MO and CC wavefunction symmetries and asymptotics: 1. MO coefficients are rotation equivariant, Eq. 9 2. T-amplitudes are rotation invariant, Eq. 10 3. T-amplitudes are sign equivariant, Eq. 11 4. The T-amplitudes coupling the localized MOs of two infinitely-separated closed-shell molecules are 0. An overview of the model architecture is shown in Fig. 1 , and details are provided in Fig. 2 . Figure 2 : On the left, we are summarizing the key components of the MōLe architecture, consisting of a padding and embedding layer, (T) transformer layers, and finally the T_{1} and T_{2} readout. On the right, we are further detailing the attention mechanism, as well as the T_{1} and T_{2} readout of our architecture. The model proceeds in four main steps: first, we run a Hartree-Fock calculation and localize the MOs. We then “embed” the coefficients onto “graph-states”, one graph per MO, by initializing equivariant GNN features with the MO coefficients. The features are then processed by (T) transformer blocks, each combining a MACE-like layer, a layer norm, and an attention mechanism to capture local atomic and long-range orbital correlations. Finally, a readout layer converts the latent MO features into T_{1} and T_{2} amplitudes. 3.1 MO embedding Since different atom types have different numbers of basis functions, but GNNs expect all atoms to have the same number of features, we need to pad the MO coefficients before we can use them as initial features in our equivariant GNN, see Fig. 1 for an illustration and Section E.1 for details. Using an equivariant linear layer \mathbf{W}_{\ell,k\bar{k}} , the initial MO coefficients are then embedded into a hidden dimension K,k\in\{1,...,K\} that will be kept throughout the transformer blocks: \mathbf{x}^{(0)}_{pA,k\ell m}=\sum_{\bar{k}}W_{\ell,k\bar{k}}^{(0)}C_{pA,\bar{k}\ell m}^{\text{padded}}, (13) where \mathbf{W}_{\ell,k\bar{k}} are learnable equivariance preserving weight matrices. Note that, in contrast to machine learning force fields where a single graph neural network maps to a target property, here, there are N_{MO} graph neural networks in parallel, one for each MO, with the same weights shared across them. 3.2 Equivariant Transformer block Next, an equivariant transformer block processes the MO embeddings across multiple transformer layers, where each layer transforms the input features while preserving their shape, rotation and sign equivariance, and only makes MOs interact if they belong to the same fragment. The t -th layer transforms the input features \mathbf{x}^{(t)}_{pA}=\{x^{(t)}_{pA,k\ell m}\} to produce output features \mathbf{x}^{(t+1)}_{pA} of the same shape. Throughout the paper, we use bold letters to denote arrays without specifying their indices. The transformer consists of three main components: a MO-Attention block to capture correlation between MOs, a normalization layer, and “Odd-MACE” to mix features within an MO, interleaved with skip connections as shown in Fig. 2 . 3.2.1 MO-Attention The MO-Attention mechanism processes the MO embeddings through multi-head attention, where each head applies learnable weight matrices to construct the query, key, and value representations. For each attention head h , the weight matrices \mathbf{W}^{(Q,h,t)} , \mathbf{W}^{(K,h,t)} , and \mathbf{W}^{(V,h,t)} project x^{(t)}_{pA,k\ell m} to the key, query and values features: \displaystyle Q_{pA,k\ell m}^{(h,t)} \displaystyle=\sum_{\bar{k}}W^{(Q,h,t)}_{\ell,k\bar{k}}x^{(t)}_{pA,\bar{k}\ell m}, (14) and similarly for K and V. Next, we normalize the L_{2} norm of the features: \displaystyle\tilde{Q}_{pA,k\ell m}^{(h,t)}=\text{Norm}_{\epsilon}(\mathbf{Q}_{p}^{(h,t)}),\quad\tilde{K}_{pA,k\ell m}^{(h,t)}=\text{Norm}_{\epsilon}(\mathbf{K}_{p}^{(h,t)}) with \displaystyle\text{Norm}_{\epsilon}(\mathbf{X}_{p}^{(h,t)}) \displaystyle=\frac{X_{pA,k\ell m}^{(h,t)}}{\sqrt{\sum_{Ak\ell m}|X_{pA,k\ell m}^{(h,t)}|^{2}}+|\epsilon|}, (15) where \epsilon is learnable. The attention score S_{p,q}^{(h,t)} between MO p and MO q is computed as: S_{pq}^{(h,t)}=\sum_{Ak\ell m}\tilde{Q}_{pA,k\ell m}^{(h,t)}\cdot\tilde{K}_{qA,k\ell m}^{(h,t)}. (16) To preserve sign equivariance, we skip the usual softmax normalization and directly sum and renormalize the attention-weighted contributions, which is structurally similar to previously proposed transformer variants like the TransNormer 47 : \tilde{o}^{(h,t)}_{pA,k\ell m}=\sum_{q}\tilde{S}_{pq}^{(h,t)}V_{qA,k\ell m}^{(h,t)},\quad o^{(h,t)}_{pA,k\ell m}=\text{Norm}_{\epsilon}(\mathbf{\tilde{o}}^{(h,t)}_{p}) Finally, we sum over the different heads: x^{(t+1)}_{pA,k\ell m}=\sum_{h}w_{h}^{(t)}o^{(h,t)}_{pA,k\ell m}, where w_{h} are learnable parameters. The updated node features \mathbf{x}^{(t+1)}_{pA} are then passed to the “Odd-MACE” block. Since the attention only uses inner products between features with the same \ell , which is rotation invariant, and a L_{2} norm, which is rotation invariant, the attention weights are also rotation invariant. Summing the rotation-equivariant features with invariant weights therefore preserves rotation equivariance of the attention mechanism. Sign equivariance is preserved because the inner product is sign equivariant with respect to both MO features. Finally, if two MOs are localized on two non-interacting fragments, their inner product is 0, since there are no overlapping non-zero coefficients. Therefore, the attention mechanism preserves size-extensivity. 3.2.2 Odd-MACE To allow mixing within each MO feature, one MACE layer is applied after each attention block. MACE is an equivariant neural network, where the key equivariant non-linear operation can be viewed as a tensor polynomial in the irreps-carrying features, \mathbf{x}_{p,A,k}^{(\nu)}=\sum_{\xi=0}^{\nu}\sum_{k^{\prime}}\mathbf{W}^{(\xi)}_{k,k^{\prime}}\,\bigl(\mathbf{x}_{p,A,k^{\prime}}\bigr)^{\otimes\xi}. (17) The tensor power (\mathbf{h}_{p,k^{\prime}})^{\otimes\xi} denotes the stack of all order- \xi equivariant tensor products constructed by repeated application of Eq. 12 to the components of \mathbf{x}_{p,k^{\prime}} , and \mathbf{W}^{(\xi)}_{k,k^{\prime}} is a learned linear map. The tensor polynomial is applied to the node features after each message-passing layer. In practice, Eq. 17 is implemented efficiently using Horner’s method. It is important to note that the even tensor monomials are sign invariant, while the odd tensor monomials are sign equivariant. Thus, to enforce sign equivariance in our model, we restrict the monomial order \xi in Eq. 17 to the odd ones, which we call “Odd-MACE”. Since MACE is an equivariant neural network, it preserves the rotational equivariance of the MO features. Message passing itself is sign equivariant with respect to its input features, such that together with the restriction to odd monomials, Odd-Mace ensures sign equivariance. Finally, the cutoff radius enforced in message passing prevents interactions between far-separated fragments, thereby ensuring size extensivity. 3.3 Layer Normalization Our architecture interleaves equivariant layer normalization blocks between each attention and an Odd-MACE block, as shown in Fig. 2 . The layer normalization is inspired by 33 , however, we found it beneficial to make \epsilon learnable. Please see Section E.2 for details. 3.4 Readout The readout layers transform the latent MO features into the final T 1 and T 2 amplitudes. 3.4.1 T 1 readout The T 1 readout combines features from two molecular orbitals (one occupied orbital i and one virtual orbital a ) to produce single excitation amplitudes. We start by normalizing each feature using: \tilde{x}_{iA,k\ell m}^{(T)}=\text{Norm}_{\epsilon}(\mathbf{x}_{i}^{(T)}). (18) Using an element-wise tensor product, we calculate invariant pairwise features for every \ell : \displaystyle\tilde{y}_{iA,\bar{k}\ell m}^{(T)}=W_{\ell,,k\bar{k}}^{\text{single}}\tilde{x}_{iA,\bar{k}\ell m}^{(T)},\quad\tilde{y}_{aA,\bar{k}\ell m}^{(T)}=W_{\ell,k\bar{k}}^{\text{single}}\tilde{x}_{aA,\bar{k}\ell m}^{(T)} \displaystyle y_{ia,k,\ell}=\sum_{A,m_{1},m_{2}}\tilde{y}_{iA,\bar{k}\ell m_{1}}^{(T)}\tilde{y}_{aA,\bar{k}\ell m_{2}}^{(T)}\mathcal{C}^{00}_{\ell,m_{1},\ell,m_{2}}, (19) where W_{\ell,k\bar{k}}^{\text{single}} are learnable weights. Finally, a sign equivariant “Odd-MLP” (no bias and tanh nonlinearity) processes the features to predict the final amplitudes: t_{i}^{a}=\text{Odd-MLP}(\mathbf{y}_{ia}). (20) 3.4.2 T 2 readout The T 2 readout combines features from two occupied orbitals i and j , and two virtual orbitals a and b , to produce double excitation amplitudes. First, we calculate intermediate pair-features: \displaystyle\tilde{f}_{iaA,k\ell m} \displaystyle=\sum_{\ell_{1}m_{1}\ell_{2}m_{2}}w^{(1)}_{\bar{k}\ell\ell_{1}\ell_{2}}x_{iA,k\ell_{1}m_{1}}^{(T)}x_{aA,\bar{k}\ell_{2}m_{2}}^{(T)}\mathcal{C}^{\ell m}_{\ell_{1}m_{1}\ell_{2}m_{2}}, \displaystyle f_{iaA,k\ell m} \displaystyle=\text{Norm}_{\epsilon}(\mathbf{\tilde{f}}_{ia}), \displaystyle f^{\prime}_{iaA,k\ell m} \displaystyle=\sum_{\bar{k}}W_{\ell,k\bar{k}}f_{iaA,\bar{k}\ell m} and similar for the j,b orbitals, resulting in f_{jbA,k\ell m} These intermediate representations are then further combined to create the final four-orbital features: y_{ijab,k\ell}=\sum_{A}\sum_{m}f^{\prime}_{iaA,k\ell m}f^{\prime}_{jbA,k\ell m}C^{00}_{\ell,m,\ell,m}, (21) used to predict the amplitudes with an Odd-MLP: t_{ij}^{ab}=\text{Odd-MLP}(\mathbf{y}_{ijab})+t_{ij,\text{MP2}}^{ab}, (22) Since we need the two-particle integrals for evaluating the energies anyway (see Eq. 7 ), we get the MP2 amplitudes for free. Therefore, we train our model to predict only the difference between MP2 and CCSD amplitudes, a technique denoted by \Delta -MP2-learning 49 . 4 Experiments Our experimental goal is to assess the efficacy of our neural network surrogate for coupled-cluster (CC) amplitudes in predicting corrections from MP2 to CCSD amplitudes and whether these predictions yield strong performance on downstream tasks. Fundamentally, our thesis is that CC methods are too expensive to afford large-scale datasets on large molecules. This is already true for CCSD, but it would be even more severe if we moved to higher-order CC methods, such as CCSDT. Therefore, we will restrict ourselves to training on the relatively small QM7 dataset. We are then interested in six aspects of our model: 1. In-distribution accuracy: How well does MōLe reproduce CCSD energies on the QM7 test split? 2. Size extrapolation: How well does the model generalize to molecules significantly larger than those in the training distribution? 3. Off-equilibrium extrapolation: Can the model remain accurate for off-equilibrium geometries, even though it is trained only on equilibrium structures? 4. Ultra low data regime: How well does MōLe perform when trained on 100 samples only? 5. Other properties: To what extent do amplitude predictions support accurate prediction of other observables, such as the electron density? 6. SCF convergence: Can the predicted amplitudes serve as a good initial guess, reducing CCSD solver iterations? Given the restriction to small datasets, we are particularly interested in the data efficiency of our model. To contextualize the data efficiency, we compare it against the MACE and eSEN 15 MLIP architectures. For fairness, we train the MLIPs in a \Delta -learning setting, where we predict only the correction from MP2 to CCSD energies. We also train a model without delta learning to add context for the results one would obtain with standard MACE training. We emphasize that MLIPs and amplitude-based models target different objectives: MLIPs prioritize speed and scalability, whereas MōLe is designed for data efficiency, completeness of properties, and CC-compatibility. Therefore, the comparison should be interpreted as a reference point rather than a claim that MōLe is a universal replacement for MLIPs. Table 1 : Mean absolute error of energy predictions in mHa. "MACE ( \Delta -MP2)" and "eSEN ( \Delta -MP2)" models are trained to predict \Delta E=E_{\text{CCSD}}-E_{\text{MP2}} while "MACE" is trained to predict E_{\text{CCSD}} directly. MōLe was trained to predict \Delta t_{ij}^{ab}=t_{ij,\text{CCSD}}^{ab}-t_{ij,\text{MP2}}^{ab} . We train each model on a 100 molecule subset (denoted “Model”-100), and on the full training split (5732 molecules) of QM7 (denoted “Model”). The 100 molecule models are averaged over three seeds. Pure MACE without MP2 scales square up to a certain system size, and then linear due to cutoff radii. Similar cutoffs can be made for wavefunction methods as well but are harder to implement, which is why we list them as the fifth power here. Train set Size extrapolation Out-of-equilibrium Model Complexity QM7 Amino acids PubChem Diels-Alder Dihedral scan Chair-to-boat MACE-100 \mathcal{O}(N) – \mathcal{O}(N^{2}) 19.15 26.41 64.89 15.01 15.37 26.56 MACE-100 ( \Delta -MP2) \mathcal{O}(N^{5}) 1.64 5.53 5.29 3.17 0.79 1.16 eSEN-100 ( \Delta -MP2) \mathcal{O}(N^{5}) 1.48 7.43 17.41 5.55 2.74 2.53 MōLe-100 \mathcal{O}(N^{5}) 0.66 0.67 2.80 1.50 0.33 0.24 MACE \mathcal{O}(N) – \mathcal{O}(N^{2}) 1.83 10.60 17.74 7.05 4.61 4.50 MACE ( \Delta -MP2) \mathcal{O}(N^{5}) 0.16 \mathbf{0.49} 2.24 1.57 0.35 0.39 eSEN ( \Delta -MP2) \mathcal{O}(N^{5}) 0.13 1.56 4.66 1.15 0.59 0.66 MōLe \mathcal{O}(N^{5}) 0.12 0.78 1.63 1.16 0.22 0.08 4.1 QM7 experiments QM7 consists of 7165 small organic molecules composed of C, N, O, S, and H. We use geometries provided in the original paper 52 ; 5 and recompute all labels at the CCSD/def2-SVP 71 level of theory. For each molecule, we store the full set of coupled-cluster amplitudes. We train a model on an 80/20 split, and additionally, three models on 100-molecule subsets using three random seeds. Hyperparameters and training details for MōLe and the MLIPs are provided in Appendix H . We are using the checkpoint obtained from training on QM7 for all the following evaluations. The mean absolute error (MAE) on the QM7 test set for the T_{1} amplitudes is 6.5\times 10^{-5} and 9.84\times 10^{-7} for the T_{2} amplitudes. This translates to an excellent energy error of 0.12 mHa, slightly better than the \Delta -MP2 MLIPs (see table 1 ) and significantly better than the non \Delta -learning MACE model. Surprisingly, even on the much smaller 100 molecule subset, MōLe achieves strong energy predictions of 0.66 mHa. In this low-data regime, the data efficiency gap to the MLIPs becomes very clear. As an example, we plot the prediction of MōLe and the ground truth amplitudes in Fig. S1 in the Appendix, illustrating that MōLe successfully predicts the highly non-trivial amplitude pattern. Next, we evaluate our model on several out-of-distribution datasets, each of which we generate at CCSD/def2-svp level of theory. 4.2 Size extrapolation experiments To study the size generalization, we evaluate MōLe on two out-of-distribution datasets containing molecules twice the size of those in QM7. This is particularly important given the steep scaling cost of CC methods, rendering the generation of datasets with large molecules prohibitive. Amino acids The amino acids dataset contains 18 structurally diverse amino acids with up to 15 heavy atoms. PubChem We further construct a diverse benchmark by randomly sampling 100 molecules from the PubChem database, containing 14 heavy atoms made from C, H, N, and O. The PubChem test set represents the most diverse and chemically challenging benchmark in our evaluation. Table 1 shows that MōLe generalizes better to larger molecules, in particular in the ultra-low data regime. 4.3 Off equilibrium experiments We also test the model’s ability to generalize to off-equilibrium geometries, despite being trained only on equilibrium structures, using three distinct chemical systems: Diels-Alder reaction The Diels-Alder reaction is one of the most commonly studied reactions in chemistry. As an example, we use the Diels-Alder reaction path, turning ethylene and 1,3-butadiene into cyclohexene. The energy error along the intrinsic reaction coordinate is shown in Fig. 3a Dihedral Scan Next, we perform a dihedral scan of the butane molecule, as it forces the geometry through a transition point. The energy error and zero-shifted relative energy scan is plotted in Fig. 3b . Chair-To-Boat conformation change The chair-to-boat transition of cyclohexane is a famous example of conformational isomerism, where cyclohexane undergoes a “ring flip” by rotating its carbon-carbon single bonds. This process forces the molecule through a high-energy half-chair transition state and a local minimum twist-boat before reaching the boat conformation. Table 1 shows that MōLe has, except for the Diels-Alder reaction where it is tied with eSEn, significantly lower error for each system, again particularly in the ultra low data regime. (a) Diels-Alder reaction of ethene and 1,3-butadiene turning into cyclohexene. (b) Dihedral scan of the butane molecule. Figure 3 : The energy error of MōLe, MP2+MACE (i.e., \Delta -MP2), and MACE along two scans. In the inset, the potential energy surface is shown, with the black line indicating the ground truth energies. MōLe achieves lower error particularly for the transition state region, while MACE would overestimate the activation energies. 4.4 One-particle properties From the amplitudes, we can derive the one-particle reduced density matrix (1-RDM) \gamma(\mathbf{r},\mathbf{r^{\prime}})=\gamma_{pq}\psi_{p}(\mathbf{r})\psi_{q}(\mathbf{r^{\prime}}) with XCCSD 30 , see Appendix C . From the 1-RDM, we can derive any one-particle property, including spatially resolved ones. The most fundamental of these is the electron density \rho(\mathbf{r})=\gamma(\mathbf{r},\mathbf{r}) , which in turn lets us calculate other spatially resolved quantities like the electron localization function (ELF) 4 , Fukui function 12 ; 50 , Bader’s QTAIM 1 and X-ray diffraction patterns. We report the Frobenius norm of the density matrix error in Table 2 , which shows that our density matrices are much better than MP2. As an example, we plot the error of the electron density |\rho_{\text{Model}}(\mathbf{r})-\rho_{\text{CCSD}}(\mathbf{r})| in Fig. 4 . We see that MōLe performs significantly better than MP2. Table 2 : The Frobenius norm of the error between the density matrix of MP2 and MōLe. Model Amino acids PubChem MP2 0.59 0.90 MōLe 0.13 0.36 Figure 4 : The electron density error of MP2 and MōLe on L-Arginine amino acid. The error is plotted at the 95% percentile of the MP2 error. 4.5 CCSD cycle reduction In cases where the MōLe model is not fully trusted, for example, for unusual molecular structures, the guarantees provided by rigorous theory can be desirable. In that case, the predicted MōLe amplitudes can serve as an initial guess for a CCSD solver to reduce the number of cycles needed for convergence. We test this on the out-of-distribution molecules from the amino acids and PubChem datasets. We turn the Direct Inversion of Iterative Subspace 55 off to save memory and set our convergence threshold to 10^{-3} for the L_{2} norm of the T-amplitude changes. This threshold corresponds to energy errors |E-E_{\text{tight}}|\lesssim 0.1 mHa compared to a very tightly converged calculation. The amplitudes predicted by MōLe result in 40-50% reduction of CCSD solver iterations, the exact numbers are in Table 3 . Notably, for the PubChem molecules, three out of one hundred systems failed to converge with the default MP2 guess, two of which did converge with our predicted amplitudes, demonstrating the high quality and practical utility of MōLe’s predictions. Table 3 : The average CCSD cycles needed for convergence and number of unconverged systems with default MP2 vs. MōLe amplitudes. The convergence criterion is set to obtain an energy error of \lesssim 0.1 mHa compared to a very tightly converged calculation. Model Amino acids PubChem Avg. cycles Num. unconverged Avg. cycles Num. unconverged MP2 (default guess) 7.61 0 10.11 3 MōLe 3.83 0 6.3 \mathbf{1} 4.6 Impact of model scaling We investigate the performance of our model as a function of transformer depth and width. In particular, we scale the transformer depth from 1 to 4 layers and its width from 32 to 128 irreps. We train the models for one week on the QM7 training set. The model’s T_{2} error on the QM7 test set is plotted in Figure 5 . Figure 5 : Left: Scaling the transformer’s depth monotonically decreases the prediction error up to four layers. Right: Scaling the transformer width also decreases the prediction error monotonically. Our model’s performance improves monotonically with increasing transformer size, suggesting that the bottleneck is mainly capacity rather than data efficiency, and that scaling could therefore improve results further. 4.7 Time complexity CCSD has a formal time complexity of \mathcal{O}(N^{6}) , while MōLe should have a theoretical time complexity of \mathcal{O}(N^{5}) , as there are \mathcal{O}(N^{4}) many amplitudes, each costing \mathcal{O}(N) to compute. We validate these expectations empirically by timing increasingly larger Alkane systems and fitting a power law, confirming the expected scaling with \mathcal{O}(N^{5.9}) and \mathcal{O}(N^{4.9}) for CCSD and MōLe, respectively. See Fig. 6 for a scaling plot. For the systems measured, MōLe is about \sim 20 x faster than CCSD, both running on the same GPU. Figure 6 : We are timing CC as implemented by GPU4PySCF 31 ; 72 and MōLe for increasingly larger alkane systems, confirming the expected \mathcal{O}(N^{5}) and \mathcal{O}(N^{6}) scalings. 5 Conclusions and Outlook In this work, we presented the first equivariant neural architecture to predict CC amplitudes from molecular orbital inputs. We trained our model on QM7 at the CCSD/def2-SVP level of theory and evaluated it on a diverse set of datasets and tasks, ranging from energies to electron densities and cycle reductions. The model performs well on both the QM7 test set and several out-of-distribution splits, achieving significantly higher data efficiency than MLIPs. Since higher levels of CC theory also need only the T_{1} and T_{2} amplitudes to compute energies, our work lays the groundwork to learn from very high levels of theory (e.g. CCSDT) with very high data efficiency. Future work will include sparse amplitude prediction to escape the qubic scaling, larger basis sets, and prediction of the lambda tensor for response properties. Appendix Table of Contents Appendix A Equivariant graph neural networks \mathrm{SO}(3) -Equivariant graph neural networks (GNNs) currently represent the most successful class of machine-learning models for interatomic potentials. In these approaches, a molecule is represented as a graph \mathcal{G}=(\mathcal{V},\mathcal{E}) embedded in three-dimensional space \mathbb{R}^{3} , where nodes I\in\mathcal{V} correspond to atoms located at positions \mathbf{r}_{I}\in\mathbb{R}^{3} , and edges (A,B)\in\mathcal{E} are defined by a distance cutoff. At layer t , each node carries a feature vector \mathbf{h}_{A}^{(t)} made up of a direct sum of irreducible representations (irreps) of \mathrm{SO}(3) , \mathbf{x}_{A}^{(t)}=\bigoplus_{\ell=0}^{\ell_{\max}}\mathbf{x}_{A,\ell}^{(t)},\qquad\mathbf{x}_{A,\ell}^{(t)}=\{\mathbf{x}^{(t)}_{A,\ell,m}\}_{m=-\ell}^{\ell}, (23) where each order- \ell array has 2\ell+1 components. Feature updates are performed by exchanging messages along edges, aggregating them in a permutation-invariant manner (typically by summation or attention-weighted summation), and combining the result with the target node’s current features. In \mathrm{SO}(3) -equivariant GNNs, node features transform covariantly under a global rotation \mathbf{Q} according to the Wigner \mathbf{D}_{\ell}(\mathbf{Q}) -matrices, \displaystyle\mathbf{x}^{(t)}_{A,\ell,m}\!\left(\mathbf{D}_{1}(\mathbf{Q})\{\mathbf{r}_{k}\}_{k=1}^{N}\right)=\sum_{m^{\prime}=-\ell}^{\ell}\mathbf{D}_{\ell,mm^{\prime}}(\mathbf{Q})\,\mathbf{h}^{(t)}_{A,\ell,m^{\prime}}\!\left(\{\mathbf{r}_{k}\}_{k=1}^{N}\right). (24) Translation equivariance is ensured by constructing messages only from relative displacements \mathbf{r}_{A,B}=\mathbf{r}_{B}-\mathbf{r}_{A} . If full \mathrm{O}(3) equivariance is desired, each order- \ell feature additionally carries a parity label specifying its behavior under spatial inversion. Couplings between irreps \mathbf{p}_{\ell_{1}} and \mathbf{g}_{\ell_{2}} are formed via the Clebsch-Gordan tensor product ( 65 ) , \displaystyle\mathbf{x}_{\ell_{3},m_{3}}=\left(\mathbf{p}_{\ell_{1},m_{1}}\otimes_{\ell_{1},\ell_{2}}^{\ell_{3}}\mathbf{g}_{\ell_{2},m_{2}}\right)_{m_{3}}=\sum_{m_{1}=-\ell_{1}}^{\ell_{1}}\sum_{m_{2}=-\ell_{2}}^{\ell_{2}}\mathbf{C}_{(\ell_{1},m_{1}),(\ell_{2},m_{2})}^{(\ell_{3},m_{3})}\,\mathbf{p}_{\ell_{1},m_{1}}\mathbf{g}_{\ell_{2},m_{2}}. (25) We use this to construct messages sent from a source atom B to a target atom A as \displaystyle\mathbf{v}_{A,B,\ell_{3}}=\mathbf{v}_{\ell_{3}}(\mathbf{x}_{A},\mathbf{x}_{B},\mathbf{r}_{A,B})=\sum_{\ell_{1},\ell_{2}}w_{\ell_{1},\ell_{2},\ell_{3}}(||\mathbf{r}_{A,B}||)\left(\mathbf{f}_{\ell_{1}}(\mathbf{x}_{A},\mathbf{x}_{B})\otimes_{\ell_{1},\ell_{2}}^{\ell_{3}}\mathbf{Y}_{\ell_{2}}\!\left(\frac{\mathbf{r}_{A,B}}{||\mathbf{r}_{A,B}||}\right)\right), (26) where \mathbf{Y}_{\ell_{2}} denotes the (2\ell_{2}+1) -dimensional vector of spherical harmonics of degree \ell_{2} and w_{\ell_{1},\ell_{2},\ell_{3}}:\mathbb{R}\rightarrow\mathbb{R} is a learned radial weighting function, usually implemented as a neural network. The function \mathbf{f}_{\ell_{1}} is a simple map combining node features (which reduces to \mathbf{f}_{\ell_{1}}(\mathbf{h}_{I},\mathbf{h}_{J})=\mathbf{h}_{J,\ell_{1}} in MACE). A.1 Graph Construction Node Features: For each molecular orbital p , an independent molecular graph is constructed where each node represents an atom. The node features for atom A in the graph corresponding to orbital p are simply the MO embeddings \mathbf{x}_{pA}^{(0)}=\{x^{(0)}_{pA,k\ell m}\} . Node Attributes: Each node stores information about atomic species as attributes. The atomic species for atom A is encoded as a one-hot vector, \mathbf{z}_{A} , where each component corresponds to a different atomic element. This atomic-type information is essential for the model to distinguish between elements and their chemical properties. In the context of our model, it is important to understand the basis set. Radial weighting function: The edge features are computed using a radial embedding block that creates rich distance-dependent representations. Let \textbf{r}_{A} be the position of atom A , and d_{AB}=||\mathbf{r}_{B}-\mathbf{r}_{A}|| be the interatomic distance between atoms A and B . The radial embedding uses Bessel basis functions to encode the interatomic distances: \mathbf{e}_{AB}=\text{RadialEmbedding}(d_{AB}), (27) where the radial embedding is computed as: \text{RadialEmbedding}(r)=f_{\text{cutoff}}(r)\cdot\begin{bmatrix}\phi_{1}(r)\\ \phi_{2}(r)\\ \vdots\\ \phi_{N_{\text{basis}}}(r)\end{bmatrix}, (28) with Bessel basis functions: \phi_{n}(r)=\sqrt{\frac{2}{r_{\max}}}\cdot\frac{\sin(n\pi r / r_{\max})}{r}, (29) and polynomial cutoff function: f_{\text{cutoff}}(r)=\begin{cases}1-\frac{(p+1)(p+2)}{2}\left(\frac{r}{r_{\max}}\right)^{p}+p(p+2)\left(\frac{r}{r_{\max}}\right)^{p+1}-\frac{p(p+1)}{2}\left(\frac{r}{r_{\max}}\right)^{p+2}&\text{if }r0 ) separately: Scalar part ( L=0 ). We apply a standard layer normalization over channels to the scalar part x^{(0)}_{i} : \displaystyle\mu^{(0)} \displaystyle=\frac{1}{C}\sum_{i=1}^{C}x^{(0)}_{k},\quad\bigl(\sigma^{(0)}\bigr)^{2}=\frac{1}{C}\sum_{k=1}^{C}\bigl(x^{(0)}_{k}-\mu^{(0)}\bigr)^{2},\quad y^{(0)}_{k}=\gamma^{(0)}_{k}\,\frac{x^{(0)}_{k}-\mu^{(0)}}{\sigma^{(0)}+|\epsilon^{(0)}|}, (65) with learnable parameters \gamma^{(0)},\epsilon^{(0)}\in\mathbb{R}^{C} . Higher-degree part ( L>0 ). All higher degrees L\geq 1 are normalized together as: \displaystyle\bigl(\sigma^{(L)}\bigr)^{2}=\frac{1}{C}\sum_{k=1}^{C}\frac{1}{2L+1}\sum_{m=-L}^{L}\bigl(x^{(L)}_{m,k}\bigr)^{2},\quad\bigl(\sigma^{>0}\bigr)^{2}=\frac{1}{L_{\max}}\sum_{L=1}^{L_{\max}}\bigl(\sigma^{(L)}\bigr)^{2},\quad y^{(L)}_{m,k} \displaystyle=\gamma^{(L)}_{k}\,\frac{x^{(L)}_{m,k}}{\sigma^{>0}+|\epsilon^{>0}|}, (66) where each degree L has learnable scale parameters \gamma^{(L)},\epsilon^{>0}\in\mathbb{R}^{C} . The output of the layer normalization block is then the concatenation over all degrees: y=\{y^{(0)}_{k}\}_{k=1}^{C}\cup\{y^{(L)}_{m,k}\}_{L\geq 1,\,-L\leq m\leq L,\,1\leq k\leq C} . This construction is rotation-equivariant because it only rescales irrep blocks by scalar factors and does not mix orders m within a given L . It also does not change the signs, thereby preserving sign equivariance. The \epsilon ensures that, if all coefficients on an atom are 0 for a specific MO, they are also 0 after the normalization, ensuring size extensivity. Appendix F Visualization of results F.1 Amplitude visualization We are visualizing the output of the T_{2} amplitude in figure Fig. S1 . Since the T_{2} amplitude is a four index tensor, we only plot one slice. We see that our model successfully predicts the highly non trivial structure of the amplitudes. Figure S1 : The prediction of MōLe and ground truth for the slice (t_{\text{CCSD}}-t_{\text{MP2}})_{i=2,j=2}^{a,b} of Methanol. We see that MōLe correctly predicts the highly non-trivial correction between MP2 and CCSD. Appendix G CCSD solver iteration numbers We provide the average number of CCSD solver iterations necessary to converge a CCSD calculation with default MP2 and MōLe initializations, as well as the number of systems that did not converge at all in Table 3 . Clearly, the MōLe amplitudes serve as a high-quality initial guess that can even make systems converge, which would not have converged with MP2. Appendix H Hyperparamters We are training our MōLe models for 4 weeks on an H100 GPU using the Adam optimizer to minimize the mean squared error between the predicted and ground truth amplitudes: \displaystyle\mathcal{L}(\{t_{i}^{a}\},\{t_{i,\text{GT}}^{a}\},\{t_{ij}^{ab}\},\{t_{ij,\text{GT}}^{ab}\})=\sum_{ia}\left(t_{i}^{a}-t_{i,\text{GT}}^{a}\right)^{2}+\sum_{ijab}\left(t_{ij}^{ab}-t_{ij,\text{GT}}^{ab}\right)^{2}. The hyperparameter details are given in table S2 . Category Configuration Model / Geometry Basis set def2-SVP Number of layers 4 Transformer irrep dimensions Hidden irreps 128x0e + 128x1o + 128x2e Edge irreps 1x0e + 1x1o + 1x2e Radial / GNN Block Radial type Bessel Number of Bessel functions 10 Polynomial cutoff order 5 Max radius 4.0 MACE correlation order 3 Attention Block Latent irreps 32x0e + 32x1o + 32x2e Number of attention heads 4 Readout Heads t_{1} readout irreps 16x0e + 16x1o + 16x2e t_{1} MLP neurons 16 Single \rightarrow Pair irreps 16x0e + 16x0o + 16x1e + 16x1o + 16x2e + 16x2o Pair \rightarrow Quadruple irreps 8x0e + 4x1e + 2x2e Pair \rightarrow Quadruple MLP neurons 8 Pair \rightarrow Quadruple layers 1 Training Batch size 1 Optimizer Adam Base learning rate 10^{-2} Loss function MSE Scheduler StepLR Scheduler step 24 Scheduler \gamma 0.5 Table S2: Model architecture and training hyperparameters used in our experiments. Mace is trained for 1000 epochs, which takes around 12h on a L40s GPU, using the recommended settings. One important change we did is to switch the default Adam to AdamW optimizer, which greatly improved results for MACE on our data. Category Configuration Model Architecture Number of interactions 3 Hidden irreps 128x0e + 128x1o Number of radial basis 8 Cutoff radius 6.0 Å Training Max epochs 1000 Batch size 32 Loss function L1 (MAE) per atom Gradient clipping 10 Optimizer Optimizer AdamW Learning rate 10^{-3} Weight decay 10^{-3} LR Scheduler Scheduler Cosine Annealing + Warmup LR min 10^{-6} Table S3: Model architecture and training hyperparameters for MACE. The eSEN model is based on the 6.3 million parameter small version, but with irreps higher than \ell=0,1 removed. Like MACE, we train eSEN for 1000 epochs, which takes around 10h on a L40s GPU. Category Configuration Model Architecture Backbone eSEN-MD Number of layers 4 Hidden channels 128 Sphere channels 128 \ell_{\max} 1 m_{\max} 1 Edge channels 128 Distance function Gaussian Number of distance basis 64 Cutoff radius 6.0 Å Norm type RMS norm (SH) Training Max epochs 1000 Max atoms per batch 256 Loss function L1 (MAE) per atom Gradient clipping 100 Optimizer Optimizer AdamW Learning rate 5\times 10^{-4} Weight decay 10^{-3} LR Scheduler Scheduler Cosine Warmup factor 0.2 Warmup epochs 0.01 LR min factor 0.01 Table S4: Model architecture and training hyperparameters for eSEN.