Transferable Machine Learning Potential X-MACE for Excited States using Integrated DeepSets

Rhyan Barrett, Christoph Ortner, Julia Westermayr · 2025

Read Transferable Machine Learning Potential X-MACE for Excited States using Integrated DeepSets by Rhyan Barrett, Christoph Ortner, Julia Westermayr (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12870.txt.

Introduction

Rhyan Barrett, Christoph Ortner, and Julia Westermayr present X-MACE in 2025, a learning model for excited energy states of molecules. Cone-cross points gate fast light-driven shifts in tasks like sight and leaf light use, yet they are hard to count and harder to model. Sharp bends at those points break plain smooth models.

A Deep Sets layer inside the MACE frame smooths the bent surfaces while keeping their shape. Tests across molecules beat standard excited-state tools near the crossings. Ground-state base models can seed the excited fits, and skill moves to new molecules past the training set.

Catalog record

CREATORRhyan Barrett, Christoph Ortner, Julia Westermayr
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-12870

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Transferable Machine Learning Potential X-MACE for Excited States using Integrated DeepSets Rhyan Barrett, Christoph Ortner, Julia Westermayr Abstract Conical intersections serve as critical gateways in photochemical reactions, enabling rapid nonradiative transitions between potential energy surfaces that underpin fundamental processes such as photosynthesis or vision. Their calculation with quantum chemistry is, however, extremely computationally intensive and their modeling with machine learning poses a significant challenge due to their inherently non-smooth and complex nature. To address this challenge, we introduce a deep learning architecture designed to precisely model excited states and improve their accuracy around these critical, non-smooth regions. Our model integrates Deep Sets into the Message Passing Atomic Cluster Expansion (MACE) framework resulting in a smooth representation of the non-smooth excited-state potential energy surfaces. We validate our method using numerous molecules, showcasing a significant improvement in accurately modeling the energy landscape around conical intersections compared to conventional excited-state models. Additionally, we apply ground-state foundational machine learning models as a basis for excited states. By doing so, we showcase that the developed model is capable of transferring not only from the ground state to excited states, but also within chemical space to molecular systems beyond those included in the training dataset. This advancement not only enhances the fidelity of excited-state modeling, but also lays the foundations for the investigation of more complex molecular systems. I Introduction Photodynamics simulations play a pivotal role in advancing our understanding of essential photophysical and photochemical processes, including but not limited to photosynthesis [ 1 , 2 ] , photo-damage [ 3 , 4 , 5 ] , or optoelectronics [ 6 , 7 , 8 , 9 ] . By investigating how molecules absorb, emit, and interact with light, these studies can unveil fundamental mechanisms that underpin key biological functions or disease pathways [ 10 , 11 , 12 ] and can help a more informed design of functional materials. For instance, detailed insights into the energy transfer mechanisms involved in photosynthesis can inform the design of artificial photosynthetic systems [ 13 , 14 ] , thereby contributing to innovations in renewable energy technologies. Similarly, a deeper understanding of the interactions of light and matter at the cellular and molecular levels has the potential to improve photodynamics cancer therapies [ 15 , 16 ] or enhance treatments for vision-related disorders. [ 17 ] In simulating excited state processes, however, the fundamental assumption that underlies many ground-state studies, which is the Born–Oppenheimer approximation, breaks down and complicates excited-state simulations. In regions, where electronic transitions play a crucial role, the separation of nuclear and electronic degrees of freedom is no longer valid. Instead, the electrons and nuclei become tightly coupled, necessitating methodologies that can handle the simultaneous evolution of both. [ 18 ] Mixed quantum-classical molecular dynamics simulations go beyond the Born-Oppenheimer approximation, enabling the study of excited-state dynamics. These simulations treat nuclei classically and propagate them on multiple adiabatic potential energy surfaces, allowing for electronic transitions between them and maintaining computational feasibility while capturing nonadiabatic effects. . [ 19 ] An example of such a technique is surface hopping that describes transitions between electronic states as so-called hops. [ 20 , 21 , 22 , 23 ] Still, such techniques remain computationally expensive as they rely on quantum chemical calculations of multiple potential energy surfaces including corresponding gradients at every time step during a dynamics simulation. [ 24 ] The computational cost of such simulations scales dramatically with system size and simulation time [ 25 , 26 ] . It is not uncommon for these simulations to require years of computational time to model even small molecules consisting of a few dozen atoms over timescales of hundreds of picoseconds. [ 26 , 27 , 28 , zhang ] This computational bottleneck severely limits the practical applicability of these methods to larger, more complex systems and longer simulation times, which are often of significant interest in both fundamental research and practical applications. Machine learning offers a transformative solution to this computational challenge. By constructing an initial dataset of molecular structures and their associated properties, machine learning models can be trained to predict the behavior of larger, more complex systems at significantly faster rates while retaining ab initio accuracy [ 29 , 28 , 30 , 31 ] . This approach has demonstrated impressive success in recent years, particularly with the development of neural networks designed for predicting molecular properties for molecuar dynamics. [ 32 , 33 , 34 ] Equivariant neural networks, which respect the symmetries inherent in molecular systems such as rotational and translational invariance, have achieved high accuracy and generalization capabilities for ground-state properties. [ 35 , 36 , 37 ] Building on these advances, several neural network architectures, including SPaiNN [ 38 ] , SchNarc [ 39 ] , PyrAIMD 2 [ 31 ] or MLAtom [ 30 , 40 , 41 ] , have been proposed for excited-state prediction, allowing for excited-state simulations in the nanosecond regime. [ 24 , 31 ] While these methods have shown great promise, they face significant challenges in accurately modeling conical intersections in the molecular potential energy landscape where two or more Born–Oppenheimer potential energy surfaces intersect. The non-smooth nature of conical intersections makes them difficult for neural networks to approximate without employing a prohibitively large number of parameters. This is because neural networks are inherently smooth function approximators and struggle to capture sharp, discontinuous features in the data. [ 26 , 42 ] In this paper, we present a deep learning architecture designed to overcome the challenges associated with excited-state dynamics, particularly in the vicinity of conical intersections. Our model leverages the concept of permutationally invariant functions to represent non-smooth adiabatic potential energy surfaces as learnable smooth functions. Additionally, we leverage the foundational models developed in the Message Passing Atomic Cluster Expansion (MACE) [ 43 , 44 , 45 ] , an architecture that has demonstrated exceptional performance in ground-state molecular systems by effectively accounting for higher-order atomic interactions and many-body effects, to transfer learn to excited states. It can be shown that, despite the distinct nature of different excited-state potentials, leveraging information gained from the ground state leads to a reduced amount of data needed to train excited-state potentials and improved generalization to unseen systems. II Results The proposed architecture, which we call X-MACE, extends the MACE machine learning interatomic potential model [ 43 ] to enable efficient parametrization of multiple excited states. Interpreting multiple energy levels as a “set,” we combine MACE with a DeepSet embedding into a latent space and an auto-encoder architecture to recover the non-smooth energy levels. The X-MACE architecture is illustrated in Figure 1 a. Each component of the architecture is explained in detail in the remainder of this section. II.1 Learning non-smooth adiabatic excited states via sets of permutationally invariant functions Figure 1: Architecture of the message-passing neural network (MPNN)-based Autoencoder Framework. a) The model architecture consists of various iterations of MACE blocks consisting of single atom functions followed by many body expansions. The hidden states are passed to the readout functions; these are fitted to the learned permutationally invariant functions. b) The output of the readout function in the MACE block is fitted to the latent space containing the

Read the complete text