A Cartesian Encoding Graph Neural Network for Crystal Structures Property Prediction: Application to Thermal Ellipsoid Estimation
2025
Read A Cartesian Encoding Graph Neural Network for Crystal Structures Property Prediction: Application to Thermal Ellipsoid Estimation (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18369.txt.
Introduction
Àlex Solé and six co-authors present CartNet in two thousand twenty five. Thermal ellipsoids describe how atoms vibrate in crystals. Diffraction analysis needs them, but computing them is costly. CartNet predicts them with a graph neural network instead.
Atomic geometry enters as Cartesian coordinates plus crystal temperature. A neighbor equalization step stresses covalent and contact links. A Cholesky based head keeps displacement predictions valid. Rotation augmentation handles unseen crystal orientations in training. Over two hundred thousand structures from Cambridge data validate it. Gains extend to energy and moduli prediction tasks.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 97 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-18369
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Cartesian Encoding Graph Neural Network for Crystal Structures Property Prediction: Application to Thermal Ellipsoid Estimation Abstract In the diffraction resolution of crystal structures, the thermal ellipsoids are a critical parameter that is usually more difficult to determine than atomic positions. These ellipsoids are quantified through the Anisotropic Displacement Parameters (ADPs), which provide critical insights into atomic vibrations within crystalline structures. ADPs reflect the thermal behaviour and structural properties of crystal structures. However, traditional methods to compute ADPs are computationally intensive. This paper presents CartNet, a novel graph neural network (GNN) architecture designed to predict properties of crystal structures efficiently by encoding the atomic structural geometry to the cartesian axes and the temperature of the crystal structure. Additionally, CartNet employs a neighbour equalization technique for message passing to help emphasise the covalent and contact interactions, and a novel Cholesky-based head to ensure valid ADP predictions. Furthermore, a rotational SO(3) data augmentation technique has been proposed during the training phase to generalize unseen rotations. To corroborate such procedure, an ADP dataset with over 200,000 experimental crystal structures from the Cambridge Structural Database (CSD) has been curated. The model significantly reduces computational costs and outperforms existing previously resported methods in ADP prediction by 10.87%, while demonstrating a 34.77% improvement over the tested theoretical computation methods. Moreover, we have employed CartNet for other already known datasets that included different material properties, such as formation energy, band gap, total energy, energy above the convex hull, bulk moduli, and shear moduli. The proposed architecture outperformed previously reported methods by 7.71% in the Jarvis Dataset and 13.16% in the Materials Project Dataset, proving CarNet’s capability to achieve state-of-the-art results in several tasks. Project website with online demo available at: https://www.ee.ub.edu/cartnet Àlex Solé a,b , Albert Mosella-Montoro a , Joan Cardona b , Silvia Gómez-Coca ∗ b , Daniel Aravena ∗ c , Eliseo Ruiz ∗ b and Javier Ruiz-Hidalgo ∗ a a Image Processing Group - Signal Theory and Communications Department, Universitat Politècnica de Catalunya, Barcelona, Spain; E-mail: [email protected] b Inorganic and Organic Chemistry Department and Institute of Theoretical and Computational Chemistry, Universitat de Barcelona, Barcelona, Spain; E-mail: [email protected], [email protected] c Materials Chemistry Department, Faculty of Chemistry and Biology, Universidad de Santiago de Chile, Santiago, Chile. E-mail: [email protected] 1 Introduction The Anisotropic Displacement Parameters (ADP) 1 represent a three-dimensional ellipsoid of atomic displacements within a crystal lattice due to thermal vibrations. These ellipsoids are fundamental for understanding the anisotropic nature of atomic movements and the dynamic behaviour of materials at the atomic scale. They provide critical insights into the structural and thermal properties of materials, influencing the interpretation of experimental data from techniques such as single crystal X-ray diffraction and neutron scattering. Accurate representation of ADPs is essential for constructing precise structural models and understanding the physical behaviour of materials under varying thermal conditions. The ADPs are particularly valuable in crystallography, as they assist in identifying determination issues such as disorder or twinning. Several studies have shown that ADPs can also be utilized to predict thermal motion, as well as translational and vibrational frequencies 1 , 2 . Furthermore, as demonstrated in previous research, thermal properties like heat capacity ( C_{v} ) 3 , 4 and vibrational entropy 5 , 6 are directly linked to ADPs. Additionally, ADPs have been related to the thermal expansion of crystal structures 7 , 8 , making them especially useful for identifying materials with negative thermal expansion. From an experimental point of view, inconsistencies in atomic positions are often easily spotted using chemical intuition when solving a crystal structure, allowing for straightforward visual identification of errors. However, such intuitive assessments are not as straightforward when it comes to thermal ellipsoids, making visual detection of discrepancies more challenging. As a result, some database structures exhibit ellipsoids with seemingly anomalous sizes and orientations. Developing theoretical methods that enable quick evaluation of these ellipsoids can thus serve as valuable tools for facilitating accurate structural determination from diffraction data. From a theoretical perspective, ADPs can be calculated using periodic electronic structure calculations to obtain the vibrational frequencies based on the harmonic approximation 9 , 10 . This method requires the numerical calculation of forces at displaced geometries for all atomic positions in solid-state systems. Thus, these calculations are computationally expensive and time-consuming, often creating a bottleneck in the process. Our contribution is particularly significant in this context, as deep learning methods based on graph neural networks can dramatically reduce the computation time required, providing a more efficient alternative to traditional approaches. Figure 1 shows the full pipeline proposed for this work, named CartNet. Our presented network uses a graph representation of the crystal structure and, through a set of learnable encodings and geometrical operations, predicts atomic or material properties Moreover, predicting ADPs presents a unique challenge and opportunity in the field of machine learning for crystal structure property prediction. Unlike most tasks typically explored in the literature, such as formation energy, band gap, or total energy, which are unaffected by rotation, predicting ADPs requires models to be sensitive to rotational orientation. In this paper, we make the following contributions: 1. ADP Dataset: We present a meticulously curated dataset of ADPs with over 200,000 experimental crystal structures from the Cambridge Structural Database (CSD) 11 . The ADPs are both temperature-dependent and rotation-equivariant, offering a robust foundation for exploring the necessity and impact of rotation-equivariant architectures in crystal modelling. This necessitates the use of architectures that can handle properties dependent on direction, opening the door to designing networks capable of processing rotationally dependent features. See Section 3 for a detailed description of the dataset. 2. CartNet Architecture: We introduce an architecture, CartNet, capable of accurately predicting material properties based on the geometry of a crystal structure. The key contributions of this model are as follows: (a) Geometry and Temperature Encoding: We propose a feature descriptor that efficiently encodes the complete 3D geometry referenced to the Cartesian axis and adaptively fuse other input attributes such as temperature. Since the geometry is ancored to the Cartesian reference axes, there is no need to encode the unit cell. Cell-less encoding enables the accurate prediction of the crystal’s ADP orientation regardless of cell size. (b) Neighbour Equalization: We present a neighbour equalization technique designed to address the exponential increase in neighbours over distance, thereby enhancing the model’s ability to detect various types of bonds and force interactions between atoms. This technique improves the model’s sensitivity to different interaction ranges, ensuring a more precise representation of atomic environments. (c) Cholesky Head: We introduce a output layer based on Cholesky decomposition, which guarantees that the model produces positive definite matrices, an essential mathematical property requirement for valid ADP predictions. 3. Rotation SO(3) Augmentation: We propose a data augmentation technique for both input features and output ADPs to facilitate the creation of SO(3) rotation-equivariant representations. This technique enables the model to learn rotational equivariance without requiring specific layers to enforce it, thereby simplifying the overall architecture and reducing the number of trainable parameters. These contributions allowed our model to outperform previously reported methods by 8.85% in Jarvis Dataset 12 and 15.5% in the Materials Project Dataset 13 , vide infra. Furthermore, in the ADP dataset examined, CartNet demonstrated a 10.87% improvement over other