Scaling Kinetic Monte-Carlo Simulations of Grain Growth with Combined Convolutional and Graph Neural Networks

Zhihui Tian, Ethan Suwandi, Tomas Oppelstrup, Vasily V. Bulatov, Joel B. Harley, Fei Zhou · 2025

Read Scaling Kinetic Monte-Carlo Simulations of Grain Growth with Combined Convolutional and Graph Neural Networks by Zhihui Tian, Ethan Suwandi, Tomas Oppelstrup, Vasily V. Bulatov, Joel B. Harley, Fei Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17848.txt.

Introduction

Zhihui Tian, Ethan Suwandi, Tomas Oppelstrup, Vasily Bulatov, Joel Harley, and Fei Zhou speed up simulations of grain growth in materials, where a network of crystal grains changes over time. Graph neural networks model such networks well, but they struggle with the large cells needed for realistic structures.

Their design compresses space with a reversible convolutional autoencoder, then lets a graph network evolve the squeezed version. For the largest mesh tested, memory use and running time drop by more than a hundredfold compared with a graph only baseline. Accuracy and long term behavior improve as well, aiding realistic microstructure studies.

Catalog record

CREATORZhihui Tian, Ethan Suwandi, Tomas Oppelstrup, Vasily V. Bulatov, Joel B. Harley, Fei Zhou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-17848

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Scaling Kinetic Monte-Carlo Simulations of Grain Growth with Combined Convolutional and Graph Neural Networks Zhihui Tian, Ethan Suwandi, Tomas Oppelstrup, Vasily V. Bulatov, Joel B. Harley, Fei Zhou Abstract Graph neural networks (GNN) have emerged as a promising machine learning method for microstructure simulations such as grain growth. However, accurate modeling of realistic grain boundary networks requires large simulation cells, which GNN has difficulty scaling up to. To alleviate the computational costs and memory footprint of GNN, we propose a hybrid architecture combining a convolutional neural network (CNN) based bijective autoencoder to compress the spatial dimensions, and a GNN that evolves the microstructure in the latent space of reduced spatial sizes. Our results demonstrate that the new design significantly reduces computational costs with using fewer message passing layer (from 12 down to 3) compared with GNN alone. The reduction in computational cost becomes more pronounced as the spatial size increases, indicating strong computational scalability. For the largest mesh evaluated ( 160 3 160^{3} ), our method reduces memory usage and runtime in inference by 117× and 115×, respectively, compared with GNN-only baseline. More importantly, it shows higher accuracy and stronger spatiotemporal capability than the GNN-only baseline, especially in long-term testing. Such combination of scalability and accuracy is essential for simulating realistic material microstructures over extended time scales. The improvements can be attributed to the bijective autoencoder’s ability to compress information losslessly from spatial domain into a high dimensional feature space, thereby producing more expressive latent features for the GNN to learn from, while also contributing its own spatiotemporal modeling capability. The training was optimized to learn from the stochastic Potts Monte Carlo method. Our findings provide a highly scalable approach for simulating grain growth. \svgpath figures/ 1 Introduction Polycrystalline materials comprise the bulk of modern engineering materials. Many physical properties of these materials, e.g. mechanical, chemical, electrical, magnetic, are intrinsically linked to their grain microstructure, i.e. size, shape and topology of crystal grains comprising the material [ 1 , 2 ] . Therefore, understanding and predicting the evolution of grain microstructures during processing is important for developing and optimizing new materials with properties tailored for specific applications. The evolution of grains is driven by a complex variety of mechanisms at multiple length scales [ 1 , 3 ] . Several computational approaches have been used so far to simulate the coarsening of grain structures [ 4 , 5 , 6 ] , such as molecular dynamics (MD) [ 7 ] , kinetic Monte-Carlo (KMC) [ 8 , 9 , 10 , 11 ] , phase-field methods [ 12 , 13 , 14 , 15 ] , and finite-element front-tracking methods [ 16 , 17 , 18 ] , roughly in order of increasing granularity and decreasing levels of detail, with each offering a unique balance between computational efficiency and physical fidelity. Each of these techniques is built on a set of physical assumptions and are concerned with capturing different aspects of microstructure evolution. At the finest level of detail, molecular dynamics is considered the most predictive. However, the computational resources required to simulate grain growth with MD are prohibitively high due to the length and time scales. On the opposite end of the spectrum, phase-field and front-tracking methods, coarse-grained models based on simplifying assumptions and continual representations, can reach much larger length and time scales. Although such continuum methods have contributed significantly to our understanding of grain growth mechanisms, the trade-off is often a reduced connection to physical details [ 15 ] . Potts model kinetic Monte Carlo (PMC) [ 8 , 9 , 10 , 11 ] is a stochastic microstructure simulation technique widely used due to its ease of implementation and scalability. In PMC, the grain structure is represented as a grid of lattice sites labeled with grain orientations, and each grain consists of a contiguous region or cluster of sites sharing the same grain label. The interfacial energy at grain boundaries (GB) is approximated with a Potts model that penalizes dissimilar labels at neighboring sites. In PMC simulations, a sequence of randomly selected lattice sites and label changes is proposed, each change either accepted or rejected in accordance with the Boltzmann distribution, leading to reduction of excessive interfacial energy associated with label/orientation mismatch between adjacent grains. As a result, the average grain size increases and the GB area per unit volume decreases, entailing macroscopic grain growth or coarsening. PMC enjoys benefits from both ends of the spectrum: compared to MD, PMC is orders of magnitude more computationally efficient because of spatial coarse-graining of multiple atoms into a single lattice site and temporal coarse-graining of atomic vibrations into collective grain boundary motion in the form of label-flipping events. Compared to continuum methods, lattice sites in PMC retain discrete degrees of freedom with an energy model designed to emulate the effects of realistic atomic interactions. With properly parametrized Potts models, PMC has the capacity to simulate a wide and rich variety of grain coarsening mechanisms [ 19 ] in agreement with established theories of grain growth [ 20 , 21 , 22 ] . The kinetic Monte Carlo algorithm in SPOCK can efficiently scale up to 10^{11} elements (spins) in massively parallel 3D simulations in a heroic demonstration, although doing so required 1.5 million compute cores [ 11 ] . Maintaining such capabilitiesfor large and, simultaneously, detailed simulations while reducing their computational costs is therefore a highly attractive goal. Scientific machine learning (ML) approaches have emerged as a fast-growing field of enabling techniques that complement and extend the capabilities of traditional computational materials science methods [ 23 , 24 ] . In particular, ML-based surrogate models trained on high-fidelity but expensive simulators such as PFM or PMC can accelerate microstructure evolution simulations with reduced computational costs [ 25 , 26 , 27 , 28 , 29 ] . A range of microstructure evolution phenomena, including spinodal decomposition [ 25 , 26 ] , grain growth [ 25 ] and dendrite growth [ 25 , 29 ] , have been successfully reproduced with convolutional neural networks (CNN) based surrogate models trained from phase-field data. Enhanced computational efficiency was achieved with coarse-grained spatiotemporal grids in CNN compared to fine grids in the differential equation solvers of PFM [ 25 , 29 ] . Although several studies have applied deep learning methods to the grain growth problem, most of them is based on phase field or other deterministic data [ 25 , 30 , 31 , 32 , 33 ] . Only one study uses a deep neural network to learn how the energy decreases with the physically informed regularization [ 34 ] . Rather than inputting the microstructure directly into the network, their method firstly encodes it with the Hamilton function inspired by KMC, aiming to capture the energy decay dynamic. However, this approach employs a fixed window size for extracting the local information across time, which overlooks the dynamic nature of grain growth. For instance, the average grain area increases over time, which requires a correspondingly adaptive window and could be solved by a graph neural network with adaptive remeshing. In the rapidly evolving field of scientific machine learning, graph neural networks (GNNs) [ 30 , 35 , 33 ]

Read the complete text