Kinetic Langevin Diffusion for Crystalline Materials Generation

Antiquus S. Hippocampus, Natalia Cerebro & Amelie P. Amygdale, Ji Q. Ren & Yevgeny LeNet, Coauthor, François Cornet, Federico Bergamin, Arghya Bhowmik, Juan Maria Garcia Lastra, Jes Frellsen, Mikkel N. Schmidt · 2025

Read Kinetic Langevin Diffusion for Crystalline Materials Generation by Antiquus S. Hippocampus, Natalia Cerebro & Amelie P. Amygdale, Ji Q. Ren & Yevgeny LeNet, Coauthor, François Cornet, Federico Bergamin, Arghya Bhowmik, Juan Maria Garcia Lastra, Jes Frellsen, Mikkel N. Schmidt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03602.txt.

Introduction

Cornet and five co-authors put forth a new model in twenty twenty-five that makes fresh crystal stuffs on a computer. Crystals have set patterns that repeat, and atom spots sit on a loop-like space. That loop shape makes plain spread models hard to fit well.

Their model pairs each atom spot with a helper speed value on flat space. The spread then runs on flat space while still honors the loop and the crystal's own balance. On tests that guess known crystals and that dream up new ones, it scored with the best tools to date. The trick is the flat-space shift, they say.

Catalog record

CREATORAntiquus S. Hippocampus, Natalia Cerebro & Amelie P. Amygdale, Ji Q. Ren & Yevgeny LeNet, Coauthor, François Cornet, Federico Bergamin, Arghya Bhowmik, Juan Maria Garcia Lastra, Jes Frellsen, Mikkel N. Schmidt
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE107 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-03602

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Kinetic Langevin Diffusion for Crystalline Materials Generation Antiquus S. Hippocampus, Natalia Cerebro & Amelie P. Amygdale, Ji Q. Ren & Yevgeny LeNet, Coauthor, François Cornet, Federico Bergamin, Arghya Bhowmik, Juan Maria Garcia Lastra, Jes Frellsen, Mikkel N. Schmidt Abstract Generative modeling of crystalline materials using diffusion models presents a series of challenges: the data distribution is characterized by inherent symmetries and involves multiple modalities, with some defined on specific manifolds. Notably, the treatment of fractional coordinates representing atomic positions in the unit cell requires careful consideration, as they lie on a hypertorus. In this work, we introduce Kinetic Langevin Diffusion for Materials, a novel diffusion model for crystalline materials generation, where the key innovation resides in the modeling of the coordinates. Instead of resorting to Riemannian diffusion on the hypertorus directly, we generalize Trivialized Diffusion Model to account for the symmetries inherent to crystals. By coupling coordinates with auxiliary Euclidean variables representing velocities, the diffusion process is now offset to a flat space. This allows us to effectively perform diffusion on the hypertorus while providing a training objective that accounts for the periodic translation symmetry of the true data distribution. We evaluate Kinetic Langevin Diffusion for Materials on both Crystal Structure Prediction ( csp ) and De-novo Generation ( dng ) tasks, demonstrating its competitive performance with current state-of-the-art models. † † affiliationnotice: Equal contribution 1 Introduction The discovery of novel compounds with desired properties is critical to several scientific fields, such as molecular discovery ( Bilodeau et al. 2022 ) and materials design ( Merchant et al. 2023 ; Zeni et al. 2025 ) . In the case of crystalline materials, the search space is vast, but only a fraction of it is physically plausible. The main challenges are to efficiently search the space for feasible materials and to accurately estimate their properties. Conventional approaches usually combine random structure search methods with ab-initio Quantum Mechanics methods ( Oganov et al. 2019 ) , such as Density Functional Theory ( Kohn & Sham 1965 ) ; however, structural optimization and property evaluation with Density Functional Theory can be computationally expensive. Recently, the field has witnessed a paradigm shift where deep generative models have been introduced to supplement traditional search methods ( Anstine & Isayev 2023 ) , such as random search ( Pickard & Needs 2011 ) or evolutionary algorithms ( Glass et al. 2006 ; Wang et al. 2010 ) . Deep generative models learn to approximate underlying probability distributions from existing material data, and in turn, can be sampled from to generate novel materials based on the learned patterns. Among deep generative models, diffusion models have been successful on a variety of data modalities relevant to the sciences, ranging from Partial Differential Equations simulations ( Lippe et al. 2023 ; Rozet & Louppe 2023 ; Shysheya et al. 2024 ) to molecule generation ( Hoogeboom et al. 2022 ; Xu et al. 2023 ; Cornet et al. 2024 ) . Unlike molecules, crystalline materials consist of a periodic arrangement of atoms, typically described by a unit cell , a parallelepiped that serves as the fundamental building block repeated to tile the entire space. A unit cell is typically represented by three vectors that define its edges and the angles between them, along with the coordinates and species of the atoms inside it. It can be considered as a multi-modal data type, specifically a geometric graph combining discrete and continuous features ( Joshi et al. 2023 ) . Notably, the atomic positions are described by coordinates that lie on a hypertorus. Dealing with non-Euclidean data in the diffusion setting requires careful consideration: for example, restricting Brownian motion to a manifold requires incorporating its geometric structure to ensure trajectories remain on the manifold, typically using projection or specialized approximations ( Lou et al. 2023 ) . Current diffusion models for crystals either handle this by working in real space, through multi-graph representations ( Xie et al. 2022 ) , or on fractional coordinates ( Jiao et al. 2023 ) . In addition to this, the data distribution is governed by inherent symmetries, including permutation invariance (swapping atom indices or lattice bases), translation invariance (shifting atom coordinates), and rotation invariance (rotating atom positions). When operating on fractional coordinates, the main challenge is to ensure the periodic translation invariance of the learned distribution. This is usually enforced by parameterizing the score network with a periodic translation invariant architecture. However, while existing models have successfully demonstrated the potential of applying diffusion to crystalline materials generation, previous work has highlighted the existence of a mismatch between architecture and supervision signal, resulting in a suboptimal training objective ( Lin et al. 2024 ) . While the issue has been acknowledged in the literature, in this paper we show an alternative way to mitigate this mismatch that is effective at low levels of noise. Contributions In this work, we introduce Kinetic Langevin Diffusion for Materials ( kldm ), a novel diffusion model for crystalline materials generation, where the key innovation resides in the modeling of the fractional coordinates. Instead of resorting to Riemannian diffusion on the hypertorus directly as in previous work ( Jiao et al. 2023 ) , we generalize Trivialized Diffusion Model ( tdm ) ( Zhu et al. 2024 ) to model symmetric distributions over coordinates. Using the structure of the torus, the diffusion process is offset to auxiliary Euclidean variables representing velocities. We propose a specific parameterization of the resulting diffusion process leading to faster training convergence and improved performance while mitigating a mismatch in the training objective of previous diffusion models for materials. Finally, we show that Kinetic Langevin Diffusion for Materials offers competitive performance on Crystal Structure Prediction and De-novo Generation. 2 Background 2.1 Crystalline materials and related symmetries In this section, we introduce the data modality we are interested in, along with the relevant symmetries. Unit cell We are interested in learning the distribution of crystalline materials, described as the repetition of a unit cell in 3 D-space. We describe a unit cell containing K atoms as a fully connected geometric graph \bm{x} , \displaystyle\bm{x}=(\bm{f},\bm{l},\bm{a}), (1) where \bm{f}=(\bm{f}_{1},\ldots,\bm{f}_{K})\in[0,1)^{3\times K} denotes the fractional coordinates, \bm{l}=(\bm{l}_{1},\bm{l}_{2},\bm{l}_{3})\in\mathbb{R}^{3\times 3} refers to the lattice vectors of the unit cell, and \bm{a}=(a_{1},\ldots,a_{K})\in\mathbb{Z}^{K} encodes the chemical composition. The infinite periodic structure can be represented as, \displaystyle\big\{(\bm{a}^{\prime},\bm{f}^{\prime})\big|\bm{a}^{\prime}=\bm{a};\bm{f}^{\prime}=\bm{f}+\bm{k}\bm{\mathrm{1}}^{\top},\bm{k}\in\mathbb{Z}^{3}\big\}, (2) where \bm{\mathrm{1}} is a vector of ones with size K , and \bm{k}=(k_{1},k_{2},k_{3}) translates the unit cell to tile the entire space. The lattice vectors \bm{l} can also be compactly represented by a 6 -dimensional vector consisting of the three lattice vector lengths and their interior angles, such that the representation is invariant to rotation. Tasks Let p(\bm{x}) denote the true data distribution over the unit cells, and let q(\bm{x})=\frac{1}{N}\sum_{i=1}^{N}\delta_{\bm{x}_{i}} be the empirical data distribution defined by the N available samples. The goal of generative models is to learn an approximate model p_{\theta}(\bm{x}) of p(\bm{x}) using q(\bm{x}) . In the realm of crystalline materials generation, there are two tasks of interest. Crystal Structure Prediction ( csp ) aims at finding low-energy atomic arrangements (\bm{f},\bm{l}) , i.e. stable structures, for a given atomic composition \bm{a} . This is framed as a conditional generation task where a model p_{\theta}(\bm{f},\bm{l}|\bm{a}) is trained

Read the complete text