Enhancing Materials Discovery with Valence Constrained Design in Generative Modeling
Mouyang Cheng, Weiliang Luo, Hao Tang, Bowen Yu, Yongqiang Cheng, Weiwei Xie, Ju Li, Heather J. Kulik, Mingda Li · 2025
Read Enhancing Materials Discovery with Valence Constrained Design in Generative Modeling by Mouyang Cheng, Weiliang Luo, Hao Tang, Bowen Yu, Yongqiang Cheng, Weiwei Xie, Ju Li, Heather J. Kulik, Mingda Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19799.txt.
Introduction
Mouyang Cheng and co-workers built lab common sense into a crystal generator in a 2025 paper. Spread models can invent new stuff, but many invented forms break a basic rule: oxidation states must balance, or the crystal cannot exist. Checking balance afterward wastes most samples. Their CrysVCD setup puts the rule inside making itself, in two stages.
A model text model over elements first puts forth compositions that already balance valence. A spread model then builds the crystal form for each mix, checking valence far faster than post-screening allows. Tuned for stability, the generator produced mostly thermodynamically stable options, and it can aim at targets like heat-conducting semiconductors and high-grade dielectrics. The module plugs into other pipelines.
Catalog record
| CREATOR | Mouyang Cheng, Weiliang Luo, Hao Tang, Bowen Yu, Yongqiang Cheng, Weiwei Xie, Ju Li, Heather J. Kulik, Mingda Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-19799
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enhancing Materials Discovery with Valence Constrained Design in Generative Modeling Mouyang Cheng, Weiliang Luo, Hao Tang, Bowen Yu, Yongqiang Cheng, Weiwei Xie, Ju Li, Heather J. Kulik, Mingda Li Abstract Diffusion-based deep generative models have emerged as powerful tools for inverse materials design. Yet, many existing approaches overlook essential chemical constraints such as oxidation state balance, which can lead to chemically invalid structures. Here we introduce CrysVCD (Crystal generator with Valence-Constrained Design), a modular framework that integrates chemical rules directly into the generative process. CrysVCD first employs a transformer-based elemental language model to generate valence-balanced compositions, followed by a diffusion model to generate crystal structures. The valence constraint enables orders-of-magnitude more efficient chemical valence checking, compared to pure data-driven approaches with post-screening. When fine-tuned on stability metrics, CrysVCD achieves 85% thermodynamic stability and 68% phonon stability. Moreover, CrysVCD supports conditional generation of functional materials, enabling discovery of candidates such as high thermal conductivity semiconductors and high- κ \kappa dielectric compounds. Designed as a general-purpose plugin, CrysVCD can be integrated into diverse generative pipeline to promote chemical validity, offering a reliable, scientifically grounded path for materials discovery. Introduction Materials design has long been a cornerstone of modern technology, driving advancements across diverse fields, from structural and chemical materials to energy and quantum technologies. The integration of computational methods has significantly enhanced this process, enabling the automated discovery of promising candidates [ 1 , 2 , 3 ] , with recent advances in artificial intelligence (AI) accelerating these efforts further. In particular, inverse design has emerged as a transformative paradigm, facilitating the targeted generation of functional materials with specific properties while reducing the computational burden of exhaustive forward screening [ 4 ] . Among inverse design techniques, deep generative models have achieved remarkable success by capturing intricate structure-property relationships to enable conditional materials generation [ 5 , 6 ] . Notable examples include CDVAE [ 7 ] , DiffCSP [ 8 ] , and MatterGen [ 9 ] , which demonstrate the capability of diffusion-based models to generate chemically diverse materials with novel crystal structures. Another approach incorporates large language models (LLMs) in the materials design process, utilizing inverse design prompted by human natural language [ 10 , 11 , 12 ] . All of these advanced deep generative architectures are opening a new era of automatic materials discovery. Despite significant progress, current generative approaches still encounter challenges in practical solid state material discovery scenarios. One key issue is to ensure that generated materials adhere to fundamental chemical principles, such as oxidation states and stoichiometric balance. While these chemical rules can be learned from sufficiently large datasets, chemically implausible candidates can still be proposed by current state-of-the-art models. Another issue is the thermodynamic stability of the generated materials. Methods such as guided generation [ 13 , 14 , 15 ] and post-processing with density functional theory (DFT) help address this, although the DFT’s computational cost, particularly for dynamical stability when evaluated with phonon calculations, limit the scalability. In addition, while models have shown success in generating materials with specific target properties such as bulk modulus and bandgap [ 9 ] , incorporating a wider range of functional characteristics, such as thermal and electrical conductivity, or optical behavior, could enhance their real-world utility. In this work, we present CrysVCD (Crystal generator with Valence-Constrained Design), a deep generative architecture that combines diffusion and transformer models to generate ab initio stable crystal structures while respecting fundamental chemical constraints. Built upon recent advances such as MatterGen and DiffCSP, CrysVCD introduces a dedicated transformer module that explicitly ensures charge-balanced compositions. The generation process follows two steps: in Stage I, a transformer-based elemental language model outputs chemically valid formulas where each autoregressive token corresponds to a charged ion, explicitly enforcing oxidation state balance; in Stage II, a conditional diffusion model generates the corresponding atomic structure based on the formula. This design enables rapid screening of chemically plausible compositions during inference, ensuring that all generated crystals adhere to fundamental chemical valence constraints, an essential stability condition that has been underexplored. Within a comparable inference time, CrysVCD enables rapid screening of total chemical valence during Stage I, which guarantees balanced charge valence for all end product crystals. The stability of generated crystals are evaluated on-the-fly using a pretrained machine learning interatomic potential (MLIP), in terms of both formation energy above the convex hull ( E_{\text{hull}} ) and phonon imaginary frequency. By further tuning the model with labeled stability metrics, the conditional CrysVCD model achieves >85\% stability rate of materials according to the criteria of E_{\text{hull}} ( E_{\text{hull}}<0.1 eV), and 68\% of materials that are stable as assessed by phonon calculations. We further apply CrysVCD to search for materials with high thermal conductivity and high- \kappa dielectrics, both relevant for microelectronics applications. Overall, CrysVCD provides a general-purpose, physics-constrained framework that enhances the reliability and throughput of generative materials discovery. Results Model architecture We start by briefly reviewing recent diffusion-based generative modeling for materials design. A periodic crystal structure can generally be represented as \mathbf{M}=(\mathbf{A},\mathbf{X},\mathbf{L}) , comprising atom types ( A ), fractional atomic coordinates ( X ), and lattice matrices ( L ). Diffusion models progressively add Gaussian noise to these components over a sequence of time steps. A neural network, often instantiated as a graph neural network (GNN) representing the geometric structure [ 16 , 17 ] , is trained to learn the reverse denoising process by approximating the score function [ 18 ] . This learned score function enables the generation of diverse crystal structures by sampling from a noise distribution and iteratively denoising it back toward physically plausible configurations. The current crystal structure generative models, such as DiffCSP and MatterGen, perform joint equivariant diffusion of (\textbf{A},\textbf{X},\textbf{L}) . More specifically, the probability of generating (\textbf{A}_{0},\textbf{X}_{0},\textbf{L}_{0}) can be expressed as p(\textbf{A}_{0},\textbf{X}_{0},\textbf{L}_{0})=\prod_{t=1}^{T}\left(\int d\mathbf{M}_{t}\right)p_{T}(\textbf{A}_{T},\textbf{X}_{T},\textbf{L}_{T})\prod_{t=T-1}^{0}q_{\theta}(\textbf{A}_{t},\textbf{X}_{t},\textbf{L}_{t}|\textbf{A}_{t+1},\textbf{X}_{t+1},\textbf{L}_{t+1}) (1) where \mathbf{M}_{t}=(\mathbf{A}_{t},\mathbf{X}_{t},\mathbf{L}_{t}) is the crystal structure at diffusion time step t , q_{\theta}(\cdot) is a learnable function parametrized by an equivariant GNN, and p_{T}(\cdot) is the prior noise distribution. This enables flexible structure generation and materials design. However, the above diffusion-based process is entirely data-driven and lacks explicit physical or chemical constraints. Current approaches typically first generate materials and down-select based on constraints, which reduces the efficiency. It would be desirable to impose fundamental constraints earlier in the process, e.g., before data generation. For instance, fundamental rules such as stoichiometry should apply to the atom types \mathbf{A} . This raises a key question: can we eliminate non-physical candidates before initiating the generative diffusion process? If so, this would enable a lightweight and scalable approach to incorporating domain-specific constraints early on. In light of this, we introduce CrysVCD, a two-step, property-aware crystal generation framework that explicitly incorporates physical and chemical constraints, as shown in Fig. 1 . Figure 1: Overview of CrysVCD . Rather than performing pure data-driven denoising diffusion generation, CrysVCD introduces a two-step, property-guided pipeline that incorporates physical and chemical constraints. A property-conditioned elemental language model first generates a composition with balanced chemical valence (e.g., \text{ZrO}_{2} ), which is then refined by a geometric diffusion model under classifier-free guidance, which interpolates conditional and unconditional outputs. Properties can encode thermodynamic stability as well as target functional performance. CrysVCD decouples the generation of crystal compositions and geometries into