CrystalReasoner: Reasoning and RL for Property-Conditioned Crystal Structure Generation

Yuyang Wu, Stefano Falletta, Delia McGrath, Sherry Yang · 2026

Read CrystalReasoner: Reasoning and RL for Property-Conditioned Crystal Structure Generation by Yuyang Wu, Stefano Falletta, Delia McGrath, Sherry Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14344.txt.

Introduction

Wu and three co-authors propose CrystalReasoner, an end-to-end LLM framework for crystals from language instructions through reasoning. CrysReas introduces priors as thinking tokens: symmetry, coordination, and predicted traits, before atomic coordinates. CrysReas then uses reinforcement learning with a dense reward to align generation with validity and stability. Against baselines without thinking traces or RL, CrysReas performs better on diverse metrics, triples S.U.N. ratio, and achieves better results.

Catalog record

CREATORYuyang Wu, Stefano Falletta, Delia McGrath, Sherry Yang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53221
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14344

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CrystalReasoner: Reasoning and RL for Property-Conditioned Crystal Structure Generation Yuyang Wu, Stefano Falletta, Delia McGrath, Sherry Yang Abstract Generative modeling has emerged as a promising approach for crystal structure discovery. However, existing LLM-based generative models struggle with low-level atomic precision, while diffusion-based methods fall short in integrating high-level scientific knowledge. As a result, generated structures are often invalid, unstable, or do not possess desirable properties. To address this gap, we propose CrystalReasoner (CrysReas), an end-to-end LLM framework that generates crystal structures from natural language instructions through reasoning and alignment. CrysReas introduces physical priors as thinking tokens, which include crystallographic symmetry, local coordination environments and predicted physical properties before generating atomic coordinates. This bridges the gap between natural language and 3D structures. CrysReas then employs reinforcement learning (RL) with a multi-objective, dense reward function to align generation with physical validity, chemical consistency, and thermodynamic stability. For property-conditioned tasks, we design task-specific reward functions and train specialized models for discrete constraints (e.g., space group) and continuous properties (e.g., elasticity, thermal expansion). Empirical results demonstrate that compared to prior works and baselines without thinking traces or RL, CrysReas obtains better performance on diverse metrics, triples S.U.N. ratio, and achieves better performance for property conditioned generation. CrysReas also exhibits adaptive reasoning, increasing reasoning lengths as the number of atoms increases. Our work demonstrates the potential of leveraging thinking traces and RL for generating valid, stable, and property-conditioned crystal structures. 1 Introduction Modern technologies increasingly rely on the development of new materials, such as solid-state electrolytes for batteries ( 42 ), high-performance catalysts ( 9 ), and functional semiconductors ( 4 ). 1 1 1 Our work is available at https://crystalreasoner.github.io/ , with code at https://github.com/wyy603/CrystalReasoner . Traditional computational methods for crystal structure discovery such as random search ( 26 ) and particle swarm optimization ( 33 ) are computationally intensive due to explicit energy evaluation in each search iteration. In contrast, generative models offer a scalable alternative by bypassing the costly search and energy evaluation steps ( 5 ). Despite the progress in generative modeling, existing generative models for crystal structures are limited. For example, diffusion-based models ( 40 ; 35 ; 2 ; 15 ; 16 ; 18 ; 17 ) operate in the 3D structure or latent space could not easily integrate rich textual knowledge (e.g., compositions, properties from textbooks). To incorporate scientific knowledge, some works ( 39 ; 13 ; 19 ) use LLMs to generate formulas followed by diffusion for structures conditioned on chemical formulas. However, these decoupled architectures separate semantic reasoning and structural generation into distinct modules, preventing end-to-end training and joint optimization. On the other hand, finetuning LLMs to directly generate crystal information files (CIFs) holds great promise integrating scientific knowledge, as most LLMs are pretrained on science text books. However, recent attempts ( 1 ; 10 ; 22 ; 7 ; 36 ) face a critical challenge: the LLM tokenizer flattens 3D coordinates into strings, losing symmetry and spatial constraints, which results in low space-group accuracy (e.g., 24% in CrystalTextLLM). Furthermore, LLM based approaches generally suffer from a lack of precision in generated atom locations, and they lack mechanisms to enforce physical validity, stability, and property conditioning in the generated structures. To address this gap, we draw insights from the development of LLMs around reasoning and RL alignment with verifiable feedback. We propose CrystalReasoner (CrysReas), an end-to-end framework that converts high-level textual instructions into high-fidelity low-level crystal structures through reasoning and alignment, as shown in Figure 1 . First, CrysReas is finetuned to generate physical priors as thinking traces before outputting atomic coordinates, following an abstract-to-concrete progression through reasoning about crystallographic symmetry, local coordination environments, and predicted properties (e.g., structure volume, formation energy). By introducing symbolic representations of the 3D structure through text, LLMs can first reason about 3D structure before generating the structure itself, making structure generation more tractable. Second, to improve precision of the generated atom locations, we apply RL with a carefully designed multi-objective dense reward function covering physical validity, chemical validity, and thermodynamic stability, guiding generation toward valid, low-energy configurations. To enable property conditioned generation, CrysReas employs RL with property-specific reward, supporting optimization with respect to both discrete constraints (e.g., space group) and continuous properties (e.g., elasticity, thermal expansion) calculated using surrogate MLIPs ( 38 ). By combining stability rewards with property-specific objectives, CrysReas can be specialized for diverse material design scenarios without architectural modifications. Figure 1 : Overview of the CrystalReasoner pipeline. An LLM is finetuned to first generate thinking traces in an abstract-to-concrete manner before outputting atomic coordinates. A multi-objective dense reward is used for RL (GRPO) alignment. The model can be used for formula conditioned generation generation, and can be further specialized with property-specific reward for property conditioned generation. Our evaluation shows that CrysReas consistently achieves the best performance among model variants without thinking or RL in generating valid and low-energy structures, as verified by Density Functional Theory (DFT) calculations ( 12 ; 20 ). Furthermore, CrysReas triples stable, unique, and novel (S.U.N.) discovery ratio, compared to previous LLM-based crystal generation approaches. Notably, CrysReas also exhibit adaptive reasoning, increasing reasoning lengths as the number of atoms increase. For property conditioned generation, we found that RL against elasticity and thermal expansion consistently improves the chance that the generated structures fall into the specified range of these properties. In summary, our contributions are fourfold: 1. Physical Priors as Thinking Tokens: A novel strategy that instructs the LLM to generate explicit physical priors before atomic coordinates, improving 3D reasoning. 2. RL Global Alignment: A RL framework with a multi-objective dense reward, improving numerical precision and guiding generated structures toward thermodynamic equilibrium. 3. Task-Specialized Property Conditioning: Individual reward designs for property conditioned generation without requiring architectural modifications. 4. Overall Better Performance: Compared to prior works and baselines, CrysReas achieves superior performance across diverse metrics, triples the S.U.N. discovery ratio, and improves property conditioned generation quality. 2 Preliminaries In this section, we define notations and provide background on LLMs for crystal structure generation and RL for LLMs. 2.1 LLMs for Crystal Structure Generation Following prior work ( 10 ; 1 ), we formulate crystal structure generation as token-sequence generation with an LLM \pi_{\theta} . Given a natural language description c (e.g., formula, space group), the LLM autoregressively generates a token sequence a_{0:N} representing lattice parameters and atomic coordinates: \pi_{\theta}(a_{0:N}|c)=\prod_{t=0}^{N}P(a_{t}|a_{<t},c) After training, the generated structures are evaluated by validity checkers or MLIPs on multiple metrics, including the structural validity R_{\text{structural}} (satisfying geometric constraints), chemical validity R_{\text{chemical}} (oxidation states consistent with electroneutrality), composition consistency R_{\text{consistency}} (following user constraints), and thermodynamic stability R_{\text{stability}} of the generated structures. 2.2 RL for Language Models RL has been an effective technique for refining LLMs, ensuring the models are specifically optimized for targeted objectives or human preferences ( 25 ) or verifiable reward ( 29 ). Among different RL algorithms, Group Relative Policy Optimization (GRPO) ( 29 ) demonstrates significant utility in addressing domains that necessitate long thinking traces, most notably in the context of mathematical reasoning. GRPO is a policy gradient RL algorithm for LLMs that eliminates the need for a critic network by comparing multiple outputs sampled from the same input. For each input c , it samples G candidate

Read the complete text