PLaID++: A Preference Aligned Language Model for Targeted Inorganic Materials Design

Andy Xu, Rohan Desai, Larry Wang, Gabriel Hope, Ethan Ritz · 2025

Read PLaID++: A Preference Aligned Language Model for Targeted Inorganic Materials Design by Andy Xu, Rohan Desai, Larry Wang, Gabriel Hope, Ethan Ritz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07150.txt.

Introduction

Andy Xu and 4 co-authors present PLaID++ in 2025, a language model tuned to design new inorganic materials. Inorganic materials include metals, salts, and crystals that lack carbon-based chemistry. The goal is not one right answer but many fresh crystal structures that meet set limits and stay stable. The work borrows training methods first built for text models.

A compact text form based on Wyckoff positions, which describe where atoms sit in a crystal pattern, helps the model learn faster and generalize better. A temperature setting during training keeps outputs varied instead of collapsing to a few repeats. The model makes stable, unique, and new structures at a rate about half again higher than earlier methods. It can also aim at chosen symmetry traits, which speeds the hunt for useful new materials.

Catalog record

CREATORAndy Xu, Rohan Desai, Larry Wang, Gabriel Hope, Ethan Ritz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-07150

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PLaID++: A Preference Aligned Language Model for Targeted Inorganic Materials Design Andy Xu, Rohan Desai, Larry Wang, Gabriel Hope, Ethan Ritz Abstract Discovering novel materials is critical for technological advancements such as solar cells, batteries, and carbon capture. However, the development of new materials is constrained by a slow and expensive trial-and-error process. To accelerate this pipeline, we introduce PLaID++, a Large Language Model (LLM) fine-tuned for stable and property-guided crystal generation. We fine-tune Qwen-2.5 7B to generate crystal structures using a novel Wyckoff-based text representation. We show that generation can be effectively guided with a reinforcement learning technique based on Direct Preference Optimization (DPO), with sampled structures categorized by their stability, novelty, and space group. By encoding symmetry constraints directly into text and guiding model outputs towards desirable chemical space, PLaID++ generates structures that are thermodynamically stable, unique, and novel at a ∼ \sim 50% greater rate than prior methods and conditionally generates structures with desired space group properties. Our experiments highlight the effectiveness of iterative DPO, achieving ∼ \sim 115% and ∼ \sim 50% improvements in unconditional and space group conditioned generation, respectively, compared to fine-tuning alone. Our work demonstrates the potential of adapting post-training techniques from natural language processing to materials design, paving the way for targeted and efficient discovery of novel materials. 1 Introduction The discovery of new solid-state materials is the foundation of many transformative technologies including solar cells [ 12 ] , batteries [ 46 ] , and carbon capture [ 35 ] . However, the search for new materials is constrained by the immense scale of chemical space—previous explorations have only uncovered a fraction of the total number of potential stable inorganic compounds [ 7 ] . Generative models offer a promising avenue for accelerating technological breakthroughs by efficiently discovering novel and stable structures in unexplored regions of chemical space. Previous work has applied variational autoencoders [ 42 ] and denoising models [ 45 , 17 , 25 ] to generate stable and novel structures. However, these works either do not explicitly encode crystallographic symmetry or use computationally inefficient and complex representations, limiting the efficacy of their models. Meanwhile, language models [ 13 , 36 ] have emerged as a promising alternative. Their pretrained knowledge makes them data-efficient, often requiring far fewer domain-specific examples than training models from scratch [ 13 ] . Moreover, their natural-language interface allows one model to be applied to many tasks, including unconditional and conditional generation, infilling, and crystal structure prediction [ 13 ] . Symmetry is a defining aspect of crystal structures. The set of rotations, reflections, inversions, and translations exhibited by a crystal lattice form its space group . A crystal’s space group and symmetries are not merely a mathematical construct but critical to many optical, electrical, and magnetic properties like piezoelectricity [ 24 , 44 ] . One way to define a crystal’s structure from its symmetries is via Wyckoff positions, whereby one can specify a few key atomic coordinates and have the remaining atomic positions filled by applying symmetry operations [ 14 ] . Other fields of machine learning have shown that general-purpose architectures that focus on scale and data expressivity outperform models with handcrafted, domain-specific constraints [ 8 , 20 ] . We contend that the same “Bitter Lesson” holds true for materials generation [ 38 ] . Rather than imposing explicit crystallographic constraints, we train an LLM to learn and exploit structural parameters from the data itself. By allowing the model to discover patterns implicitly through training on Wyckoff-based text representations, we see significant improvements in generation performance. To guide our search space towards chemically useful structures, we introduce Reinforcement Learning from Interatomic Potentials (RLIP), a reinforcement learning framework for physically grounded materials generation. To do so, we adapt Direct Preference Optimization (DPO) [ 29 ] , a computationally efficient reinforcement learning method. Our pipeline is as follows: first, we perform supervised finetuning on a base LLM with Wyckoff-based text encodings of crystals. Then we further fine-tune the LLM via multiple rounds of DPO on generated structures categorized by their stability, novelty, and space group. To prevent entropy collapse and increase the diversity of generated structures, we increase the sampling temperature across successive iterations of DPO. By incorporating inherent crystal symmetries and the feedback of a Machine Learning Interatomic Potential (MLIP), we significantly increase the rate of stable, unique, and novel (S.U.N.) materials. Our experiments demonstrate that our method PLaID++ generates materials at state of the art stability rate and generates S.U.N materials at over a 20% higher rate than prior models while retaining the flexibility of natural language prompting. We also highlight the effectiveness of reinforcement learning for materials discovery, achieving \sim 115% and \sim 50% improvements in unconditional and space group conditioned generation, respectively, compared to fine-tuning alone. Our contributions are as follows: 1. We develop a novel, symmetry-informed text representation for crystal structures which is compact, performant, and physically-motivated. 2. We introduce an end-to-end framework for fine-tuning LLMs for material generation using Reinforcement-Learning from Interatomic Potentials (RLIP). 3. We demonstrate that fine-tuned LLMs outperform existing state-of-the-art models in generating novel and stable materials. Figure 1 : Overview of the PLaID++ pipeline, highlighting Wyckoff fine tuning and iterative DPO. 2 Related Work Variational autoencoders (VAEs) were among the early approaches to crystal structure generation, using learned latent spaces to produce physically plausible atomic arrangements [ 42 , 5 ] . Specifically, CDVAE introduced a continuous representation of crystal structures, however, VAEs face challenges in generating structures with strict crystallographic constraints, as their representations often lack direct symmetry considerations. Diffusion models like DiffCSP and FlowMM iteratively denoise atomic positions to generate crystal structures, achieving higher stability and validity than earlier VAE approaches [ 17 , 25 ] . While these models excel at capturing complex chemical landscapes, they face significant inference cost due to multi-step denoising, which limits their scalability for rapidly screening a broad sample of material candidates. Language models are scalable and capable when leveraging extensive pre-training on vast text corpora. In particular, CrystalLLM [ 13 ] pioneered the use of fine-tuned LLMs for crystal generation, showcasing the effectiveness of text-based representations for materials prediction. Symmetry-aware language models have introduced Wyckoff-position-based representations, leveraging inherent crystallographic symmetries to more effectively constrain the generative process within physical reality. WyFormer and CrystFormer [ 21 , 4 ] utilized transformer-based architectures to predict atomic positions conditioned explicitly on predefined space groups and chemical formulas. Although these symmetry-aware methods showed improvements in structural validity, their reliance on explicit formula and space group constraints considerably limits their utility in exploratory de novo generation tasks. On the other hand, symmetry-preserving non-LLM methods such as WyCryst [ 47 ] , Crystal-GFN [ 1 ] , DiffCSP++ [ 17 ] , and SymmCD [ 23 ] enforce Wyckoff or space group constraints through templates or diffusion processes. While effective, these approaches either require predefined templates or incur high computational cost, and cannot flexibly target multiple objectives. In this paper, we explore using a compact Wyckoff text encoding with preference-based post-training, enabling both unconditional and conditional generation in a single unified pipeline. 3 Background 3.1 Crystallography Crystal structures are periodic arrangements of atoms defined by repeating unit cells. Each

Read the complete text