Aligning Reasoning LLMs for Materials Discovery with Physics-aware Rejection Sampling
Lee Hyun, Sohee Yoon, Jinwoo Park, Sue In Chae, Seongeon Park, Jooyeon Ahn, Yebin Jung, Youjung Chung, Hogeun Chang, Sujin Park, Myeonginn Kang, Jina Kim, Ho-Gyeong Kim, Myeonghun Jeong, [1.7em] Materials AI Lab (AI Center), Samsung Electronics · 2025
Read Aligning Reasoning LLMs for Materials Discovery with Physics-aware Rejection Sampling by Lee Hyun, Sohee Yoon, Jinwoo Park, Sue In Chae, Seongeon Park, Jooyeon Ahn, Yebin Jung, Youjung Chung, Hogeun Chang, Sujin Park, Myeonginn Kang, Jina Kim, Ho-Gyeong Kim, Myeonghun Jeong, [1.7em] Materials AI Lab (AI Center), Samsung Electronics (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-00768.txt.
Introduction
Lee Hyun leads a team of fourteen authors on reasoning models for materials search. Automated experiments need recipe-to-property predictors. Those predictors must be accurate and well calibrated. They must also respect basic physics. Training often curates reasoning traces from a teacher model. But picking traces by correctness alone reflects physics poorly.
The team introduces Physics-aware Rejection Sampling, or PaRS. PaRS favors traces that agree with fundamental physics. It also favors traces close to numeric targets. Light halting rules control the compute cost. A large student model is fine-tuned on the chosen traces. It improves in accuracy and calibration over baselines. It also breaks physics rules less often. Sampling cost falls at the same time.
Catalog record
| CREATOR | Lee Hyun, Sohee Yoon, Jinwoo Park, Sue In Chae, Seongeon Park, Jooyeon Ahn, Yebin Jung, Youjung Chung, Hogeun Chang, Sujin Park, Myeonginn Kang, Jina Kim, Ho-Gyeong Kim, Myeonghun Jeong, [1.7em] Materials AI Lab (AI Center), Samsung Electronics |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-00768
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Aligning Reasoning LLMs for Materials Discovery with Physics-aware Rejection Sampling Lee Hyun, Sohee Yoon, Jinwoo Park, Sue In Chae, Seongeon Park, Jooyeon Ahn, Yebin Jung, Youjung Chung, Hogeun Chang, Sujin Park, Myeonginn Kang, Jina Kim, Ho-Gyeong Kim, Myeonghun Jeong, [1.7em] Materials AI Lab (AI Center), Samsung Electronics Abstract AI-driven materials discovery that couples automated experimentation with algorithmic decision-making requires process aware recipe to property predictors that are accurate, calibrated, and physically admissible. We approach this as a reasoning problem with large reasoning models (LRMs). To instill reasoning capability into language models, we curate reasoning traces from a teacher model to train a student model. However, most training pipelines select reasoning traces using binary correctness or learned preference signals that poorly reflect physical admissibility. We introduce Physics-aware Rejection Sampling (PaRS) , a training-time trace selection scheme that favors traces consistent with fundamental physics and numerically close to targets, with lightweight halting to control compute. We instantiate our framework with a large student model fine-tuned on traces synthesized by a larger teacher model, and evaluate under matched token budgets against various rejection sampling baselines. Our method improves accuracy and calibration, reduces physics-violation rates, and lowers sampling cost relative to baselines. These results indicate that modest, domain-aware constraints combined with trace-level selection provide a practical path toward reliable, efficient LRMs for process-aware property prediction and closed-loop materials design. 1 Introduction A central goal in materials discovery is to compress the experimental loop by coupling automated experimentation with algorithmic decision making. Within this loop, property prediction is the core module. Accurate models that map composition, structure, and process/recipe variables to target properties (e.g., materials properties or device-level figures of merit) convert combinatorial exploration into tractable optimization and enable closed-loop design via bayesian optimization, provided that the models expose calibrated uncertainty and lightweight physics constraints to keep proposals physically admissible ( Stach et al. 2022 ; Flores-Leonar et al. 2024 ; Frazier 2018 ; Sabanzagil et al. 2025 ; Jacobs et al. 2024 ; Varivoda et al. 2022 ) . Prior work has largely targeted properties from composition or crystal structure ( Xie & Grossman 2018 ; Chen et al. 2019 ) and, more recently, has explored text- or instruction-conditioned surrogates with LLMs ( Ndayishimiye et al. 2025 ) ; yet scaling these predictors to process-aware, recipe to property tasks at the device level remains challenging ( Liu et al. 2022 ; Lu et al. 2023 ; Xie et al. 2024 ) . Recently, large reasoning models (LRMs)—language models trained and/or reinforced to produce reliable reasoning traces—have shown dominant performance in diverse areas such as math, coding and scientific QA ( Guo et al. 2025 ; Jaech et al. 2024 ; Yang et al. 2025 ) . Their step-wise reasoning capabilities are a natural fit for recipe to property prediction, where multi-step physical arguments along the classic chemical composition \rightarrow process \rightarrow micro-structure \rightarrow property chain are essential and well established in integrated computational materials engineering ( National Research Council 2008 ) . Despite the promise, the leveraging LRMs on property prediction task remains underexplored relative to LLM and naive knowledge extraction ( Zhao et al. 2024 ; Ndayishimiye et al. 2025 ) . In this paper, we study how to train LRMs that reason effectively about materials recipes and output numerically correct, physically grounded properties. A prevailing strategy for training LRMs to reason is to use filtered or re-weighted training signals based on the quality of teacher generated traces, complemented by test-time scaling ( Muennighoff et al. 2025 ) . Concretely, models are fine-tuned on self-generated rationales kept only when they reach correct outcomes ( Zelikman et al. 2022b ; Yuan et al. 2023 ) , or on samples ranked by a learned reward/verifier ( Dong et al. 2023 ; Cobbe et al. 2021 ; Zheng et al. 2023b ) , or they aggregate multiple samples at decoding ( Wang et al. 2022 ) . These methods work as standard building blocks for LRMs along with SFT-only pipelines and RL-style post-training ( Xu et al. 2025 ; Chen et al. 2025 ) . We argue that training property prediction LRMs from generated reasoning traces requires more sophisticated, physically grounded rejection sampling. Two characteristics of this task drive the need: (1) High combinatorial design space. The composition, process, structure, property chain creates high-dimensional, multi-mechanism spaces; inverse maps are often non-unique, yielding traces that seem plausible yet are scientifically incorrect ( Xiang et al. 1995 ; Takeuchi et al. 2002 ; Ren et al. 2021 ; Liu et al. 2018 ; Yang et al. 2022 ) . Therefore, effective learning requires sufficient exploration that searches both the design and reasoning trace space. (2) Physically grounded outputs. Targets are physical quantities whose magnitudes are constrained by physics and even small numeric deviations matter. Filters must therefore enforce admissible ranges and physical constraints from conservation laws and constitutive relations rather than rely solely on binary correctness. Motivated by these challenges, we propose Physics-aware Rejection Sampling (PaRS) , a domain-tailored approach to optimize reasoning traces. Unlike prior methods that depend on binary correctness or learned reward models, our method couples rejection sampling with task-native, continuous error metrics derived from wet-lab experiments. Concretely, for each device recipe, we sequentially generate candidate traces, accepting the first trace that satisfies physics-aware acceptance gates and halting sampling early when further candidates show negligible variance or improvement. We adopt Qwen3-32B † † † https://huggingface.co/Qwen/Qwen3-32B as the backbone model, fine-tuned via supervised fine-tuning (SFT) on internal prompts, with teacher reasoning traces synthesized from Qwen3-235B ‡ ‡ ‡ https://huggingface.co/Qwen/Qwen3-235B-A22B ( Yang et al. 2025 ) . We benchmark against various rejection sampling methods under matched token budgets. Empirically, our method achieves the highest overall accuracy and calibration, while also delivering superior compute efficiency compared to existing baselines. Our contributions are threefold. • We formulate recipe to property prediction as a reasoning task with LRMs where physics-aware verification is essential. • We propose novel physically grounded rejection sampling for optimizing reasoning traces, introducing the combination of powerful gating and halting techniques. • We conduct (1) a teacher-side ablation, comparing our physics-aware sampler against six baselines in terms of trace accuracy and sampling efficiency, and (2) a student-side evaluation, fine-tuning an open-source LRM to demonstrate consistent gains in accuracy, calibration, and compute efficiency over all baselines. 2 Related Work LLMs for materials design Recent advances in large language models (LLMs) have demonstrated strong generalization capabilities in materials design, drawing on interdisciplinary knowledge from chemistry, physics, and engineering ( Miret & Krishnan ; Jia et al. 2024 ) . Beyond general-purpose LLMs, domain-specific models such as MatSciBERT ( Gupta et al. 2022 ) , MatBERT ( Wan et al. 2024 ) , and MELT ( Kim et al. 2024 ) have been trained on large-scale materials science corpora, successfully capturing fundamental concepts that link structure, properties, processes, and performance. A key step in the materials design pipeline is accurate property prediction from symbolic representations, which serves as a surrogate for expensive experiments and enables rapid candidate screening. Leveraging their ability to process unstructured scientific data, recent studies have applied LLMs to this task without the need for elaborate feature engineering. For example, LLM-Prop ( Niyongabo Rubungo et al. 2025