Role of Large Language Models and Retrieval-Augmented Generation for Accelerating Crystalline Material Discovery: A Systematic Review

Agada Joseph Oche, Arpan Biswas · 2025

Read Role of Large Language Models and Retrieval-Augmented Generation for Accelerating Crystalline Material Discovery: A Systematic Review by Agada Joseph Oche, Arpan Biswas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06691.txt.

Introduction

Agada Oche and Arpan Biswas review in 2025 how large language models paired with retrieval systems could speed the discovery of crystalline materials. Hunting new crystals for energy devices burns years of simulation and lab work. Language models that can search literature and databases first promise a cheaper shortlist of candidates.

The review surveys structure prediction, defect analysis, fresh compound discovery, literature mining, and multimodal retrieval. Retrieval grounding keeps the model's claims tied to real data rather than invention. Performance reports and open challenges are weighed across the subfields. For labs, the message is practical: the chat layer is only as good as the knowledge plumbing beneath it.

Catalog record

CREATORAgada Joseph Oche, Arpan Biswas
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-06691

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Role of Large Language Models and Retrieval-Augmented Generation for Accelerating Crystalline Material Discovery: A Systematic Review Agada Joseph Oche, Arpan Biswas Abstract Large language models (LLMs) have emerged as powerful tools for knowledge-intensive tasks across domains. In materials science, to find novel materials for various energy efficient devices for various real-world applications, requires several time and cost expensive simulations and experiments. In order to tune down the uncharted material search space, minimizing the experimental cost, LLMs can play a bigger role to first provide an accelerated search of promising known material candidates. Furthermore, the integration of LLMs with domain-specific information via retrieval-augmented generation (RAG) is poised to revolutionize how researchers predict materials structures, analyze defects, discover novel compounds, and extract knowledge from literature and databases. In motivation to the potentials of LLMs and RAG in accelerating material discovery, this paper presents a broad and systematic review to examine the recent advancements in applying LLMs and RAG to key materials science problems. We survey state-of-the-art developments in crystal structure prediction, defect analysis, materials discovery, literature mining, database integration, and multi-modal retrieval, highlighting how combining LLMs with external knowledge sources enables new capabilities. We discuss the performance, limitations, and implications of these approaches, and outline future directions for leveraging LLMs to accelerate materials research and discovery for advancement in technologies in the area of electronics, optics, biomedical, and energy storage. Keywords: Retrieval Augmented Generation (RAG), Large Language Model (LLM), Generative AI, Natural Language Processing (NLP), Crystalline Material, Material Science and Engineering 1 Introduction The rapid progress of large language models (LLMs) in natural language processing has begun to significantly impact scientific domains, including materials science ( Yu2024-GameChangers ) . LLMs such as GPT-3 and GPT-4, built on the Transformer architecture ( Vaswani2017 ) and trained on massive text corpora ( Brown2020-GPT3 ) , demonstrate impressive abilities in generating human-like text and reasoning over knowledge. However, out-of-the-box LLMs often lack specialized scientific knowledge and can produce hallucinations (incorrect statements) when tasked with domain-specific problems. This has led to growing interest in techniques to ground LLMs with reliable external information ( Jiang2025-NPJReview ; Lewis2020-RAG ) . In materials science, there is a vast region of material search space, suited for various energy efficient devices for various real-world applications. One of the major challenges is to find intended material candidates, which require several time and cost expensive simulations Barghathi:2022bw ; CasianoDiaz:2023pi and experiments Harris2024PLD . With current global motivation of AI-driven accelerated search for material discovery, LLM can play a bigger role to search quickly into the known material space to find application-driven promising candidates. This accelerated guided search in the known material space, can potentially help to tune down the vast uncharted material space for faster discovery of novel materials. This motivates us to first look into the ongoing researches and potential of LLMs in accelerating material research, in the early phase of discovery. Early applications of natural language processing (NLP) focused on text mining and knowledge extraction from literature, for example using word embeddings to capture structure-property relations ( Tshitoyan2019 ) . LLMs promise a more flexible and powerful approach, able to interpret complex queries, generate hypotheses, and interface with databases or simulation tools through natural language. Retrieval-augmented generation (RAG) has emerged as a key strategy for domain adaptation: an LLM is coupled with a retrieval module that supplies relevant documents or data from an external knowledge base ( Lewis2020-RAG ) . By injecting up-to-date and context-specific information into the LLM’s prompt, RAG can significantly improve factual accuracy and domain relevance of the generated answers. This review provides a systematic overview of how LLMs and RAG are being leveraged in materials science and engineering. We cover applications ranging from crystal structure prediction and defect analysis to materials discovery and literature mining, highlighting the current state-of-the-art, challenges, and charting the way forward. 2 Methods As per our research contribution in this paper, we performed a systematic literature survey to identify relevant publications on LLM and RAG applications in materials science. Multiple databases (Web of Science, Scopus, Google Scholar) and preprint servers (arXiv) were queried using keywords such as “large language model”, “retrieval augmentation”, “materials science”, and specific task keywords (e.g. “crystal structure prediction”, “materials discovery”). Studies were included if they (1) applied LLMs or GPT-style models to a materials science problem, or (2) introduced methods for integrating materials domain knowledge (databases, literature, tools) with LLMs. After removing duplicates and screening titles and abstracts, a total of \sim 21 peer-reviewed papers and preprints (2019–2025) were identified for detailed review. For each, we analyzed the problem addressed, the LLM or augmentation technique used, and key findings. The review is organized by application area. 2.1 Theoretical Background: LLMs and Retrieval-Augmented Generation LLMs are neural networks (typically Transformer-based ( Vaswani2017 ) ) trained to predict text, which endows them with a broad but implicit knowledge of language and facts from their training data. In practice, state-of-the-art LLMs like GPT-4 can answer questions, generate explanations, and perform reasoning tasks ( Brown2020-GPT3 ) . However, their knowledge is limited by the static training corpus and they may not know specialized scientific information not present in that data. Furthermore, LLMs have no direct access to tools or databases at runtime and can confidently output incorrect information. Retrieval-augmented generation (RAG) addresses these limitations by augmenting the LLM with a retrieval mechanism ( Lewis2020-RAG ) . RAG is a framework that combines a neural text retrieval module with a text generation module to improve the quality of generated responses in knowledge-intensive tasks ( Oche2025ASR ) . Formally, a RAG model augments a sequence-to-sequence (seq2seq) generator with access to an external text corpus (non-parametric memory) via a retriever ( Lewis2020 ; Karpukhin2020 ) . Given an input query x , the retriever R selects a small subset of relevant documents Z=\{z_{1},z_{2},\dots,z_{K}\} from a large corpus \mathcal{C} (with K\ll|\mathcal{C}| ) ( Karpukhin2020 ) . The generator then conditions on both the query x and the retrieved documents Z to produce an output y (such as an answer or a descriptive text). Formally, the RAG model can be viewed as a latent variable generative model that defines a probability distribution over outputs y by marginalizing over the retrieved documents z_{i} : P(y\mid x)\;=\;\sum_{i=1}^{K}P_{\text{ret}}(z_{i}\mid x)\;P_{\text{gen}}(y\mid x,z_{i})\,, (1) Figure 1: Illustration of a RAG Architecture. where P_{\text{ret}}(z_{i}\mid x) is the probability of retrieving document z_{i} given query x (the retriever’s output distribution), and P_{\text{gen}}(y\mid x,z_{i}) is the generator’s conditional probability of producing y given x and a particular retrieved document z_{i} . In practice, P_{\text{ret}}(z_{i}\mid x) is typically non-zero only for the top- K retrieved items, providing a tractable approximation to the full sum over the corpus ( Lewis2020 ) . The retriever R itself can be defined as a function R(x,\mathcal{C})\to Z that takes a query and returns a small subset Z of corpus \mathcal{C} (with |Z|=K\ll|\mathcal{C}| ) likely to contain information relevant to x ( Karpukhin2020 ) . By design, RAG models maintain two kinds of memory : a parametric memory (the knowledge encoded in the generator’s weights) and a non-parametric memory (the external text corpus accessed via retrieval) ( Lewis2020 ) . A standard RAG architecture is illustrated in Figure 1 below. A key distinction

Read the complete text