Iterative Corpus Refinement for Materials Property Prediction Based on Scientific Texts

Lei Zhang (✉), Markus Stricker · 2025

Read Iterative Corpus Refinement for Materials Property Prediction Based on Scientific Texts by Lei Zhang (✉), Markus Stricker (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21646.txt.

Introduction

Finding new materials by trial in the lab is slow because the possible mixes of elements are nearly endless. Lei Zhang and Markus Stricker used the scientific literature itself as data in 2025. Their framework repeatedly refines a text corpus, picking the most varied documents, training word embeddings on them, and watching how composition-property links settle in the embedding space.

The method was aimed at catalysts for three reactions tied to fuel cells and water splitting. It picked out the highest-performing compositions from a large pool of candidates. Lab tests of the predicted materials confirmed the picks. The authors present text mining as a scalable screen where measured data are scarce.

Catalog record

CREATORLei Zhang (✉), Markus Stricker
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-21646

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Iterative Corpus Refinement for Materials Property Prediction Based on Scientific Texts Lei Zhang (✉), Markus Stricker Abstract The discovery and optimization of materials for specific applications is hampered by the practically infinite number of possible elemental combinations and associated properties, also known as the ‘combinatorial explosion’. By nature of the problem, data are scarce and all possible data sources should be used. In addition to simulations and experimental results, the latent knowledge in scientific texts is not yet used to its full potential. We present an iterative framework that refines a given scientific corpus by strategic selection of the most diverse documents, training Word2Vec models, and monitoring the convergence of composition-property correlations in embedding space. Our approach is applied to predict high-performing materials for oxygen reduction (ORR), hydrogen evolution (HER), and oxygen evolution (OER) reactions for a large number of possible candidate compositions. Our method successfully predicts the highest performing compositions among a large pool of candidates, validated by experimental measurements of the electrocatalytic performance in the lab. This work demonstrates and validates the potential of iterative corpus refinement to accelerate materials discovery and optimization, offering a scalable and efficient tool for screening large compositional spaces where reliable data are scarce or non-existent. 1 Introduction The discovery of new materials has traditionally relied on experimental intuition and trial-and-error methods, where researchers manually combined and tested materials, guided by experience and theoretical knowledge [ 6 , 7 , 26 ] . These methods have led to significant breakthroughs, such as platinum-based electrocatalysts for fuel cells [ 5 ] and advanced alloys for aerospace applications [ 4 ] . However, they are time-consuming, resource-intensive, and difficult to scale, particularly as material systems containing more than one or two principle elements become more complex. Modern material systems, such as high-entropy alloys [ 15 ] or oxides [ 27 ] , multi-principal element compounds [ 9 ] , involve a large number of possible and tunable compositions, which represents a possibility to use them as ‘discovery platforms’ [ 2 ] . However, the sheer number of possible compositions makes experimental searches impractical or even impossible. Furthermore, global challenges such as the switch to renewable energy and sustainability require faster and more efficient ways to discover new and optimize existing materials [ 11 , 17 ] . In recent years, computational methods have become powerful tools for materials discovery. Simulation techniques such as density functional theory (DFT) can predict material properties, reducing the need for extensive experimental trials at the cost of the energy spent in high performance computing centers [ 10 , 18 , 19 ] . Machine learning has added another dimension by finding patterns in structured datasets and predicting properties for unexplored compositions [ 13 , 16 ] . Although these methods have been successful in narrowing the search space, they have limitations. DFT simulations are computationally expensive, in particular when small \leq 1\, atom-% compositional changes require many calculation to achieve a statistically correct property prediction for one composition point due to the different random distributions of elements and their impact on material properties. Supervised machine learning models to substitute expensive DFT simulations require high-quality datasets that are available at scale and variety to match the parameter space of technologically interesting materials. The scientific literature offers an alternative resource for material discovery. Research articles and patents contain hidden knowledge encoded in text about composition-property relationships from experimental results and theoretical approaches [ 25 ] . Natural language processing (NLP) methods like Word2Vec [ 14 ] and Doc2Vec [ 12 ] can extract this knowledge by turning textual data into vector representations. These vectors capture relationships and correlations between words, which allows to link ‘material dimensions’, such as composition, to properties, e.g. electrocatalytic performance, and to develop models for the prediction of new high-performing candidate compositions. Unlike simulations or structured datasets, text mining can leverage unstructured data, providing access to this latent knowledge. Despite its potential, using the scientific literature effectively presents challenges. Not all text sources are equally relevant, and including too many irrelevant or redundant sources can reduce the predictive quality of the models. The increasing volume of scientific literature, including AI-generated content, makes this issue even more pressing. Many AI-generated texts are repetitive or inaccurate, introducing noise into the dataset, and if repetetively used to retrain the models eventually leading to their collapse [ 20 , 21 ] . Effective methods are therefore needed to filter out ‘low-quality content’ to ensure that models are trained on the most meaningful information. Another challenge is scalability. NLP models can process large datasets, but training them on massive corpora is expensive and it is unclear if more data actually results in a better model. Static, corpus-based models also struggle to adapt to specific tasks. For instance, a model trained on a broad corpus may not effectively capture the relationships required to predict material properties for a specific system accurately. The term ‘material system’ here refers to a fixed set of elements which can be mixed in an arbitrary proportion. To address these challenges, there is a need for methods that allow to tailor a training corpus w.r.t. specific prediction tasks. In this work, we propose an iterative framework to address these challenges. First we start with a broad collection of abstracts from scientific papers, furtheron referred to as ‘documents’, and use Doc2Vec embeddings [ 3 ] to create a map of abstracts. This map allows us to then derive an ordered list based on greedy selection which represents the most diverse documents to avoid information duplication and information fuzziness. From this list, we use batches of 50 documents to train Word2Vec [ 8 , 14 ] models. In their respective embedding space, we measure the change of the centroid of the embeddings w.r.t. our specific prediction task and stop adding new document batches once a convergence criterion is met. The resulting Word2Vec model then constitutes our material system-optimized model which we use to predict reaction-specific high-performance candidate compositions for electrocatalysis. To demonstrate the effectiveness of our approach, we predict highest performing compositions from three different material systems for three different electrocatalytic reactions: oxygen reduction (ORR), hydrogen evolution (HER), and oxygen evolution (OER) and validate them against experimental measurements. While electrocatalysts are used as a case study, our framework is general and can be applied to a wide range of materials discovery tasks. 2 Experiments All code and data needed to reproduce our workflow are available. The code can be found in [ 29 ] , references to all datasets are provided when they are introduced further below. Figure 1: Schematic overview for iterative corpus refinement framework from literature collection, document selection, Word2Vec model training to final predictions based on Pareto front analysis. 2.1 Corpus Collection and Preprocessing Fig. 1 shows a schematic overview of our methodology. First, we collect a relevant corpus of documents using the PaperCollector module in MatNexus [ 28 ] . As source for the documents we use the APIs of Scopus and and limit ourselves to use open access-only publications up to including the year 2023 which results in 6506 papers. The retrieved abstracts and metadata are stored in a structured CSV file. Text preprocessing is performed using

Read the complete text