ComProScanner: A multi-agent based framework for composition-property structured data extraction from scientific literature
Aritra Roy, Enrico Grisan, John Buckeridge, Chiara Gattinoni · 2025
Read ComProScanner: A multi-agent based framework for composition-property structured data extraction from scientific literature by Aritra Roy, Enrico Grisan, John Buckeridge, Chiara Gattinoni (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20362.txt.
Introduction
Aritra Roy and three co-authors build ComProScanner, a multi-agent tool that pulls clean data from science texts. It reads journal texts and pulls out what things are made of, their traits, and how they were made. Such tools are still rare in a form that lay users can run, check, and plot. Their pack aims to fill that gap for dataset work.
The tool is tested on 100 journal texts with 10 language models, at a hard case: ceramic piezoelectric traits and their strain rates. One model, DeepSeek-V3-0324, tops the rest with the best score by a clear gap. The pack gives an easy route from buried print facts to clean sets for machine learning.
Catalog record
| CREATOR | Aritra Roy, Enrico Grisan, John Buckeridge, Chiara Gattinoni |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20362
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ComProScanner: A multi-agent based framework for composition-property structured data extraction from scientific literature Aritra Roy, Enrico Grisan, John Buckeridge, Chiara Gattinoni Abstract Since the advent of various pre-trained large language models, extracting structured knowledge from scientific text has experienced a revolutionary change compared with traditional machine learning or natural language processing techniques. Despite these advances, accessible automated tools that allow users to construct, validate, and visualise datasets from scientific literature extraction remain scarce. We therefore developed ComProScanner , an autonomous multi-agent platform that facilitates the extraction, validation, classification, and visualisation of machine-readable chemical compositions and properties, integrated with synthesis data from journal articles for comprehensive database creation. We evaluated our framework using 100 journal articles against 10 different LLMs, including both open-source and proprietary models, to extract highly complex compositions associated with ceramic piezoelectric materials and corresponding piezoelectric strain coefficients ( d 33 ), motivated by the lack of a large dataset for such materials. DeepSeek-V3-0324 outperformed all models with a significant overall accuracy of 0.82. This framework provides a simple, user-friendly, readily-usable package for extracting highly complex experimental data buried in the literature to build machine learning or deep learning datasets. keywords American Chemical Society, L a T e X † † affiliation: Energy, Materials and Environment Research Centre, London South Bank University, London SE1 0AA, UK. † † affiliation: School of Engineering and Design, London South Bank University, London SE1 0AA, UK. † † email: [email protected] † † affiliation: Bioscience and Bioengineering Research Centre, London South Bank University, London SE1 0AA, UK. † † affiliation: Energy, Materials and Environment Research Centre, London South Bank University, London SE1 0AA, UK. † † affiliation: School of Engineering and Design, London South Bank University, London SE1 0AA, UK. † † email: [email protected] † † affiliation: Department of Physics, Kings College London, London WC2R 2LS, UK. † † email: [email protected] † † abbreviations: IR,NMR,UV 1 Introduction Contemporary data-driven materials design heavily relies on high-fidelity datasets in machine-readable formats, as the effectiveness of machine learning (ML) and deep learning (DL) methodologies hinges on structured and computationally accessible data containing, at minimum, material compositions and their corresponding physical properties. Over the past decade and a half, the establishment of computational databases of high-throughput screened materials based on Density Functional Theory (DFT) calculations, such as the Materials Project (MP) Jain et al. 2013 , JARVIS-DFT Choudhary et al. 2020 , and Open Quantum Materials Database (OQMD) Saal et al. 2013 , together with experimental datasets like the Cambridge Crystallographic Data Centre (CCDC) Allen 2002 or High Throughput Experimental Materials (HTEM) database Zakutayev et al. 2018 , has shifted research emphasis toward data-driven materials design. Nevertheless, the preponderance of experimental scientific knowledge regarding solid-state materials, analogous to other domains, remains embedded within millions of scientific journal articles. Extracting this wealth of information into the structured, machine-readable formats required for computational analysis presents a significant challenge that necessitates automated approaches. Natural language processing (NLP) algorithms have demonstrated remarkable advances in materials science applications, from building toolkits and techniques for automated extraction of chemical information from the scientific literature, such as ChemDataExtractor Swain and Cole 2016 , Jessop et al. 2011 , ChemicalTagger Hawizy et al. 2011 , BatteryBERT Huang and Cole 2022 , and others. These tools and techniques have been implemented to systematically structure the vast corpus of textual knowledge in the field Kim et al. 2017 ; Kononova et al. 2019 ; Huang and Cole 2020 ; Sierepeklis and Cole 2022 ; Dong and Cole 2022 ; Cruse et al. 2022 ; Beard and Cole 2022 ; Trewartha et al. 2022 ; Huang and Cole 2022 ; Foppiano et al. 2023 leveraging various techniques, including regular expressions Python RegEx 2025 , BiLSTM recurrent neural networks Sharfuddin et al. 2018 , and smaller transformer-based language models like BERT Devlin et al. 2019 . These approaches have successfully facilitated the extraction of entity information from diverse sources, including battery materials literature Huang and Cole 2020 ; Huang and Cole 2022 and chemical synthesis parameters documented in methodology sections of scientific papers Kononova et al. 2019 . Entity extraction, and in particular named entity recognition (NER), has dominated these research efforts. Researchers have applied domain-specific labels such as “material” or “property” to specific textual elements, but require an additional post-processing step to construct the relations between these entities, relations that prove essential for training effective machine learning or deep learning models. To exemplify, discrete entities such as “ \text{Cu}{\vphantom{\text{X}}}_{\vphantom{\text{2}}\smash[t]{\text{2}}}^{\vphantom{\smash[t]{\text{2}}}\hphantom{\text{2}}\text{}}\text{O} ” or “2.1 eV” were targeted rather than establishing the relational connections between them (for example, “2.1 eV” represents the measurement of the band gap for “ \text{Cu}{\vphantom{\text{X}}}_{\vphantom{\text{2}}\smash[t]{\text{2}}}^{\vphantom{\smash[t]{\text{2}}}\hphantom{\text{2}}\text{}}\text{O} ”), i.e., they do not implement relation extraction (RE) techniques. In the early 2020s, several end-to-end methods were developed that use a single machine learning model integrating both named entity recognition and relation extraction (NERRE) Giorgi et al. 2022 ; Cabot and Navigli 2021 ; Townsend et al. 2021 . These methodologies demonstrate efficacy in relation extraction tasks; however, they remain fundamentally limited to n -ary relation extraction frameworks that are complex in architectural structure and struggle to extract all information if the interconnection between various entities are too high. Following the widespread adoption of various large language models (LLMs), researchers have employed them successfully to extract information from journal articles, replacing traditional sequence-to-sequence approaches with more sophisticated NERRE methods. Approaches ranging from pre-training Mishra et al. 2025 and fine-tuning LLMs Dagdelen et al. 2024 ; Foppiano et al. 2024 ; Polak et al. 2024 ; Ye et al. 2024 ; Jablonka et al. 2023 ; Zimmermann et al. 2025 to prompt-engineering Polak and Morgan 2024 ; Alampara et al. 2025 ; Prasad et al. 2024 ; Foppiano et al. 2024 ; Gupta et al. 2024 ; Jablonka et al. 2023 ; Zimmermann et al. 2025 , zero-shot Foppiano et al. 2024 ; Polak et al. 2024 ; Ekuma 2024 ; Jablonka et al. 2023 ; Zimmermann et al. 2025 and few-shot prompting Foppiano et al. 2024 ; Ekuma 2024 ; Gupta et al. 2024 ; Zimmermann et al. 2025 , as well as Retrieval-Augmented Generation (RAG) methods Lála et al. 2023 ; Maharana et al. 2025 have enhanced NERRE-level text extraction from materials science literature. Concurrently, LLM-powered agents have been utilised for various chemistry and material science tasks, including extracting relevant information from journal articles M. Bran et al. 2024 ; Ansari and Moosavi 2024 ; Zhang et al. 2024 ; Skarlinski et al. 2024 ; Feng et al. 2025 , predicting new molecules or materials or their properties Zimmermann et al. 2025 ; M. Bran et al. 2024 , automating data handling Zimmermann et al. 2025 ; Zhang et al. 2024 ; Chiang et al. 2024 ; Boiko et al. 2023 ; Feng et al. 2025 , enhancing reasoning and computational capabilities of LLMs M. Bran et al. 2024 ; Zhang et al. 2024 ; Skarlinski et al. 2024 ; Chiang et al. 2024 ; Boiko et al. 2023 , proposing novel hypotheses Zimmermann et al. 2025 , and even semi-automating experiments Boiko et al. 2023 by integrating expert tools. Several notable implementations have emerged in this domain, such as Eunomia by Ansari et al. Ansari and Moosavi 2024