From Data to Theory: Autonomous Large Language Model Agents for Materials Science
Samuel Onimpa Alfred, Veera Sundararaghavan · 2026
Read From Data to Theory: Autonomous Large Language Model Agents for Materials Science by Samuel Onimpa Alfred, Veera Sundararaghavan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19789.txt.
Introduction
Alfred and Sundararaghavan present an autonomous language model agent for end-to-end, data-driven materials theory development. The agent picks an equation form, generates and runs its own code, and tests how well the theory matches the data without human help. It combines step-by-step reasoning with expert-supplied tools, adjusting its approach when required while keeping a clear record of its decisions. For established cases like the Hall-Petch equation and Paris law, it correctly identifies the governing equation and predicts reliably on new datasets.
Catalog record
| CREATOR | Samuel Onimpa Alfred, Veera Sundararaghavan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68767 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.19789
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Data to Theory: Autonomous Large Language Model Agents for Materials Science Samuel Onimpa Alfred, Veera Sundararaghavan Abstract Abstract We present an autonomous large language model (LLM) agent for end-to-end, data-driven materials theory development. The model can choose an equation form, generate and run its own code, and test how well the theory matches the data without human intervention. The framework combines step-by-step reasoning with expert-supplied tools, allowing the agent to adjust its approach as needed while keeping a clear record of its decisions. For well-established materials relationships such as the Hall–Petch equation and Paris law, the agent correctly identifies the governing equation and makes reliable predictions on new datasets. For more specialized relationships, such as Kuhn’s equation for the HOMO-LUMO gap of conjugated molecules as a function of length, performance depends more strongly on the underlying model, with GPT-5 showing better recovery of the correct equation. Beyond known theories, the agent can also suggest new predictive relationships, illustrated here by a strain-dependent law for changes in the HOMO-LUMO gap. At the same time, the results show that careful validation remains essential, because the agent can still return incorrect, incomplete, or inconsistent equations even when the numerical fit appears strong. Overall, these results highlight both the promise and the current limitations of autonomous LLM agents for AI-assisted scientific modeling and discovery. 1 Introduction Scientific discovery has long relied on human expertise, with foundational equations such as the Hall–Petch equation hall1951deformation in metallurgy and the Arrhenius equation arrhenius1967reaction in chemical kinetics emerging from close attention to experimental data. In 1889, Arrhenius examined published temperature-dependent reaction-rate data and showed that several datasets could be described by a common relation. Van ’t Hoff had already recognized in 1884 that the temperature dependence of equilibrium constants suggested a related mathematical form for the temperature dependence of forward and reverse reaction rates. Arrhenius then took the next step by showing that experimental rate data could be organized by a similar expression, turning an earlier theoretical idea into a broadly useful empirical law bearing his name arrhenius1967reaction . In a similar spirit, the present work treats LLMs as knowledge-based assistants that draw on prior scientific literature to connect observed data to plausible equations before those equations are tested quantitatively. For decades, researchers have hoped that artificial intelligence (AI) could help speed up the full scientific workflow, from data generation and hypothesis building to equation discovery and experimental validation. Early practical progress came through machine learning, which benefited from the rapid growth of materials data through high-throughput experiments hattrick2016perspective , databases such as the Materials Project jain2013commentary , and broader efforts such as the Materials Genome Initiative de2019new . These tools have been applied to many problems, including prediction of metal fatigue properties alfred2025data and thermodynamic stability of inorganic compounds zou2025predicting . However, most machine learning models function as black boxes: they can make accurate predictions, but they do not naturally provide equations or explanations that can be turned into theory, checked against physical principles, or used to generate new hypotheses. Symbolic regression (SR), originally developed in the context of genetic programming, offers a more interpretable alternative by searching for mathematical expressions that fit data directly koza1994genetic . Yet this search quickly becomes difficult as equation complexity grows. More recent approaches combine deep learning with symbolic search to steer the search toward physically reasonable expressions d2022deep ; mundhenk2021symbolic , but they still explore large mathematical spaces without the benefit of broad scientific knowledge, which can limit the physical meaning of the final result udrescu2020ai . Large language models (LLMs) introduce a different kind of capability for materials science. Because they are trained on large collections of web text, scientific papers, textbooks, and technical documents, they can draw from a wide range of scientific knowledge rather than from a single task-specific dataset. In materials science, LLM-based agents have so far been used mainly for extracting information from the literature gupta2022matscibert ; kononova2021opportunities ; dagdelen2024structured ; polak2024extracting ; gupta2024data ; ansari2024agent ; ghosh2026llm . Several recent studies have shown that this can work well at scale. Dagdelen et al. used fine-tuned LLMs to extract structured information across multiple materials chemistry tasks dagdelen2024structured . Polak et al. reported precision and recall approaching 90% for materials data extraction using prompt-based conversational LLMs polak2024extracting . Gupta et al. extracted more than one million polymer-property records from about 680,000 full-text articles gupta2024data . Ansari et al. introduced Eunomia, a zero-shot autonomous agent with performance comparable to fine-tuned models across several extraction benchmarks ansari2024agent . Ghosh et al. developed a closed-loop multi-agent system with internal consistency checks to extract thermoelectric and structural data from roughly 10,000 articles ghosh2026llm . Together, these studies show that LLM-based agents can be useful in materials science, but they focus on extracting known information from the literature. They do not address the broader challenge of carrying out an end-to-end scientific fitting workflow without human intervention. In practice, materials scientists often combine many individual experimental and computational tools, interpret intermediate results, and revise their approach when an initial plan does not work. This process is powerful, but it can also be slow, labor-intensive, and difficult to scale. The key question is therefore not only whether LLMs can help identify equations, but whether they can take part in the larger workflow used in day-to-day scientific analysis. In this work, we develop autonomous agents that decide what step to take next, use specialized tools, interpret intermediate results, and change course when needed, all while keeping a transparent record of their decisions. To the best of our knowledge, this is the first LLM-driven autonomous agent designed specifically for end-to-end data fitting in materials science. Existing fitting workflows still require human input at one or more important stages, such as choosing the equation form, selecting initial fitting parameters, judging fit quality, or deciding whether another fitting attempt is needed. We are not aware of prior work that automates this entire process through LLM-driven autonomy. This work makes four main contributions. First, the agent generates equations from scientific reasoning rather than choosing from a fixed library of templates, making the task a direct test of scientific knowledge. Second, the framework is designed to handle unclear or imperfect LLM outputs, which are common in scientific computing tasks. Third, the agent judges its own fitting results and decides whether re-fitting or a different strategy is needed. Fourth, the framework records the full chain of decisions, making it possible to inspect every step of the fitting process. A second major contribution is the systematic evaluation of LLM scientific knowledge in the setting of autonomous data fitting. Because we intentionally remove fallback options, successful completion depends on whether the LLM can supply the governing equation from its own prior knowledge. Each case study therefore becomes a direct test of scientific reasoning: does the agent know the right equation, can it turn that equation into working code, and can it recognize when the result is physically unreasonable? By evaluating OpenAI’s Generative Pre-trained Transformer (GPT) models on materials science datasets of different complexity, this work provides a quantitative picture of the current strengths and limits of LLM-based scientific knowledge as a basis for autonomous scientific workflows. Using this framework, we study