Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models
Kristian G. Barman, Sascha Caron ∗, Emily Sullivan, Henk W. de Regt, Roberto Ruiz de Austri, Mieke Boon, Michael Färber, Stefan Fröse, Faegheh Hasibi, Andreas Ipp, Rukshak Kapoor, Gregor Kasieczka, Daniel Kostić, Michael Krämer, Tobias Golling, Luis G. Lopez, Jesus Marco, Sydney Otten, Pawel Pawlows · 2025
Read Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models by Kristian G. Barman, Sascha Caron ∗, Emily Sullivan, Henk W. de Regt, Roberto Ruiz de Austri, Mieke Boon, Michael Färber, Stefan Fröse, Faegheh Hasibi, Andreas Ipp, Rukshak Kapoor, Gregor Kasieczka, Daniel Kostić, Michael Krämer, Tobias Golling, Luis G. Lopez, Jesus Marco, Sydney Otten, Pawel Pawlows (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05382.txt.
Introduction
Barman and a large team of co-authors lay out a roadmap for Large Physics Models, in this two thousand twenty-five paper. The idea is to build foundation AI models specialized for physics, rather than leaning only on commercial general-purpose chatbots.
Such models could work alone or inside a framework with symbolic math tools, analyzers for experimental data, and literature synthesis. The authors organize the effort around three pillars. Development builds models that handle physics text, mathematics, and data. Evaluation tests accuracy through benchmarks. Philosophical reflection asks what the models mean for the science. They argue the project needs physicists, computer scientists, and philosophers working together from the start. The paper is a position piece meant to rally that collaboration.
Catalog record
| CREATOR | Kristian G. Barman, Sascha Caron ∗, Emily Sullivan, Henk W. de Regt, Roberto Ruiz de Austri, Mieke Boon, Michael Färber, Stefan Fröse, Faegheh Hasibi, Andreas Ipp, Rukshak Kapoor, Gregor Kasieczka, Daniel Kostić, Michael Krämer, Tobias Golling, Luis G. Lopez, Jesus Marco, Sydney Otten, Pawel Pawlows |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-05382
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models Kristian G. Barman, Sascha Caron ∗, Emily Sullivan, Henk W. de Regt, Roberto Ruiz de Austri, Mieke Boon, Michael Färber, Stefan Fröse, Faegheh Hasibi, Andreas Ipp, Rukshak Kapoor, Gregor Kasieczka, Daniel Kostić, Michael Krämer, Tobias Golling, Luis G. Lopez, Jesus Marco, Sydney Otten, Pawel Pawlowski, Pietro Vischia, Erik Weber, Christoph Weniger Abstract This paper explores ideas and provides a potential roadmap for the development and evaluation of physics-specific large-scale AI models, which we refer to as Large Physics Models (LPMs). These models, based on foundation models such as Large Language Models (LLMs) - trained on broad data - are tailored to address the unique demands of physics research. LPMs can function independently or as part of an integrated framework. This framework can incorporate specialized tools, including symbolic reasoning modules for mathematical manipulations, frameworks to analyse specific experimental and simulated data, and mechanisms for synthesizing insights from physical theories and scientific literature. We begin by examining whether the physics community should actively develop and refine dedicated models, rather than relying solely on commercial LLMs. We then outline how LPMs can be realized through interdisciplinary collaboration among experts in physics, computer science, and philosophy of science. To integrate these models effectively, we identify three key pillars: Development, Evaluation, and Philosophical Reflection. Development focuses on constructing models capable of processing physics texts, mathematical formulations, and diverse physical data. Evaluation assesses accuracy and reliability through testing and benchmarking. Finally, Philosophical Reflection encompasses the analysis of broader implications of LLMs in physics, including their potential to generate new scientific understanding and what novel collaboration dynamics might arise in research. Inspired by the organizational structure of experimental collaborations in particle physics, we propose a similarly interdisciplinary and collaborative approach to building and refining Large Physics Models. This roadmap provides specific objectives, defines pathways to achieve them, and identifies challenges that must be addressed to realise physics-specific large scale AI models. 1 Introduction Traditionally, Machine Learning models in physics were narrowly focused and designed for specific tasks such as distinguishing signal events from background events in particle accelerator experiments, predicting the mass of a particle given detector data, discovering materials, or identifying celestial objects [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] . While some of these models were (and still are) effective in performing the specific tasks they were designed for, they lacked the versatility to be applied beyond their original domains. In contrast to domain and application specific models, Large Language Models (LLMs) such as GPT-4 [ 8 ] , Claude [ 9 ] , Gemma [ 10 ] and Llama [ 11 ] , are versatile and able to analyse and react to text, images, computer code, and data in general, across various domains, and with remarkable proficiency [ 12 , 13 ] . Unlike narrow models, which are primarily used in data analysis, LLMs can enhance a broad range of research activities. Scientific research can be regarded as an interconnected network of processes aimed at advancing scientific understanding. In this network, activities such as hypothesis generation, experimentation, data analysis, and model or theory development continually feed back into one another in an iterative, dynamic fashion. The successful integration of LLMs into these workflows requires not only a careful evaluation of the skills they bring to such activities but also of their alignment with desirable epistemic values (e.g., accuracy, coherence, and explanatory power) and non-epistemic values (e.g., societal impact and ethical considerations). As was the case with the use of computer-based research, LPMs could also help us overcome the limits of our human capabilities. For instance, they may help speed up scientific progress in general, deepening our scientific understanding, which is one of the ultimate goals of science, enabling us not only to make accurate predictions but also to grasp why things are the way they are [ 14 ] . For instance, they can aid the generation of hypotheses by serving as brainstorming partners, and in doing so may offer novel approaches to complex problems in physics and inspire creativity, acting as an ’artificial muse’ [ 15 ] for researchers. For example, [ 16 ] use LLMs to suggest ideas in physics, subsequently having 100 experienced researchers evaluate the resulting ideas. In the experimental phase, LLMs may assist in devising tests and experiments, showcasing both current capabilities and future potential for experiment design and execution, thereby streamlining the research process [ 17 ] . In data analysis, LLMs can offer new methods for interpretation and visualisation, particularly in data-intensive physics. They could also generate insights that may elude human researchers or narrower AI models and automate code generation for data analysis [ 18 , 19 , 20 ] . Moreover, LLMs may help formulate accessible conclusions for a broader scientific community, facilitating knowledge sharing across disciplines, while also enabling multimodal integration and generalisation [ 21 ] . To date, there have been notable examples of successful scientific use of LLMs, including the design and execution of autonomous experiments, agent-based AI labs, applications to symbolic tasks, and the development of collaborative AI tools known as CoScientists, and the enhancement of capabilities in programming and mathematical proof generation [ 22 , 23 , 24 , 25 , 26 , 27 , 28 ] . It is claimed that LLMs are transforming scientific research by creating a ’hybrid intelligence’ that augments human cognition and reshapes research processes [ 29 , 30 ] . Despite LLM’s limitations in reasoning and creativity [ 31 , 32 ] , which are usually central to the process of hypothesis formulation, experimentation, and scientific conclusions, they have been shown to enrich the initial stage of scientific inquiry by posing insightful questions and providing valuable observations. In selecting relevant research topics, they can efficiently summarise and highlight key findings from vast scientific literature, and enhance understanding [ 33 , 34 ] . Additionally, LLMs facilitate the exploration of interdisciplinary research, bridging gaps between different fields and advancing innovative ideas. Given the prospective success of LLMs, a fundamental question that arises is whether the physics community should use commercially available tools or develop a custom-built LLM specifically for physics research. While tools such as GPT-4 are frequently utilised in physics, their usefulness depends on accommodating a tool that was not primarily designed for physicists, and therefore requires either fine-tuning on additional data, or techniques such Retrieval-Augmented Generation (RAG) [ 35 , 36 ] (see ATLASchatbot - chATLAS). For instance, tools like AstroLLama [ 37 ] are fine-tuned on existing LLMs using abstracts of astronomy papers. Such tools, however, still have very limited capabilities, as fine-tuning on domain-specific data often lacks the comprehensive contextual understanding and reasoning skills necessary for addressing complex, novel problems in physics and astronomy. Similarly, there is a growing number of tools for more general physical data embedding that can solve very specific physical problems via a common physical embedding. These tools are often referred to as ”foundation models” in the physics literature, but usually have no text interface (see e.g., [ 38 , 39 , 40 , 41 , 42 , 43 ] ), and their scope is