A Search for “New Physics” “Beyond the Standard Model” in Open Data with Machine Learning April 1, 2025

Rikab Gambhir · 2025

Read A Search for “New Physics” “Beyond the Standard Model” in Open Data with Machine Learning April 1, 2025 by Rikab Gambhir (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22790.txt.

Introduction

Rikab Gambhir wrote a paper dated April 1, 2025, reporting a machine learning search for new physics in open data. The dataset is the public archive of papers in a high-energy theory channel, tens of thousands of papers in all. The search treats talk of new physics in that literature as its signal. It claims detection at high significance, with a dark, axion-like character.

The paper also claims stronger reach for a future collider and a path to finding new physics with no collider at all. Most of the code, the author states, was written by machine learning methods. The piece reads as a playful take on search papers, built on literature rather than collision data.

Catalog record

CREATORRikab Gambhir
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-22790

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Search for “New Physics” “Beyond the Standard Model” in Open Data with Machine Learning April 1, 2025 Rikab Gambhir Abstract In this new era of large data, it is important to make sure we do not miss any signs of new physics. Using the publicly-available open data collected by the arXiv.org experiment in the hep-ph channel, corresponding to a raw total integrated ℒ \mathcal{L} iterature of 65,276 papers, we perform a search for “New Physics” and related signals. In the worst-case, we are able to detect “New Physics” with “the LHC” at a significance level of at least 6.5 ​ σ 6.5\sigma . This “New Physics” signature is primarily “Dark” in nature, and is potentially axion(-like) dark matter. We also show the potential for further improvement in the future, and that “New Physics” can be found with “a Future Collider” at at least 8.9 ​ σ 8.9\sigma , as well as the potential to find “New Physics” without any collider at all. This search is performed using code that was 80 % 80\% written by Machine Learning methods. 1 Introduction Using tools like the Large Hadron Collider (LHC), we have made enormous progress in our understanding of the Standard Model (SM) over the last few decades. However, little progress has been made in finding new physics Beyond the Standard Model (BSM) Peskin:1997ez , despite indirect evidence of its existence. In recent years the paradigm of anomaly detection hepmllivingreview ; ATLAS:2020iwa ; ATLAS:2023azi ; CMS:2024nsz ; ATLAS:2023ixc ; ATLAS:2025obc ; knapp2020adversarially ; Gambhir:2025afb has grown in popularity: new physics might be buried in data we already have, if only we had a method to uncover it. In this paper, we perform a direct search for “New Physics”, using 126 GB of data from https://arXiv.org/archive/hep-ph , collected from January 1 st , 2016 to March 1 st 2025 — our preprocessed dataset and analysis framework will be made public (see Sec. 5 ). By analyzing the abstracts of randomized arXiv submissions in the hep-ph channel, we are able to find significant excess of “New Physics”, most of which is “Dark”, well above the 5 \sigma discovery threshold. We emphasize that this is in already existing data produced by the physics community over the last decade --- no new experiment is needed. 1 1 1 Despite some great recommendations for experiments Cesarotti:2023sje . Moreover, our analysis strategy is multi-differential: We are able to gauge the impact of experiments by searching for “New Physics” with “the LHC” or with “Future Colliders” – the later of which we will see has a higher “New Physics” significance. Lastly, our technique can be used to analyze trends in the particle physics community over time. We will see, for example, that “the LHC” is not as popular as it once was. A major component of this search is the use of Machine Learning (ML)-based techniques. Unlike traditional ML-based searches, however, which typically employ ML to perform fits to data Collins:2019jip , we instead employ ML to write most of the analysis framework. We show that it is possible to use ChatGPT to code about 80\% of a novel and gimmicky data analysis in less than 18 hours, including sleep. 2 2 2 Only the analysis code was generated with the help of AI, not the text of this paper or the plots. I have too much pride to let an AI speak for me. Machines have no right to utter humanity’s sacred tongues. We hope this serves as a lesson to the particle physics community — AI can help one realize an idea quickly, but it cannot replace the soul behind it. The rest of this paper is organized as follows: In Sec. 2 , we describe the arXiv dataset and our selection cuts. In Sec. 3 , we show and discuss our main results. Finally, we present our outlook in Sec. 4 . 2 The Dataset and Methodology Using the extremely convenient arxiv (v2.1.3) Python Package arxiv_scraper , it is possible to analyze arXiv data. However, because the full arXiv dataset is extremely large, and most of this data does not contain “New Physics” or related signals, it is wise to make selection cuts. I am also limited by the fact that my laptop only has 8 GB of RAM and that I really have to get this out by April 1^{\rm st} . We will search in the hep-ph channel, since it is unknown how likely it is to find “New Physics” in other channels such as cond-mat or the quantitative finance categories. We will use hep-ex as a control group, since supposedly no collider experiment has ever seen “New Physics”. We will restrict ourselves from January 2016 to March 2025, a 9-year data taking period. The total integrated \mathcal{L} iterature 3 3 3 We use \mathcal{L} iterature rather than the more commonly-used Luminosity because not all papers are equally illuminating. collected during this period, \int dt\,\mathcal{L} , is \displaystyle\texttt{hep-ph}:\int dt\,\mathcal{L}=65,276\text{ Papers}. (1) \displaystyle\texttt{hep-ex}:\int dt\,\mathcal{L}=25,661\text{ Papers}. (2) An average paper is approximately 1.93 MB, corresponding to approximately 126 GB of collected data. In its raw AOD (All Of the Data) file format, the data is too unwieldy for phenomenological analysis and must be preprocessed. We show a plot of the instantaneous \mathcal{L} iterature rate, measured per-month, in Fig. 1 . Figure 1: The instantaneous \mathcal{L} iterature collected over time for the hep-ph and hep-ex channels. It is interesting to note in Fig. 1 the bump before the large dip at the end of each year. This happens to coincide with a number of annual astrophysical phenomenon: • Earth reaches its Perihelion in its orbit around the Sun. • The Quadrantid meteor shower. • Orion becomes visible. This happens 9 times in a row and is unlikely to be a coincidence — 18 times in a row if hep-ex is included, though it seems to happen at a lesser extent there. We leave the study of this phenomenon for potential future work, which will likely involve a similar analysis in the astro-ph channel. 2.1 Selection Cuts Due to the extremely high data rate, our selection must be prescaled Smith:2016vcs . The data collection trigger only fires exactly 250 times per month, heavily reducing our effective \mathcal{L} iterature. Each arXiv entry is a composite combination of many different sections (a title, an abstract, sections, a conclusion, and so on), distributed in a Portable Document Format (PDF) Placakyte:2011az file. In a typical PDF, the fundamental abstract field will only be a small fraction ( 1-10\% ) of the total document, and the rest of the document typically contains no additional interesting physics. We make a hard cut to only select the abstract and remove the rest of the Underlying Entry (UE). After these two cuts, the effective data size has been reduced from 126 GB to 34 MB. We emphasize that we will make all of this curated data public for further analysis by the community. Next, we can perform our search. For any entry \mathcal{E} , its abstract is a character string A_{\mathcal{E}} . We would like our analysis to be IRC (Improved-Readability-and-Capitalization)-safe, so we cut on only Secondary Verbiage (SV) filler words: “the”, “of”, “for”, “a”,

Read the complete text