Symbolic regression for precision LHC physics
Manuel Morales-Alvarado, Daniel Conde, Josh Bendavid, Veronica Sanz, Maria Ubiali · 2024
Read Symbolic regression for precision LHC physics by Manuel Morales-Alvarado, Daniel Conde, Josh Bendavid, Veronica Sanz, Maria Ubiali (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07839.txt.
Introduction
Morales-Alvarado, Sanz, Ubiali and their co-authors study symbolic regression for precision physics at the Large Hadron Collider in 2024. The method seeks compact formulas that fit data, joining the clarity of math with machine learning power.
As a first test, they use the method to recover known results in quantum electrodynamics, where true answers are already known. That check helps judge how well the tool works before harder use. They then turn to structure functions in the Drell-Yan process, which lack first-principle formulas. The authors present symbolic regression as a useful aid for collider analysis.
Catalog record
| CREATOR | Manuel Morales-Alvarado, Daniel Conde, Josh Bendavid, Veronica Sanz, Maria Ubiali |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 13 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-07839
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Symbolic regression for precision LHC physics Manuel Morales-Alvarado, Daniel Conde, Josh Bendavid, Veronica Sanz, Maria Ubiali Abstract We study the potential of symbolic regression (SR) to derive compact and precise analytic expressions that can improve the accuracy and simplicity of phenomenological analyses at the Large Hadron Collider (LHC). As a benchmark, we apply SR to equation recovery in quantum electrodynamics (QED), where established analytical results from quantum field theory provide a reliable framework for evaluation. This benchmark serves to validate the performance and reliability of SR before extending its application to structure functions in the Drell-Yan process mediated by virtual photons, which lack analytic representations from first principles. By combining the simplicity of analytic expressions with the predictive power of machine learning techniques, SR offers a useful tool for facilitating phenomenological analyses in high energy physics. 1 Introduction SR is a machine learning task that discovers symbolic models by searching for simple analytic expressions that minimise both prediction error and model complexity. Unlike traditional methods, SR does not fit parameters to a potentially overparametrised model but instead finds concise formulas to describe data. This approach combines the power of machine learning with the clarity of analytical expressions, enabling the extraction of simple formulas from potentially complex datasets. In LHC physics, some quantities have analytic expressions, while others require expensive fits or iterative algorithms for evaluation, lacking universally known formulas. Previous studies have applied SR in LHC contexts [ 1 , 2 ] , often comparing the derived models to known analytical results. However, a key motivation for this work arises in scenarios where no reference expression exists, prompting the need to assess the reliability of SR methods. The structure of this work is as follows. Sect. 2 briefly introduces the basics of SR. Sect. 3 validates the methodology by recovering known analytical expressions from noisy data. Sect. 4 presents an SR-derived result for the Drell-Yan structure function with virtual photons, which cannot be obtained from first principles. We conclude in Sect. 5 . 2 Symbolic regression SR is a supervised learning method that discovers closed-form analytical expressions for input-output relationships without completely predefined functional forms [ 1 , 2 , 3 , 4 , 5 ] . Unlike linear regression or neural networks, SR optimises simultaneously for both accuracy and simplicity. We use the PySR package [ 6 ] , a multipopulation evolutionary algorithm that evaluates symbolic expressions as expression trees. It can be highly effective for parameter spaces of moderate size [ 7 , 8 ] . Fig. 2 shows an example tree representing the equation 3.1y\cdot(x^{2}+1) . Figure 1: Example of an expression tree. Figure 2: Mutation of an expression tree. In this study, equations are evaluated using the MSE loss function. During optimisation, expression trees mutate over iterations to improve based on a selection criterion, as shown in Fig. 2 , where a ’ + ’ in Fig. 2 mutates to a ’ - ’. Trees can also combine through crossover, and complexity, defined by node count, is managed via multiobjective optimisation. More details are available in the original reference. The selection criterion in PySR guides the evolutionary algorithm in choosing the fittest expression trees. There are three criteria: accuracy , which selects the model with the lowest loss; score , defined as the negative derivative of log-loss with respect to complexity, selects the model with highest decrease in loss with marginally higher complexity; and best , which selects the model with the highest score, provided its loss does not exceed 1.5 times that of the most accurate model. 3 Equation rediscovery from QED In this section, we apply SR to the process e^{+}e^{-}\to\gamma^{*}\to\mu^{+}\mu^{-} at leading order, testing its ability to recover the angular cross-section distribution in the massless limit. From QED, the distribution is: \frac{d\sigma}{d\cos\theta}=\frac{\pi\alpha^{2}}{2s}(1+\cos^{2}\theta), (1) where \theta is the angle between the outgoing muon and incoming electrons, \alpha the QED coupling, and s the squared centre-of-mass energy, treated as a constant. Radiative corrections and higher-order effects are not included, so \alpha is also treated as constant. SR will aim to rediscover this equation from simulated samples. To train the regressor, we generate 100k events at \sqrt{s}=1 TeV using MadGraph5_aMC@NLO [ 9 , 10 ] without kinematic cuts. From these events, we extract \cos\theta distributions for various binnings and show the corresponding samples to the regressor. As Eq. ( 1 ) indicates, \cos\theta is the key kinematic variable. In Tab. 1 , we present the analytical equations derived from the simulated distributions for different binnings. Comparing with Eq. ( 1 ), we observe that the accuracy criterion often fails to recover the equation across different binning levels, fitting the noise. In contrast, best , successfully recovers the correct equation with finer binning. Notably, score consistently identifies the correct equation, even with very fine binning, demonstrating that simplicity can be an effective factor. Table 1: Equations according to the three selection criteria for different bin sizes with c_{\theta}\equiv\cos\theta . The numbers that appear in these expressions have been approximated to the 5th decimal place. Bins Accuracy Best Score 10 c_{\theta}(c_{\theta}+0.00798)(0.00111\cdot c_{\theta}^{3}+0.03459)+0.03503 c_{\theta}^{2}(0.00111\cdot c_{\theta}+0.03459)+0.03503 0.03459\cdot c_{\theta}^{2}+0.03503 20 c_{\theta}(c_{\theta}+0.01825)(-0.00155\cdot c_{\theta}(c_{\theta}-0.05138)+0.03579)+0.03485 c_{\theta}(0.03447\cdot c_{\theta}+0.00064)+0.03498 0.03447\cdot c_{\theta}^{2}+0.03498 200 c_{\theta}^{2}(-0.64647\cdot c_{\theta}(0.00119\cdot c_{\theta}-0.00151)+0.03495)+0.03495 0.03447\cdot c_{\theta}^{2}+0.03495 0.03447\cdot c_{\theta}^{2}+0.03495 Realistic simulations must account for uncertainties and fluctuations in the data. Figs. 4 and 4 show the absolute and normalised distributions for 30 bins, comparing the simulation’s central value (with 1 -standard deviation Poisson uncertainty at the level of the event count in each bin), the SR result, and the analytic equation. SR demonstrates excellent agreement with the true functional form, even in cases where the simulation deviates by more than one standard deviation from it. This shows SR’s ability to recover not only accurate distributions but also the correct functional dependence derived from first principles in QED. Figure 3 : Absolute distribution for 30 bins. Figure 4 : Normalised distribution for 30 bins. Having verified a known natural law across various settings, we can now explore how SR can shed light on expressions that do not have a known closed analytical formula. This is, for example, the case of parton distribution functions and structure functions. 4 Proton structure functions Parton distribution functions (PDFs) are essential for calculating observables at hadron colliders, as discussed in [ 11 , 12 ] and references therein. They represent momentum distribution of partons within hadrons, which must be combined with partonic cross sections to produce physical predictions to compare with experimental data. PDFs cannot be calculated from first principles, as they encapsulate the non-perturbative regime of quantum chromodynamics where the strong coupling becomes too large for perturbative methods to converge. Instead, PDFs have to be fitted from experimental data. This is achieved at the state of the art by using fixed functional forms or neural networks with hundreds of trainable weights [ 13 , 14 , 15 ] . Many differential observables depend on structure functions (SFs), which are weighted combinations of PDFs [ 16 , 17 ] . Like PDFs themselves, SFs lack closed analytical expressions. In this section, we introduce the first SR approach to derive SFs. Our goal is to obtain accurate and compact analytical expressions that can effectively model these functions, offering a more straightforward and clear