Reinforcement Learning and Metaheuristics for Feynman Integral Reduction
Mao Zeng · 2025
Read Reinforcement Learning and Metaheuristics for Feynman Integral Reduction by Mao Zeng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-16045.txt.
Introduction
Mao Zeng's 2025 paper brings machine learning to a bottleneck in particle physics: the algebra needed to simplify Feynman integrals, the building blocks of precise predictions. The standard reduction grinds through huge systems of equations, and the order in which equations are generated and solved changes the cost enormously. Zeng frames that ordering choice as a game and tries two ways to play it well.
In the first, a reinforcement learning agent watches the reduction unfold and learns which moves pay off. In the second, a search method tunes priority numbers that steer the ordering, with a small neural network compressing the settings for big problems. On a test case of one-loop bubble integrals, both methods, with almost no human guidance, matched the best hand-designed schemes. Zeng also notes readable patterns in the machine solutions that may transfer to harder integrals.
Catalog record
| CREATOR | Mao Zeng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-16045
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Reinforcement Learning and Metaheuristics for Feynman Integral Reduction Mao Zeng Abstract We propose new methods for optimizing the integration-by-parts (IBP) reduction of Feynman integrals, an important computational bottleneck in modern perturbative calculations in quantum field theory. Using the simple example of one-loop massive bubble integrals, we pose the problem of minimizing the number of arithmetic operations in reducing a target integral to master integrals via the Laporta algorithm. This is a nontrivial combinatorial optimization problem over the ordering of IBP equation generation (from pairs of seed integrals and IBP operators) and the ordering of integral elimination. Our first proposed method is reinforcement learning, which involves an agent interacting with an environment in a step-by-step manner and learning the best actions to take given an observation of the environment (in this case, the current state of the IBP reduction process). The second method is using metaheuristics, e.g. simulated annealing, to minimize the computational cost as a black-box function of numerical priority values that control the orderings. For large-scale problems, the number of free parameters can be compressed by using a small neural network to assign priority values. Remarkably, both methods lead to IBP reduction schemes that are more efficient than human-designed algorithms. Introduction— Perturbative quantum field theory as a precision science requires the evaluation of Feynman integrals from multi-loop amplitudes and correlation functions, with many applications in e.g. collider physics, statistical mechanics, gravitational wave physics and cosmology. Integration-by-parts (IBP) reduction Chetyrkin and Tkachov 1981 is used in almost all nontrivial modern calculations except for those in highly symmetric special theories, and is frequently the most computationally demanding part of the calculations. IBP reduction is commonly carried out using the Laporta algorithm Laporta 2000 as implemented in publicly available computer programs Anastasiou and Lazopoulos 2004 ; Studerus 2010 ; Lee 2014 ; Smirnov 2008 ; Smirnov and Smirnov 2013 ; Smirnov 2015 ; Smirnov and Chukharev 2020 ; Smirnov and Zeng 2024 ; Maierhöfer et al. 2018 ; Maierhöfer and Usovitsch 2018 ; Klappert et al. 2021a . While there are many proposed alternative methods for IBP reduction, e.g. Refs. Lee 2012 ; Tarasov 2004 ; Gerdt and Robertz 2006 ; Smirnov and Smirnov 2006a ; Smirnov 2006 ; Smirnov and Smirnov 2006b ; Lee 2008 ; Barakat et al. 2023 ; Gluza et al. 2011 ; Schabinger 2012 ; Ita 2016 ; Larsen and Zhang 2016 ; Abreu et al. 2017 ; Abreu et al. 2018 ; Böhm et al. 2018 ; Bendle et al. 2020 ; Wu et al. 2024 ; Wu et al. 2025 ; Mastrolia and Mizera 2019 ; Frellesvig et al. 2021 ; Liu and Ma 2019 ; Guan et al. 2020 ; Kosower 2018 ; Feng et al. 2024 , the Laporta algorithm remains arguably the most widely-applied in practical calculations. While the Laporta algorithm traditionally required complicated manipulations of polynomials and rational functions in intermediate steps, the use of finite-field numerical techniques Kant 2014 ; von Manteuffel and Schabinger 2015 ; Peraro 2016 ; Abreu et al. 2019 ; Klappert and Lange 2020 ; Peraro 2019 ; Laurentis and Maître 2019 ; Klappert et al. 2021b ; De Laurentis and Page 2022 ; Magerya 2022 ; Belitsky et al. 2023 ; Chawdhry 2024 ; Liu 2024 ; Maier 2024 allows reconstructing complicated analytic results using a large number of numerical evaluations. With such a workflow, it is important to make each numerical IBP reduction run as fast as possible. Applications of the Laporta algorithm involve many heuristic choices that are based on experience rather than derived from first principles, and adjusting such choices can have a tremendous impact on the performance of IBP reduction. For example, there is a choice about whether Lorentz-invariance relations Gehrmann and Remiddi 2000 are included, and the selection of seed integrals and IBP operators can be optionally trimmed using Lie algebra relations Lee 2008 . Recently, several papers observed that widely used algorithms for selecting seed integrals can be improved to vastly reduce the number of IBP equations Driesse et al. 2024 ; Guan et al. 2025 ; Bern et al. 2024 . The goal of this letter is to present automated strategies for blind searches, with minimal human input, of IBP reduction schemes that outperform, and/or provide valuable feedback on, human-designed algorithms. Among recent interests in machine learning in perturbative scattering amplitudes Dersy et al. 2024 ; Jinno et al. 2023 ; Calisto et al. 2024 ; Cai et al. 2024 ; Cheung et al. 2025 , two papers von Hippel and Wilhelm 2025 ; Song et al. 2025 applied genetic algorithms and LLM-powered program searches to find optimal symbolic expressions controlling the various ordering choices in the Laporta algorithm. Our work takes several novel directions not explored in the previous literature. First, we initiate the study of reinforcement learning in the context of Feynman integrals, which breaks down the IBP reduction problem to a step-by-step decision process. Second, in parallel, we introduce metaheuristics for minimizing the cost function over numerical, rather than symbolic, priority values that control the orderings. This provides a complementary perspective and allows leveraging the vast body of available numerical optimization algorithms. Third, we go beyond the binary inclusion von Hippel and Wilhelm 2025 and ordering Song et al. 2025 of seed integrals, and take a fine-grained approach of ordering seed-operator pairs , which allows more aggressive optimizations, e.g. applying only a subset of IBP operators to a given seed integral Lee 2008 ; Smirnov and Smirnov 2013 . Finally, we use the number of arithmetic operations , tracked by our custom IBP reduction program, as a more accurate proxy of computational complexity than the number of seed integrals considered in previous papers. IBP reduction & simplified cost model— Consider the family of one-loop massive bubble integrals used as an introductory example in the book Weinzierl 2022 : I_{\nu_{1},\nu_{2}}=\int\frac{d^{D}k}{i\pi^{D/2}}\frac{1}{(-k^{2}+m^{2})^{\nu_{1}}[-(p-k)^{2}+m^{2}]^{\nu_{2}}}\,, (1) where the two propagators in Fig. 1 are raised to non-negative integer powers \nu_{1} and \nu_{2} . The integral vanishes in dimensional regularization if both indices are non-positive. When one index is non-positive, the integral is referred to as a tadpole integral , otherwise a genuine bubble integral. Figure 1 : One-loop massive bubble integrals. Integration-by-parts (IBP) equations arise as total derivatives integrate to zero in dimensional regularization: 0=\int\frac{d^{D}k}{i\pi^{D/2}}\frac{\partial}{\partial k^{\mu}}\frac{q^{\mu}}{(-k^{2}+m^{2})^{\nu_{1}}[-(p-k)^{2}+m^{2}]^{\nu_{2}}}\,, (2) where q^{\mu} is any Lorentz vector. With a slight abuse of notation, we refer to the above IBP equation as the outcome of applying the IBP operator , (\partial/\partial k^{\mu})q^{\mu} , to the seed integral , I_{\nu_{1},\nu_{2}} . Specifically, we have • IBP operator 1: (\partial/\partial k^{\mu})k^{\mu} . • IBP operator 2: (\partial/\partial k^{\mu})p^{\mu} . We only study IBP relations and disregard symmetry relations I_{\nu_{1},\nu_{2}}=I_{\nu_{2},\nu_{1}} for simplicity. It turns out that all I_{\nu_{1},\nu_{2}} can be reduced to three master integrals , I_{1,1},\,I_{1,0},\,I_{0,1} . Now we walk through an application of the Laporta algorithm to reduce the target integral I_{1,2} to the three master integrals at numerical values of dimension and kinematic variables, p^{2}=1,\quad m^{2}=2,\quad D=5/7\,, (3) which allows us to illustrate a simple cost model based on the number of arithmetic operations. The numerical values are unimportant, since the number of arithmetic operations is usually the same at different numerical values as long as