Reinforcement Learning techniques for the flavor problem in particle physics

A. Giarnetti · 2025

Read Reinforcement Learning techniques for the flavor problem in particle physics by A. Giarnetti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25495.txt.

Introduction

A Giarnetti and D Meloni review reinforcement learning for particle physics. Their 2025 short review discusses the flavor problem. That problem concerns fermion masses and mixing patterns. Classic methods extend the Standard Model with symmetries. The landscape of possible models is vast, however.

Systematic exploration of that landscape is infeasible manually. Reinforcement learning can navigate model spaces quickly, they note. Recent works construct models reproducing observed observables. Quark and lepton data are the targets there. Learning methods rediscover models already proposed in literature. They also uncover new phenomenologically acceptable answers. That dual result validates the method strongly. Automated search may accelerate flavor model building. Particle physicists face many candidate symmetries and charges. Reinforcement learning agents can test combinations rapidly. The review summarizes recent uses and their promise. It is brief, aimed at scholars entering the area.

Catalog record

CREATORA. Giarnetti
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-25495

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reinforcement Learning techniques for the flavor problem in particle physics A. Giarnetti Abstract Abstract This short review discusses recent applications of Reinforcement Learning (RL) techniques to the flavor problem in particle physics. Traditional approaches to fermion masses and mixing often rely on extensions of the Standard Model based on horizontal symmetries, but the vast landscape of possible models makes systematic exploration infeasible. Recent works have shown that RL can efficiently navigate this landscape by constructing models that reproduce observed quark and lepton observables. These approaches demonstrate that RL not only rediscovers models already proposed in the literature but also uncovers new, phenomenologically acceptable solutions. 1 Introduction The flavor problem in particle physics has been a central focus of study since the inception of the Standard Model (SM). Many attempts to explain fermion masses and mixing involve SM extensions based on horizontal symmetries, who are responsible of making the entries of the mass matrices related in a non trivial way instead of being free parameters. A common feature of all these models is the assignment of particles to irreducible representation of the flavor group (the case of non-abelian simmetries), the assignment of a U(1) charge to particles (models á la Froggatt-Nielsen [ 1 ] ) or a combination of both. The space of all possibilities is usually immense, spanning \sim 10^{n} different models, with n a large integer of \mathcal{O}(10) . It is clear that the success of an SM extension strongly relies on the ability to select a realization that fits the low energy data; while human searches have lead to a good success, it is not sure whether the discovered solutions are the minimal ones in terms of new degrees of freedom or the best ones according to other selection criteria like, for instance, the absence of huge hierarchies on the model parameters or a strong fine-tuning. The vastness of the parameters space in many fields of particle physics is one of the reason why, in very recent years, Machine Learning (ML) techniques started to be applied to several problems in Physics. Entering into the details of all attempts performed using ML techniques in Physics is a formidable task, as in many areas a long list of papers exist and revising them is well beyond the scope of this short review. In the restricted domain of theoretical physics, the subject is currently very active, covering a wide range of topics ranging (among others) from string theory [ 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 ] to QCD [ 36 , 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 ] , not to mention statistical mechanics [ 63 , 64 , 65 , 66 , 67 , 68 , 69 , 70 , 71 , 72 , 73 , 74 , 75 , 76 , 77 , 78 , 79 , 80 , 81 , 82 , 83 , 84 , 85 , 86 , 87 , 88 , 89 , 90 ] , thermodynamics [ 91 , 92 , 93 , 94 , 95 ] , the foundation of quantum mechanics [ 96 , 97 , 98 , 99 , 100 , 101 , 102 , 103 , 104 ] and cosmology [ 105 , 106 , 107 , 108 , 109 , 110 , 111 , 112 , 113 , 114 , 115 , 116 , 117 , 118 , 119 , 120 , 121 ] . In this short review, we focus more strictly on ML in particle physics [ 122 , 123 , 124 , 125 , 126 ] , with the intent of exploring Beyond the Standard Model theories [ 127 , 128 , 129 ] and, in particular, the (a few, so far) efforts that have been done to implement AI agents in the study of the flavor problem. The subject is relatively young so, at least in principle, there exists a large probability that more can be said and done in the near future. This review would help in setting the state of the art on the attempts accomplished using the Reinforcement Learning (RL) technique [ 130 ] to find promising quark [ 131 ] and lepton [ 132 , 133 ] textures 3 3 3 A study based on the Diffusion Model (DF) has been carried out for leptons [ 134 ] . addressing, at the same time, the quest for an axion candidate. The main features of RL are described in Sect.( 2 ), and its interesting results for model building are analysed in sect.( 3 ). Sect.( 4 ) is devoted to our conclusions. 2 Reinforcement Learning Reinforcement Learning [ 130 ] is a subfield of Machine Learning that focuses on how an agent learns to make optimal decisions by interacting with an environment to maximize a cumulative reward over time. Unlike supervised learning, where a model is trained on a dataset of labeled input-output pairs, or unsupervised learning, which seeks patterns in unlabeled data, RL operates in a trial-and-error framework. The agent learns by taking actions, observing their consequences, and receiving feedback in the form of rewards or penalties. This feedback loop allows the agent to gradually refine its decision-making strategy without being explicitly told what the “correct” action is. RL draws inspiration from behavioral psychology , particularly the concept of operant conditioning, where behaviors are shaped by rewards and punishments. This paradigm is well-suited for problems where the optimal course of action is not immediately clear, and the agent must explore its environment to discover effective strategies. RL is often formalized using Markov Decision Processes (MDPs) , which provide a mathematical framework to model sequential decision-making under uncertainty. In RL, the agent observes the current state of the environment, selects an action , and receives a reward along with the next state, iteratively learning a policy —a strategy that maps states to actions—to maximize the expected sum of future rewards. 2.1 Common features Although many variants of RL exixt, we can identify some common features; these components are essential for understanding how RL systems operate: • Agent : the entity responsible for making decisions and learning from experience. The agent could be a robot, a software program, or any system capable of taking actions in an environment; • Environment : the external system with which the agent interacts. The environment includes everything outside the agent, such as a physical space, a game board, or a simulated market. It responds to the agent’s actions by providing new states and rewards; • State ( s\in\mathcal{S} ): a representation of the current situation or configuration of the environment

Read the complete text