First Experimental Demonstration of Machine Learning-Based Tuning on the PSI Injector 2 Cyclotron
M. Haj Tahar, W. Joho, E. Solodko, M. Bocchio, S. Marquie, M. Busch, A. Barchetti, J. Grillenberger, J. Snuverink, M. Schneider · 2025
Read First Experimental Demonstration of Machine Learning-Based Tuning on the PSI Injector 2 Cyclotron by M. Haj Tahar, W. Joho, E. Solodko, M. Bocchio, S. Marquie, M. Busch, A. Barchetti, J. Grillenberger, J. Snuverink, M. Schneider (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03829.txt.
Introduction
High-power proton cyclotrons feed applications such as accelerator driven systems, but tuning their beams by hand is slow and rarely optimal. M. Haj Tahar and a large team at the Paul Scherrer Institute report a first in a 2025 accelerator physics preprint. They deployed a reinforcement learning system to tune the Injector 2 cyclotron, a testbed for high-power operation.
Their framework pairs a tailored learning algorithm with live diagnostics and control. One physics-inspired trick, an overshoot strategy, cut magnetic field settling times nearly sixfold. Across a twelve-day campaign, the agent learned stable tuning policies within hours for each operating point, then ran overnight evaluations with low beam losses. Policies trained at low current still worked at far higher currents. The authors call it the first such demonstration on a high-power cyclotron, with lessons for future driver machines.
Catalog record
| CREATOR | M. Haj Tahar, W. Joho, E. Solodko, M. Bocchio, S. Marquie, M. Busch, A. Barchetti, J. Grillenberger, J. Snuverink, M. Schneider |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-03829
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
First Experimental Demonstration of Machine Learning-Based Tuning on the PSI Injector 2 Cyclotron Preprint: APS/123-QED M. Haj Tahar, W. Joho, E. Solodko, M. Bocchio, S. Marquie, M. Busch, A. Barchetti, J. Grillenberger, J. Snuverink, M. Schneider Abstract Reliable operation of high-power proton cyclotrons is a critical requirement for Accelerator Driven Systems (ADS) and other large-scale applications. Beam tuning in such machines is traditionally performed manually, a process that can be slow, non-optimal, and difficult to execute in the presence of faults or changing conditions. To address this, we developed and deployed a machine learning (ML) based tuning framework on the Injector 2 cyclotron at PSI, chosen as an ideal testbed for high-power operation. The system combined a tailored reinforcement learning algorithm with real-time diagnostics and control, and incorporated accelerator-physics inspired adaptations such as an overshoot strategy that reduced magnetic field settling times by nearly a factor of six. Over an extensive 12-day operational test campaign, relatively long in the context of real-time ML experiments, the ML agent successfully tuned the machine across multiple operating points, achieving convergence within hours and maintaining stable beam extraction with reduced losses. Beyond initial tuning, the system was also operated in evaluation mode overnight, where it autonomously monitored and corrected the machine to compensate for drifts, demonstrating robustness and long-term stability. Crucially, the learned policy generalized reliably from low-current training to higher-current operation, underscoring its scalability. These results constitute the first demonstration of ML-assisted tuning on a high-power cyclotron, with direct relevance to ADS-class drivers. pacs Valid PACS appear here I Introduction The High Intensity Proton Accelerator (HIPA) complex at the Paul Scherrer Institut (PSI) has been in operation since 1974, and today delivers the most intense continuous-wave proton beam worldwide, with an average power of 1.42 MW produced by a two-stage cyclotron system 8 . In the first stage, Injector 2 accelerates protons from 0.87 MeV, provided by a Cockcroft–Walton DC linear accelerator, up to 72 MeV. The second stage, the 590 MeV ring cyclotron, then boosts the beam to its final energy, with a maximum average current of 2.4 mA. After extraction, which is achieved with efficiencies exceeding 99.98%, the beam is transported to multiple target stations for meson and neutron production 12 , enabling world-class programs in particle, nuclear, and materials science. Cyclotron-based proton drivers, as demonstrated at PSI, are a well-proven technology, combining compactness with high energy efficiency. These qualities make them particularly attractive for future large-scale applications such as Accelerator Driven Systems (ADS) 14 ; 1 . Within this context, Transmutex SA is developing an ADS concept aimed at generating clean energy while simultaneously reducing the long-term radiotoxicity of nuclear waste. The architectural similarities between the HIPA cyclotrons and the envisioned ADS driver make PSI’s Injector 2 an ideal testbed to investigate the control strategies and automation capabilities required for such systems. Looking beyond current applications, ADS place uniquely stringent requirements on the reliability of high-power proton drivers. Target applications in nuclear waste transmutation or energy generation demand continuous operation with failure rates two orders of magnitude lower than those achieved today. To reach such performance, not only must the hardware of cyclotrons be robust, but new operational strategies must be developed to rapidly compensate for inevitable component failures. At PSI, proof-of-principle experiments have already demonstrated that, in the event of a cavity failure in the 590 MeV ring cyclotron, beam delivery can be recovered within minutes by retuning the remaining cavities 9 . While this demonstrates feasibility, a recovery on the order of minutes falls short of the requirement for ADS-class facilities, where fault compensation must occur within only a few seconds. These results highlight the feasibility of fault compensation but also reveal a critical bottleneck: the lack of reliable, automated tuning tools capable of acting on the time scales demanded by ADS-class facilities. Machine Learning (ML) has emerged as a promising candidate to address this challenge 6 . By leveraging data-driven models and adaptive optimization, ML offers the potential to automate cyclotron tuning, compensate for drifts, and adapt to changing operational conditions in real time. While ML approaches have been explored in linear accelerators and light sources, their application to high-power cyclotrons remains largely unexplored 5 ; 16 ; 2 ; 10 . To fill this gap, PSI Injector 2 was chosen as an experimental testbed, combining the complexity of a high-power machine with the flexibility needed for R&D. The present work reports on the first experimental demonstration of ML-assisted tuning on Injector 2. A tailored Reinforcement Learning (RL) framework was integrated with real-time diagnostics and control of the machine, enabling the agent not only to converge on optimal settings within hours but also to maintain stable operation during overnight evaluation runs by autonomously compensating drifts. This effort was carried out over an extensive 12-day experimental campaign, which is remarkably long in the context of real-time ML control studies. The results of this campaign provide an essential step towards establishing ML-based control as a reliable tool for fault compensation and robust operation in ADS-class drivers. To move beyond proof-of-concept and towards reliable deployment, the Injector 2 campaign was carefully crafted to address a set of fundamental questions. At the technical level, these include identifying which actuators and diagnostics provide the greatest leverage for beam stabilization, how the machine should be initialized before handing control to an ML agent, and what forms of surrogate modeling or pretraining are most effective in accelerating convergence. At the methodological level, the campaign explored how quickly an RL policy can converge in a real cyclotron, whether a model trained at low current generalizes to higher-intensity operation, how frequently retraining is required to counteract drifts, and to what extent transfer learning across turn numbers can reduce setup time. At the heart of this effort lies the central question: can a cyclotron be operated reliably with limited human intervention, using ML-based control strategies that meet the stringent demands of ADS-class drivers? The remainder of this paper is organized as follows. Section II describes the Injector 2 cyclotron and its diagnostics, together with the control framework used for the experiments. Section III presents an analysis of historical data and feature engineering choices that informed the ML environment design. Section IV outlines the overall tuning strategy and campaign design. In Section V, the turn- and current-dependent beam dynamics are characterized using radial probe and Jacobian measurements, providing the physics context for the tuning challenge. Section VI discusses the adaptations required to integrate accelerator physics constraints into the ML framework, including the overshoot strategy and reward shaping; in particular, the overshoot strategy was found to accelerate the tuning process by nearly a factor of six. Section VII details the RL methodology employed, while Section VIII reports the experimental results, covering low-current training, overnight evaluation, and generalization to higher beam currents. Section IX presents the conclusions and outlines the roadmap toward scaling the demonstrated methodology to the HIPA complex and future ADS-class accelerator drivers. II Experimental Setup Injector 2 is a four-sector separated-sector cyclotron designed to accelerate protons from an injection energy of 870 keV to a final energy of 72 MeV 18 ; 17 . Its principal components include four large sector magnets (SM1–SM4), two double-gap RF resonators