eLog analysis for accelerators: status and future outlook

A. Sulc, T. Hellert, ALS, Berkeley Lab, Berkeley, USA T. Britton, A. Carpenter, D. Lawrence, D. Lersch, D. McSpadden, C. Tennant, Thomas Jefferson National Accelerator Facility, Newport News, USA D. Ratner, A. Reed, C. Bisegni, A. Bien, SLAC National Accelerator Laboratory, USA H. Hoschouer, J. St. · 2025

Read eLog analysis for accelerators: status and future outlook by A. Sulc, T. Hellert, ALS, Berkeley Lab, Berkeley, USA T. Britton, A. Carpenter, D. Lawrence, D. Lersch, D. McSpadden, C. Tennant, Thomas Jefferson National Accelerator Facility, Newport News, USA D. Ratner, A. Reed, C. Bisegni, A. Bien, SLAC National Accelerator Laboratory, USA H. Hoschouer, J. St. (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-12949.txt.

Introduction

Antonin Sulc and co-authors present a 2025 paper on electronic logbooks for particle accelerators. Operators at large facilities log events and faults in these books day by day. Modern AI search could make that record far more useful. The study covers work at four United States laboratories, from Fermilab to SLAC. It tests tools that pair search with language model answers.

The team weighs how such tools fit with existing control systems. Uses, limits, and open problems are drawn from real deployments. A framework is offered for better access to operational knowledge. Better access could make daily operations more efficient. The paper is a status report with a look ahead, rather than a single experiment.

Catalog record

CREATORA. Sulc, T. Hellert, ALS, Berkeley Lab, Berkeley, USA T. Britton, A. Carpenter, D. Lawrence, D. Lersch, D. McSpadden, C. Tennant, Thomas Jefferson National Accelerator Facility, Newport News, USA D. Ratner, A. Reed, C. Bisegni, A. Bien, SLAC National Accelerator Laboratory, USA H. Hoschouer, J. St.
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE14 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-12949

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

eLog analysis for accelerators: status and future outlook A. Sulc, T. Hellert, ALS, Berkeley Lab, Berkeley, USA T. Britton, A. Carpenter, D. Lawrence, D. Lersch, D. McSpadden, C. Tennant, Thomas Jefferson National Accelerator Facility, Newport News, USA D. Ratner, A. Reed, C. Bisegni, A. Bien, SLAC National Accelerator Laboratory, USA H. Hoschouer, J. St. John, Fermi National Accelerator Laboratory, USA Abstract This work demonstrates electronic logbook (eLog) systems leveraging modern AI-driven information retrieval capabilities at the accelerator facilities of Fermilab, Jefferson Lab, Lawrence Berkeley National Laboratory (LBNL), SLAC National Accelerator Laboratory. We evaluate contemporary tools and methodologies for information retrieval with Retrieval Augmented Generation (RAGs), focusing on operational insights and integration with existing accelerator control systems. The study addresses challenges and proposes solutions for state-of-the-art eLog analysis through practical implementations, demonstrating applications and limitations. We present a framework for enhancing accelerator facility operations through improved information accessibility and knowledge management, which could potentially lead to more efficient operations. 1 Introduction eLogs are essential for documenting accelerator operations, capturing everything from routine maintenance to complex beam studies. However, the volume of these records—spanning decades, multiple facilities, and varying formats makes retrieving relevant information difficult. This paper shows the current status of AI-driven solutions implemented at four accelerator facilities (Fermilab, Jefferson Lab, LBNL, and SLAC). 2 Related Work In the development of eLogs for accelerators and tokamaks, there are three notable works. First, Mayet [ mayet2024gaia ] implemented a multi-expert RAG system that combines LLMs with particle accelerator control systems and documentation tools using ReAct prompting [ yao2023react ] , enabling operators to retrieve expert knowledge, interact directly with the machine, and generate control scripts to simplify accelerator operations. Second, Metha et al. [ mehta2023towards ] a RAG system that leverages operator text logs from tokamak fusion experiments (DIII-D and Alcator C-Mod) to create an AI copilot that demonstrates superior performance over baseline methods in semantic search and device-specific operations assistance. Lastly, Maldonado et al. [ maldonado23enhancing ] used OCR to use often present images in the BNL logbook entries and used them to augment the existing entries. Recently, Sulc et al. [ sulc2024towards ] surveyed the eLog activities. 3 Current status 3.1 Advanced Light Source The ALS at LBNL utilizes an logbook system integrated as an Model Context Protocol (MCP) client within its accelerator control infrastructure, see Fig. 1 . The ALS eLog system is integrated as an MPC client that embeds RAG as a functional component within the broader control framework. Information retrieval is performed using a fused approach combining all-MiniLM-L6-v2 text embeddings and BM25 keyword search scores, indexed and queried through a Qdrant vector database. Since embedding and keyword search use different scaling, we used reciprocal rank. While recognizing the potential of superior embedding models, the current system relies on all-MiniLM-L6-v2 , with plans underway to integrate a custom-finetuned AccPhysBERT model. Figure 1: Screenshot of the currently developed system built on OpenWebUI [ openwebui2024 ] interface. After an initial high-recall search using fast vector embeddings (which only requires embedding the input query and performing matrix multiplication), we apply a re-ranking step to improve precision. While re-ranking is computationally more expensive by requiring embeddings of all filtered entries, it delivers entries with better accuracy on already prefiltered entries and refines the search. This stage employs the cross-encoder/ms-marco-MiniLM-L-2-v2 model for efficient filtering, discarding entries below an experimentally determined score threshold (currently >0). The filtered, relevant entries are then processed by an LLM for summary generation. Operational experience and feedback from ALS personnel suggest that near-term improvements in retrieval accuracy are prioritized for enhanced utility, as the summarization capabilities, especially with smaller language models, currently exhibit limitations related to hallucinated content. 3.2 Fermilab Since 2013, Fermilab has relied on ADEL (Accelerator Division Electronic Logbook) to capture all aspects of accelerator operations. ADEL is used to document machine failures, repairs,tuning, beam studies, as well as work planning and safety approvals [ hazelwood_wao_2023 ] . It’s comprehensive collection of operations activities makes ADEL a valuable resource for troubleshooting, allowing operators to reference past issues, resolutions, and patterns across the accelerator complex. 3.2.1 ADEL Smart Search To improve how operators retrieve past entries, a semantic search tool—Smart Search—has been deployed in the Fermilab AD Main Control Room. Hosted on the AD Kubernetes cluster, Smart Search enables two modes of retrieval: written queries and a recommendation system that finds similar notes based on an existing logbook entry. Each ADEL entry is converted into a 768-dimensional vector using the SBERT model all-mpnet-base-v2 [ reimers-2019-sentence-bert ] , then stored in a Qdrant vector database [ Qdrant ] . Qdrant also stores metadata alongside each vector—such as creation date, machine type, and subsystem category (e.g. Linac, RF, Tuning)—enabling precise filtering. Smart Search builds on Qdrant’s native recommendation support, which allows the use of both positive (similar) and negative (dissimilar) examples to refine search results. Whether using a query or a reference entry, the system retrieves semantically similar entries based on vector similarity. With filters applied, operators can quickly isolate related incidents or resolutions tied to specific systems without relying on exact phrasing or manual guesswork. 3.2.2 Entry Augmentation Fermilab operates several accelerators that share similar subsystem labels. For example, both the Booster and Linac have RF and Water systems. While domain experts can easily distinguish between these based on context, embedding models often struggle to make such distinctions without additional guidance. To address this limitation, each logbook entry was augmented with contextual metadata prior to vectorization. This metadata—such as machine and subsystem labels—is manually assigned by the user at the time of entry creation. During preprocessing, this information was added to the beginning of each entry in an NLP-compatible format. For example, an entry tagged as originating from the Booster and involving RF would include statements such as “This is related to Booster” and “This involves RF.” This augmentation improved semantic clustering and led to more accurate retrieval of relevant entries, particularly in cases where the original text did not explicitly state the associated machine or subsystem. 3.2.3 Adaptive Thresholding for Retrieval While semantic search is effective for static knowledge bases, applying it to a logbook presents a unique challenge: logbooks are collections of time-stamped operational events. An entry may be semantically similar to a user’s query—for example, a note on tuning Linac—but if it was recorded six years ago, its practical relevance may be limited. In this context, temporal proximity can be just as important as textual similarity. To address this, the number of retrieved entries was set deliberately high during the initial search phase. An adaptive similarity threshold was then applied to exclude low-relevance results while preserving a broad set of meaningful matches. This threshold was determined by analyzing the distribution of similarity scores and applying heuristics to identify a natural cutoff point. This allowed the remaining entries to be sorted by time of entry creation without semantically weak or unrelated entries disrupting the ranking. As a result, operators could more effectively prioritize recent, contextually relevant notes without compromising retrieval quality. 3.3 Jefferson Lab Jefferson Lab is pursuing several complementary research directions to integrate LLMs with the Continuous Electron Accelerator Facility (CEBAF) logbook, each addressing a distinct challenge in turning years of operational records into an AI-ready

Read the complete text