The LHCb Stripping Project: Sustainable Legacy Data Processing for High-Energy Physics

Nathan Allen Grieser, Eduardo Rodrigues, Niladri Sahoo, Shuqi Sheng, Nicole Skidmore, Mark Smith · 2025

Read The LHCb Stripping Project: Sustainable Legacy Data Processing for High-Energy Physics by Nathan Allen Grieser, Eduardo Rodrigues, Niladri Sahoo, Shuqi Sheng, Nicole Skidmore, Mark Smith (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-05294.txt.

Introduction

Keeping old particle physics data usable for decades is the job described by Nathan Grieser and five co-authors in a 2025 paper on the LHCb Stripping project. Stripping cuts the huge collision data from the Large Hadron Collider down to samples that analysts can actually work with.

The paper covers the project's Python-based setup, its links to LHCb computing systems, and how large reprocessing campaigns are run for the first two data-taking runs. Workflow tools, automated testing, and parallel processing have modernised the work. The authors also report organisational lessons and a road map. The aim is lasting, efficient access to legacy data sets that still hold physics value.

Catalog record

CREATORNathan Allen Grieser, Eduardo Rodrigues, Niladri Sahoo, Shuqi Sheng, Nicole Skidmore, Mark Smith
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-05294

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The LHCb Stripping Project: Sustainable Legacy Data Processing for High-Energy Physics Nathan Allen Grieser, Eduardo Rodrigues, Niladri Sahoo, Shuqi Sheng, Nicole Skidmore, Mark Smith Abstract The LHCb Stripping project is a pivotal component of the experiment’s data processing framework, designed to refine vast volumes of collision data into manageable samples for offline analysis. It ensures the re-analysis of Runs 1 and 2 legacy data, maintains the software stack, and executes (re-)Stripping campaigns. As the focus shifts toward newer data sets, the project continues to optimize infrastructure for both legacy and live data processing. This paper provides a comprehensive overview of the Stripping framework, detailing its Python-configurable architecture, integration with LHCb computing systems, and large-scale campaign management. We highlight organizational advancements such as GitLab-based workflows, continuous integration, automation, and parallelized processing, alongside computational challenges. Finally, we discuss lessons learned and outline a future road-map to sustain efficient access to valuable physics legacy data sets for the LHCb collaboration. keywords High-energy-physics, LHCb experiment, Data Processing and Offline Analysis 1 Introduction The LHCb Stripping project Stripping_Git plays a vital role in filtering the experiment’s data, serving as the last central offline processing step where physicists select interesting particle interactions from billions of recorded events. Its flexible Python interface allows researchers to customize selection criteria for different physics studies. Integrated into the LHCb Data Processing & Analysis (DPA) Abdelmotteleb et al. 2025 framework since 2020, the Stripping project is a central pillar of DPA’s Work Package 5 (WP5) Skidmore et al. 2022 , which focuses on legacy software and data. WP5 ensures that legacy data collected at CERN’s Large Hadron Collider (LHC) Evans and Bryant 2008 ; Brüning et al. 2004 during Runs 1 (2010-2012) and 2 (2015-2018) remain accessible for future re-analysis by maintaining the legacy software stack and organizing necessary (re-)Stripping campaigns. These campaigns, which ran concurrently with data-taking or during End-of-Year (EoY) periods, involve skimming and slimming data to extract the most relevant information for physics analysis. The Stripping project is designed to streamline the raw data into a manageable subset for offline analysis that maximize signal retention while minimizing background. Its Python-configurable architecture allows for flexible and user-oriented data selection, while modern organizational tools, such as GitLab Milestones, are employed to track developments and ensure timely completion of tasks. 2 LHCb Dataflow and Stripping Software Framework The LHCb data processing model spans multiple stages, from initial triggering to offline data selection. Stripping reduces the volume of recorded data by selecting events of interest and saving only the necessary information for physics analysis, producing smaller, more manageable data sets. The Stripping software stack Stripping_Git integrates closely with the DaVinci DV framework, which provides essential analysis tools. The LHC provides proton-proton collisions to the LHCb experiment at an interaction rate of 40 MHz, generating an enormous volume of data–approximately 1 TB every second in Run 2. Storing all this data is impractical due to cost constraints, necessitating a sophisticated filtering process to retain only the most interesting events as shown in Fig. 1 . This raises critical challenges: how to process and filter data quickly and accurately, manage complex tasks, organize collision data flexibly, and configure software without recompilation. These challenges stem from the high data arrival rate and the complexity of the data, which contains thousands of potential decay combinations of interest. To address these issues, the LHCb experiment employs a multi-step data processing chain. The Run 1+2 data flow begins with the trigger system, which filters events using hardware (Level-0, L0) and software (High Level Trigger, HLT) components Collaboration 2008 . The triggered data are then reconstructed by the Brunel application Brunel , transforming raw detector hits into tracks and particle identification information stored in DST (Data Summary Tape) 1 1 1 Files resulting from the reconstruction of real data and of MC samples, basically a ROOT file with our data in an optimized format files, allowing candidates selected by the HLT to be saved directly to disk. Further filtering is performed through the Stripping process, managed by the DaVinci application, which outputs data in DST or µDST (micro-DST) formats, grouped into physics-specific streams to optimize storage and analysis efficiency. Simulated data are processed through an identical reconstruction chain as real data, maintaining consistent treatment of detector effects and systematic uncertainties. The simulation begins with the Gauss Clemencic et al. 2011 application, which models proton-proton collisions and particle decays using generators like Pythia Sjöstrand et al. 2006 and EvtGen Lange 2001 , followed by Geant4 Agostinelli et al. 2003 for detector response simulation. The Boole Clemencic et al. 2011 application converts simulated hits into signals mimicking real detector output, allowing the simulated data to be processed through the same reconstruction and Stripping steps as data. The LHCb software is modular, with each application (e.g., Brunel , DaVinci ) handling specific tasks, enabling flexibility and efficiency in data processing. Stripping campaigns, identified by versions like SXrYpZ, are central to defining the available reconstructed decays for analysis. Major Stripping versions (X) represent full reprocessing and correspond to data set years. Minor versions (Y) correspond to superseding full reprocessings, while patch versions (Z) indicate incremental updates. Understanding the reconstruction and Stripping versions is crucial for selecting data, as these versions significantly impact the physics results. The Stripping project website provides detailed information on Stripping configurations, algorithms, and selection criteria, serving as essential resources for analysts. Figure 1: The LHCb dataflow in Run 2 CERN-LHCC-2018-007 2018 as described in Section 2 . The (re-)Stripping stage serves as the last centralized production stage before offline analysis workflows. The Stripping project is maintained across multiple Git production branches, each tailored to specific data-taking periods and campaign types. These branches are designed to support legacy data processing while incorporating necessary bug fixes and updates. New releases are prepared following the completion of development and validation phases, facilitated by an in-depth testing infrastructure. The LHCb Stripping software project is operating atop the primary analysis software, DaVinci , which is built on the Gaudi Barrand et al. 2001 and LHCb frameworks. The Stripping package, which defines all selection lines and their configurations, is part of a larger software stack, as shown in Fig. 2 , that includes dependencies such as Phys Phys , Rec Rec , LbCom Lbcom , and LHCb LHCb . This stack relies on CERN’s LCG software distribution LCG , with specific ROOT versions determined by the LCG release. Figure 2: Schematics of the legacy stack utilized for the LHCb offline data processing stage during Runs 1 and 2. The LHCb Stripping project performs the crucial first stage of offline data processing, transforming reconstructed collision data into manageable subsets for physics analysis. Using a Python-configurable architecture, it enables analysts to select specific physics candidates from the processed datasets, which are stored as 5 GB files on both disk and tape (with placement optimized for storage availability). When new physics selections are developed or existing ones require improved performance, the collaboration conducts systematic “(Re-)Stripping campaigns” – comprehensive reprocessing efforts that apply updated selection criteria to the full legacy datasets, ensuring consistent analysis selections across LHCb’s physics program. Stripping campaigns are large-scale efforts that involve collaboration-wide discussions, preparation of selection lines by analysts and Physics Working Groups (PWGs),

Read the complete text