Advancing ATLAS DCS Data Analysis with a Modern Data Platform
\firstname Luca \lastname Canali \fnsep, \firstname Andrea \lastname Formica \fnsep, \firstname Michelle Ann \lastname Solis \fnsep · 2025
Read Advancing ATLAS DCS Data Analysis with a Modern Data Platform by \firstname Luca \lastname Canali \fnsep, \firstname Andrea \lastname Formica \fnsep, \firstname Michelle Ann \lastname Solis \fnsep (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13543.txt.
Introduction
Luca Canali and co-authors describe a modern data platform for the ATLAS particle detector at CERN, in a 2025 paper. ATLAS logs a flood of control data on how its parts run. That data sits in a database built for quick single lookups, not for broad scans across years and thousands of devices. Experts who hunt faults need the broad view.
The new pipeline moves the data onto Apache Spark and CERN's Hadoop service. It links to the SWAN notebook hub, so experts can explore the data in Python with standard tools. The setup scales to long spans and many devices at once. The team proved it on a real fault hunt for data links in the New Small Wheel detector. They argue such platforms let experts find and fix faults far faster.
Catalog record
| CREATOR | \firstname Luca \lastname Canali \fnsep, \firstname Andrea \lastname Formica \fnsep, \firstname Michelle Ann \lastname Solis \fnsep |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-13543
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Advancing ATLAS DCS Data Analysis with a Modern Data Platform \firstname Luca \lastname Canali \fnsep, \firstname Andrea \lastname Formica \fnsep, \firstname Michelle Ann \lastname Solis \fnsep Abstract This paper presents a modern and scalable framework for analyzing Detector Control System (DCS) data from the ATLAS experiment at CERN. The DCS data, stored in an Oracle database via the WinCC OA system, is optimized for transactional operations, posing challenges for large-scale analysis across extensive time periods and devices. To address these limitations, we developed a data pipeline using Apache Spark, CERN’s Hadoop service, and the CERN SWAN platform. This framework integrates seamlessly with Python notebooks, providing an accessible and efficient environment for data analysis using industry-standard tools. The approach has proven effective in troubleshooting Data Acquisition (DAQ) links for the ATLAS New Small Wheel (NSW) detector, demonstrating the value of modern data platforms in enabling detector experts to quickly identify and resolve critical issues. 1 Introduction The ATLAS Detector Control System (DCS) atlas_dcs provides critical information on the detector’s availability and performance. Traditionally, these data support online monitoring and troubleshooting, but are rarely used for large-scale analysis due to constraints in data storage and processing. By enabling DCS data to be analyzed alongside other conditions data, this work opens the door to new insights into detector behavior and performance. Key objectives of this work include: • Exploring insights through large-scale analysis of DCS data. • Correlating DCS data with conditions and other datasets for advanced troubleshooting. • Utilizing a modern, scalable analysis platform with Python APIs and pre-configured tools. • Showing an example of how the platform has been used by a real-life case of troubleshooting Data Acquisition (DAQ) links for the ATLAS New Small Wheel (NSW) detector. 2 Data Storage, Pipeline and Analysis Framework DCS data, primarily consisting of time-series measurements, are archived in Oracle databases using the WinCC OA system winccoa . Each detector’s data are organized within a dedicated database schema, which structures and manages all relevant tables. The EVENTHISTORY table serves as the central repository, storing sensor IDs, timestamps, and measurement values, with new entries added continuously. This table can exceed 10^{9} rows annually, requiring efficient storage and retrieval strategies. To address this challenge, range partitioning is implemented, dividing the table into smaller, manageable segments based on predefined intervals, such as monthly partitions, to enhance data access and maintenance. The data import process is implemented as scheduled Apache Spark ApacheSpark jobs, which read data from the source Oracle database and write it into the Hadoop platform ApacheHadoop as Parquet files. Data are extracted from ATONR_ADG , the read-only replica of the main production database, ATONR . This approach, also used for accessing conditions data oracle_conditions , ensures that the primary database remains unaffected. The Spark JDBC (Java Database Connectivity) datasource, configured with the Oracle JDBC driver, is used for data transfer. Jobs are scheduled to run daily, with incremental updates performed for the EVENTHISTORY table to maintain synchronization without reprocessing the entire dataset. Smaller and less dynamic tables are fully overwritten during each update cycle, simplifying maintenance and reducing complexity. Data are partitioned by day, with each partition stored as a separate Parquet file. This chronological organization improves storage efficiency and allows for faster query performance by enabling partition pruning during analysis. The import process is repeated for each detector. Currently, 3~\mathrm{TB} of DCS data have been imported into the Hadoop ecosystem. This represents approximately 30\% of the data available in the Oracle database, covering only records from 2022 onward. This limited scope underscores the significant potential for expansion to include historical datasets. Furthermore, extending the framework to incorporate additional detectors, as required by the ATLAS community, would further enhance its utility and impact. 2.1 Big Data Platform This project leverages CERN IT services and open-source software to deliver advanced features and high performance while minimizing costs. Figure 1 illustrates the components of the Data Platform. CERN’s Hadoop cluster, Analytix analytix2019 , is a scalable, robust infrastructure with 1400 physical cores and 20 PB of distributed storage, supporting data-intensive projects across CERN. Figure 1: Overview of the Big Data architecture for Detector Control System (DCS) data analysis. The system integrates data from Oracle databases (including DCS, luminosity, and run information) and file-based metadata and mappings into the Hadoop ecosystem using Parquet files. Apache Spark serves as the core processing engine, enabling scalable analysis within an interactive environment powered by Jupyter notebooks on CERN SWAN. Apache Hadoop provides a robust distributed computing environment designed for managing large datasets with exceptional reliability and fault tolerance. Its core components, YARN (Yet Another Resource Negotiator) and HDFS (Hadoop Distributed File System), work seamlessly together: YARN dynamically allocates computational resources to enable scalable, concurrent, and high-throughput data processing, while HDFS ensures data durability and fault tolerance by partitioning data into blocks and replicating them across multiple nodes. Together, these components deliver the resource management and storage reliability essential for scaling the analysis of DCS data. Apache Spark serves as the platform’s primary processing engine. Its capability to distribute workloads across the cluster and utilize multiple distributed workers makes it ideal for handling large volumes of data, delivering high performance, scalability, and fault tolerance. Spark’s DataFrame and Spark SQL APIs offer a high-level interface for data manipulation and analysis, streamlining complex workflows. The DataFrame API provides functionality similar to Pandas DataFrames Pandas , a popular Python library, while Spark SQL uses SQL, a universal language for querying and managing data across databases and platforms. These APIs are designed to be interchangeable and can be seamlessly combined within Spark, providing exceptional flexibility for querying and processing data. Notably, Spark’s Python API, PySpark, enhances accessibility for the physics and data science communities, where Python is a dominant language. For data storage in the Hadoop ecosystem, we utilize Apache Parquet ApacheParquet , a modern columnar storage format optimized for analytical workloads. Parquet accelerates data retrieval by enabling selective field access without scanning entire rows, which is ideal for analytical operations. It also offers efficient data compression, reducing storage requirements, and supports predicate pushdown, a feature that filters data at the storage level based on query conditions, reducing the amount of data read and significantly improving query performance. To support time-based analyses, Parquet files are range-partitioned by timestamps, with daily partitions employed to achieve finer access granularity. This partitioning strategy not only organizes the data logically for efficient retrieval but also enables partition pruning, allowing queries to automatically skip irrelevant partitions based on filter conditions. By minimizing the volume of data scanned during queries, this approach significantly improves query performance, resulting in faster response times and more efficient resource utilization. By combining Parquet’s compatibility with Spark tools and Python-based workflows, this infrastructure provides a scalable, efficient, and user-friendly environment for offloading, storing, and analyzing Detector Control System (DCS) data at CERN. 2.2 Analysis Framework The front-end analysis is performed using Jupyter notebooks, providing an interactive and flexible environment for data exploration and processing. These notebooks integrate seamlessly with Spark, Pandas, and other Python libraries, enabling DCS experts to utilize the data analysis framework efficiently. Key capabilities include: • Querying and processing billions of rows within seconds, utilizing Spark’s distributed computation capabilities. • Performing advanced operations, such as