Impact of Data Sparsity on Machine Learning for Fault Detection in Power System Protection

Julian Oelhaf 1 * , Georg Kordowich 2 , Changhun Kim 1 , Paula Andrea Pérez-Toro 1 , Andreas Maier 1 Johann Jäger 2 , Siming Bayer 1 · 2025

Read Impact of Data Sparsity on Machine Learning for Fault Detection in Power System Protection by Julian Oelhaf 1 * , Georg Kordowich 2 , Changhun Kim 1 , Paula Andrea Pérez-Toro 1 , Andreas Maier 1 Johann Jäger 2 , Siming Bayer 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15560.txt.

Introduction

Julian Oelhaf and six co-authors test how missing data affects machine learning for grid fault detection in a 2025 paper. Germany's shift to renewable power means decentralized generation that needs smart monitoring. Learning models can flag faults and locate the faulty line, but sensor failures and communication drops thin out their input data.

The team built a framework that simulates realistic data gaps and measures the damage. Fault detection proved tough: accuracy stayed near perfect even after a fifty fold data reduction. Locating the faulty line was fragile, dropping sharply when voltage readings went missing and notably when communication failed at key points. The findings tell engineers where to harden data collection for real world protection systems.

Catalog record

CREATORJulian Oelhaf 1 * , Georg Kordowich 2 , Changhun Kim 1 , Paula Andrea Pérez-Toro 1 , Andreas Maier 1 Johann Jäger 2 , Siming Bayer 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-15560

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Impact of Data Sparsity on Machine Learning for Fault Detection in Power System Protection Julian Oelhaf 1 * , Georg Kordowich 2 , Changhun Kim 1 , Paula Andrea Pérez-Toro 1 , Andreas Maier 1 Johann Jäger 2 , Siming Bayer 1 Abstract Germany’s transition to a renewable energy-based power system is reshaping grid operations, requiring advanced monitoring and control to manage decentralized generation. Machine learning (ML) has emerged as a powerful tool for power system protection, particularly for fault detection (FD) and fault line identification (FLI) in transmission grids. However, ML model reliability depends on data quality and availability. Data sparsity resulting from sensor failures, communication disruptions, or reduced sampling rates poses a challenge to ML-based FD and FLI. Yet, its impact has not been systematically validated prior to this work. In response, we propose a framework to assess the impact of data sparsity on ML-based FD and FLI performance. We simulate realistic data sparsity scenarios, evaluate their impact, derive quantitative insights, and demonstrate the effectiveness of this evaluation strategy by applying it to an existing ML-based framework. Results show the ML model remains robust for FD, maintaining an F1-score of 0.999 ± \pm 0.000 even after a 50x data reduction. In contrast, FLI is more sensitive, with performance decreasing by 55.61% for missing voltage measurements and 9.73% due to communication failures at critical network points. These findings offer actionable insights for optimizing ML models for real-world grid protection. This enables more efficient FD and supports targeted improvements in FLI. I Introduction Germany’s Energiewende , the transition to a renewable energy-based power system, is fundamentally reshaping electric grid operations. The growth of wind, solar, and hydroelectric generation, along with the increase in energy efficiency and demand-side management, presents new challenges for ensuring a secure, stable, and affordable electricity supply [ 1 ] . A key aspect of this transition is the expansion and modernization of the power transmission infrastructure, spanning thousands of kilometers, to enable the integration of fluctuating renewable energy while ensuring robust grid operations [ 2 ] . As the power system undergoes this transformation, the grid itself must evolve to accommodate decentralized energy sources, leading to dynamic and bidirectional power flows. Traditional grid control mechanisms, designed for centralized generation, are increasingly insufficient to manage the variability and distributed nature of renewable energy sources [ 3 ] . To address these challenges, digitalization has become an essential component of modern grid infrastructure, driving an unprecedented proliferation of data from a vast network of sensors and measurement devices. These data streams originate from pr and other monitoring systems, which transfer real-time information to centralized control centers for analysis and decision-making [ 4 ] . A key enabler of this transformation is the IEC 61850 communication standard [ 5 ] , which enables the integration of remote measurements from protection systems. By improving fault monitoring and enhancing grid resilience, IEC 61850 plays a crucial role in ensuring efficient and reliable power system operation [ 6 ] . However, as the volume and complexity of grid data continue to grow, traditional analytical approaches struggle to extract actionable insights in real-time. To address this challenge, ml ( ml ) models have emerged as a promising solution for fd ( fd ) [ 6 , 7 , 8 ] , fli ( fli ) [ 9 ] , and pc ( pc ) [ 10 ] , enabling more accurate and adaptive fault management while efficiently handling large-scale grid data. However, the performance of ml methods is highly dependent on the quality and availability of training data. An over-reliance on large datasets can introduce vulnerabilities, particularly when these datasets do not adequately reflect real-world data sparsity caused by sensor failures, communication interruptions, and hardware limitations. Such sparsity can compromise ml -based fd and fli systems, potentially leading to delayed or incorrect protection actions. To systematically assess the impact of data sparsity, it is essential to consider the factors influencing data availability in power system protection, such as sampling frequency and feature availability. Higher sampling frequencies provide more precise waveform information, but real-world devices often operate at lower rates. Similarly, feature availability, which depends on sensor placement and grid topology, can lead to missing or degraded measurements. In practice, sampling rates typically range from 1\text{\,}\mathrm{kHz} to 10\text{\,}\mathrm{kHz} , varying by relay type and manufacturer. Additionally, legacy infrastructure and communication delays often complicate data availability. Due to the challenges in obtaining real-world high-resolution fault data, research has relied on simulations. Simulations offer the ability to generate extensive datasets and replicate rare fault scenarios. Many studies [ 11 , 12 , 13 ] on fd and fli simulate data sampled at 20\text{\,}\mathrm{kHz} , which can often be unrealistic in practice. However, the applicability of such studies depends on whether the simulated data truly reflects real-world grid behavior. Addressing the limitations of current ml -based fd and fli models under data-sparse conditions is crucial for their real-world deployment. A critical gap remains: there is no systematic framework to validate the performance of ML-based protection schemes under varying data quality and availability constraints. To the best of our knowledge, no prior work has introduced a validation framework to assess the impact of data sparsity on ml -based fd . This study addresses this gap by presenting a proof of concept for evaluating ml models under real-world data constraints with an existing ml model. We systematically analyze how missing sensor data, reduced sampling rates, and temporary communication failures affect ml performance. Focusing on three-phase short circuits within a single power grid topology, we demonstrate the feasibility of a structured validation approach for data quality and availability. Our findings lay the groundwork for assessing the robustness of ML-based fd and fli methods, providing insights to improve their reliability and real-world deployment in data-limited scenarios. II Methods and Materials II-A Dataset and Grid Topology To investigate the impact of data sparsity, we use a widely adopted topology in grid protection studies, as outlined in [ 14 ] . The power grid simulation is based on the “Double Line” topology, shown in Fig. 1 , and generated using DIgSILENT’s PowerFactory 1 1 1 https://www.digsilent.de/en/ software, with simulations conducted by an expert in electrical power engineering. This framework extends the methodology from [ 15 ] . Key parameters, including external grid settings, load conditions, transmission line lengths, and short circuit locations, were systematically varied to simulate a broad range of fault scenarios. The rationale behind this parameter variation, known as domain randomization, is to improve the robustness of ml training and facilitate the transition from simulation to real-world scenarios. The selected parameters aim to accurately represent realistic grid conditions while covering a wide range of possible scenarios. The parameter ranges were based on the works by [ 16 ] and [ 17 ] . For further details on the parameter randomization process, refer to our previous study [ 8 ] . This study specifically focuses on three-phase faults, which, although accounting for only 5\% of fault occurrences [ 18 ] , are responsible for the most severe disruptions in the grid. The objective is to assess whether these faults can be reliably detected despite the challenges posed by data sparsity. Fig. 1:

Read the complete text