ROBUSTNESS EVALUATION OF MACHINE LEARNING MODELS FOR FAULT CLASSIFICATION AND LOCALIZATION IN POWER SYSTEM PROTECTION
Julian Oelhaf \ad 1 *, Mehran Pashaei \ad 1, Georg Kordowich \ad 2, Christian Bergler \ad 3, Andreas Maier \ad 1, Johann Jäger \ad 2, Siming Bayer \ad 1 · 2025
Read ROBUSTNESS EVALUATION OF MACHINE LEARNING MODELS FOR FAULT CLASSIFICATION AND LOCALIZATION IN POWER SYSTEM PROTECTION by Julian Oelhaf \ad 1 *, Mehran Pashaei \ad 1, Georg Kordowich \ad 2, Christian Bergler \ad 3, Andreas Maier \ad 1, Johann Jäger \ad 2, Siming Bayer \ad 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-15385.txt.
Introduction
Julian Oelhaf and six coauthors stress test machine learning guards for electrical power grids. As renewable and distributed generation spread, fixed protection schemes strain, and learning based fault classification and localization promise faster, adaptive decisions. Deployment, though, hinges on robustness when sensors fail or degrade.
Their unified framework benchmarks models under realistic damage, simulated with high fidelity EMT tools: sensor outages, lower sampling rates, and transient communication losses. Fault classification stayed stable under most damage but fell by about 13 percent under single phase loss. Fault localization proved more fragile, with voltage loss raising its error by over 150 percent. The framework also names which measurement channels are critical for resilient operation. The findings give concrete guidance for building learning based protection that survives bad data.
Catalog record
| CREATOR | Julian Oelhaf \ad 1 *, Mehran Pashaei \ad 1, Georg Kordowich \ad 2, Christian Bergler \ad 3, Andreas Maier \ad 1, Johann Jäger \ad 2, Siming Bayer \ad 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-15385
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ROBUSTNESS EVALUATION OF MACHINE LEARNING MODELS FOR FAULT CLASSIFICATION AND LOCALIZATION IN POWER SYSTEM PROTECTION Julian Oelhaf \ad 1 *, Mehran Pashaei \ad 1, Georg Kordowich \ad 2, Christian Bergler \ad 3, Andreas Maier \ad 1, Johann Jäger \ad 2, Siming Bayer \ad 1 Abstract The growing penetration of renewable and distributed generation is transforming power systems and challenging conventional protection schemes that rely on fixed settings and local measurements. Machine learning (ML) offers a data-driven alternative for centralized fault classification (FC) and fault localization (FL), enabling faster and more adaptive decision-making. However, practical deployment critically depends on robustness. Protection algorithms must remain reliable even when confronted with missing, noisy, or degraded sensor data. This work introduces a unified framework for systematically evaluating the robustness of ML models in power system protection. High-fidelity EMT simulations are used to model realistic degradation scenarios, including sensor outages, reduced sampling rates, and transient communication losses. The framework provides a consistent methodology for benchmarking models, quantifying the impact of limited observability, and identifying critical measurement channels required for resilient operation. Results show that FC remains highly stable under most degradation types but drops by about 13 % under single-phase loss, while FL is more sensitive overall, with voltage loss increasing localization error by over 150 %. These findings offer actionable guidance for robustness-aware design of future ML-assisted protection systems. keywords FAULT CLASSIFICATION, FAULT LOCALIZATION, MACHINE LEARNING, POWER SYSTEM PROTECTION, ROBUSTNESS † † footnotetext: This paper is a postprint of a paper submitted to and accepted for publication in the 20th IET International Conference on Developments in Power System Protection (DPSP Global 2026) and is subject to Institution of Engineering and Technology Copyright. The copy of record is available at the IET Digital Library. 1 Introduction Modern power grids are undergoing a fundamental transformation driven by the large-scale integration of renewable and decentralized energy sources. This transition increases system complexity, leading to dynamic power flows and diverse fault characteristics that challenge conventional protection schemes 13 . While traditional methods remain effective for rapid fault isolation, they lack the analytical depth required for advanced post-fault tasks such as fc ( fc ) and fl ( fl ), which are essential for efficient grid restoration. ml ( ml ) offers a promising alternative for developing centralized, data-driven protection systems capable of deeper and more adaptive fault analysis beyond simple detection. However, their successful and reliable deployment largely depends on data quality, as real-world systems usually operate under imperfect conditions caused by sensor failures, communication issues, or hardware limitations. Reliable and robust operation under partial observability is therefore a key requirement for practical ml -based protection. Our recent scoping review 9 provides a comprehensive overview of ml applications in power system protection and highlights major inconsistencies in datasets, preprocessing strategies, and evaluation metrics that hinder comparability. Most existing studies investigate fc or fl separately and under ideal measurement conditions, with only a few considering the impact of measurement noise or missing data. Although recent works across HVDC systems, wind farms, and hybrid grids 12 ; 2 ; 5 ; 14 ; 16 demonstrate methodological advances, they remain fragmented and rarely evaluate robustness. To the best of our knowledge, no prior study has systematically examined how ml -based fc and fl perform under degraded or incomplete data. Building on our previous framework for fault detection and line identification 8 , this study extends the analysis to a unified robustness evaluation across both classification and localization tasks. The proposed framework systematically models realistic degradation scenarios, including sensor outages, reduced sampling rates, and communication losses, to quantify their impact on model performance. It establishes a consistent benchmark and identifies the critical measurement channels and operating conditions required for reliable and resilient ml -assisted power system protection. 2 Methodology In order to evaluate the robustness of ml models for fc and fl , a structured framework has been designed, comprising four stages: data generation, preprocessing, model training, and controlled introduction of measurement limitations to emulate real-world conditions. Model performance is quantified using well-defined evaluation metrics. 2.1 Data Material The dataset is generated following the procedure of Wang et al. 15 using DIgSILENT PowerFactory 1 1 1 https://www.digsilent.de/en/ for emt ( emt ) simulations of the benchmark double line grid 4 shown in Figure 1 . emt modelling provides high-resolution voltage and current waveforms that accurately capture transient fault behaviour 3 . To enhance data diversity and model generalization, domain randomization is applied by varying line lengths, load conditions, fault locations, and external grid parameters within realistic operating ranges 11 ; 6 . Figure 1 : Schematic of the “Double Line” grid topology showing transmission lines, pr , and communication links. Measurements from each pr are transmitted to the corresponding substation and then forwarded to the control centre for fc and fl . The dataset consists of 9,023 simulated fault cases, each lasting 1 s at a nominal voltage of 90 kV and sampled at 6,400 Hz. It includes single-, double-, double-to-ground, and three-phase short circuits (denoted by the faulted phases A, B, and C). Each transmission line is monitored by one pr per terminal, resulting in eight pr and 48 total channels recording three-phase currents and voltages: \displaystyle I_{PR}(t) \displaystyle=(I_{A}(t),I_{B}(t),I_{C}(t)), \displaystyle V_{PR}(t) \displaystyle=(V_{A}(t),V_{B}(t),V_{C}(t)),\quad t\in[0,1]\,\text{s}. Combining all sensors yields a multivariate time series for each simulation case n : X^{(n)}=[x^{(n)}_{1},x^{(n)}_{2},\ldots,x^{(n)}_{T}]\in\mathbb{R}^{48\times T},\quad x^{(n)}_{t}\in\mathbb{R}^{48}, where T (= 6,400) denotes the total number of time steps per simulation, and n indexes the individual fault cases. 2.2 Data Preprocessing Each episode is cropped to \pm 80 ms around the fault inception and segmented into overlapping windows of duration w=50 ms with a stride of 5 ms following 10 . At a sampling rate of 6.4 kHz, each window has a length of L_{w}=w\times f_{s}=320 samples across 48 channels, forming an input tensor X^{(n)}_{i}\in\mathbb{R}^{L_{w}\times 48} (15,360 data points). This segmentation yields 207,506 windows in total, of which 81,119 contain fault events (at least partially). The high simulation frequency ensures realistic temporal resolution, matching real-time protection data and enabling controlled downsampling experiments. 2.3 Machine Learning for Fault Classification and Localization The preprocessed input tensors X^{(n)}_{i}\in\mathbb{R}^{L_{w}\times 48} serve as inputs for two protection tasks: fc and fl , following the methodology proposed in 7 . For fc , each window X^{(n)}_{i} is assigned one of eleven labels, ten short-circuit types plus a no-fault class, and evaluated using the F1-score. For fl , the same input is used to predict a continuous target y_{\text{FL}}\in[0.01,\,0.99] , representing the fault location as a percentage of the line length. This regression task mirrors distance protection principles 1 and is evaluated using the mae ( mae ) (in % of line length) as metric. Both tasks use as a model architecture a compact mlp ( mlp ) with two hidden layers and ReLU activations, identified in our benchmark study 7 as the best-performing and efficient ml model across tasks. Each model maps the flattened input window X^{(n)}_{i} through fully connected layers to a latent representation. The output layer contains 11 softmax-activated neurons for fc and a single linear neuron for fl to estimate the fault location. All models were trained using the the Adam optimizer together with an initial learning rate of 1.38\times 10^{-4} and