Interpretable Physics-Informed Load Forecasting for U.S. Grid Resilience: SHAP-Guided Ensemble Validation in Hybrid Deep Learning Under Extreme Weather
Md Abubakkar 1 , Sajib Debnath 2 , Md. Uzzal Mia 3 · 2026
Read Interpretable Physics-Informed Load Forecasting for U.S. Grid Resilience: SHAP-Guided Ensemble Validation in Hybrid Deep Learning Under Extreme Weather by Md Abubakkar 1 , Sajib Debnath 2 , Md. Uzzal Mia 3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23500.txt.
Introduction
Abubakkar, Debnath, and Mia forecast short-term electricity demand for the Texas grid with an interpretable ensemble that pairs a convolutional network for local patterns with a transformer for long-range dependence. A physics-based loss encoding the temperature-demand curve regularises the blend, while SHAP explanations reveal which drivers matter. The average error is just over 1 percent, and errors fall markedly in extreme weather flagged by the system.
Catalog record
| CREATOR | Md Abubakkar 1 , Sajib Debnath 2 , Md. Uzzal Mia 3 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33576 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.23500
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Interpretable Physics-Informed Load Forecasting for U.S. Grid Resilience: SHAP-Guided Ensemble Validation in Hybrid Deep Learning Under Extreme Weather Md Abubakkar 1 , Sajib Debnath 2 , Md. Uzzal Mia 3 Abstract Accurate short-term electricity load forecasting is a cornerstone of U.S. grid reliability; however, prevailing deep learning models remain opaque, limiting operator trust during extreme weather. A unified, interpretable, physics-informed ensemble framework is proposed, integrating a Convolutional Neural Network (CNN) branch for local feature extraction and a Transformer branch for long-range dependency modeling; the branches are fused through a validation-optimized weighted ensemble and regularized by a physics-informed loss derived from the piecewise parabolic temperature-demand relationship of the Electric Reliability Council of Texas (ERCOT) system. Post-hoc interpretability is provided through SHapley Additive exPlanations (SHAP) with the DeepExplainer backend, yielding global and event-level attributions. Using eight years of ERCOT hourly load data (2018-2025) fused with Automated Surface Observing System (ASOS) records from three Texas stations, the framework achieves 713 MW MAE, 812 MW RMSE, and 1.18% MAPE on the test window. For Hampel-flagged extreme events, MAPE falls by 20.7% relative to its Transformer branch and by 40.5% relative to its CNN branch; an ablation confirms that the parabolic and ramp constraints drive a 14.7% RMSE reduction. SHAP analysis reveals a regime shift: temperature dominates under normal operation, whereas wind speed and precipitation become more influential during cold fronts and heatwaves. I Introduction The U.S. electric grid is undergoing a period of rapid structural change driven by three converging pressures: soaring load growth from hyperscale data centers and transportation electrification, deepening penetration of variable renewable generation, and a growing frequency of high-impact, low-probability weather events. The Grid Strategies 2023 forecast revised the U.S. five-year load-growth estimate upward by 81%, concentrated in regions with significant data-center build-out [ 1 ] . At the same time, events such as Winter Storm Uri (February 2021) in Texas demonstrated the catastrophic cost of forecasting failure: Independent System Operators dispatched insufficient thermal reserves to cover a demand spike that traditional statistical forecasters had materially underestimated, contributing to cascading outages and more than 200 deaths [ 4 ] , [ 12 ] , [ 33 ] . Modern deep-learning load forecasters, including Long Short-Term Memory (LSTM), Transformer, and hybrid CNN-LSTM variants, routinely deliver sub-2% Mean Absolute Percentage Error (MAPE) on normal operating days [ 20 ] , [ 21 ] . Probabilistic extensions of these architectures, which produce calibrated prediction intervals rather than point estimates, have been surveyed in [ 30 ] . Our own prior work demonstrated that a weather-informed Transformer can achieve 98.7% accuracy on ERCOT 2024 extreme events, compared with 95.7% for a weather-informed LSTM [ 7 ] , and a subsequent attention-based CNN–LSTM reduced MAE to 1,431 MW on the ERCOT test set [ 8 ] . Despite these encouraging results, three limitations continue to prevent widespread operational adoption. First, prevailing deep networks are opaque point predictors that offer no attribution, so operators cannot verify whether a predicted ramp is being driven by temperature, a calendar effect, or spurious correlation. Second, purely data-driven models are free to predict load trajectories that violate the well-documented piecewise parabolic temperature–demand relationship [ 7 ] , [ 11 ] , [ 12 ] or that imply physically implausible hour-over-hour ramps. Third, a single architecture, however sophisticated, exhibits architecture-specific failure modes: CNN-only models tend to over-smooth sharp transitions, while Transformers can overreact to recent spikes. These limitations are operationally significant. When a system operator receives an elevated-reserve signal 24 hours before a cold front, the operator must be able to answer three questions: Why does the model believe the load will spike? Is that belief consistent with the meteorological forecast? And how confident is the model under extreme conditions where training data is inherently sparse? None of these questions can be answered by the current generation of black-box deep learning load forecasters. In this paper, we propose a single integrated framework that addresses all three gaps. The specific contributions are: 1) A physics-informed loss formulation derived from the piecewise parabolic temperature–demand relationship of the ERCOT footprint, penalizing predictions that violate the established thermal-response envelope together with those that imply physically implausible hour-over-hour ramps. 2) A dual-stream hybrid architecture in which a 1-D CNN branch captures local multivariate motifs and a Transformer branch captures long-range temporal dependencies, fused through a validation-optimized weighted ensemble. 3) A SHAP DeepExplainer-based interpretability layer tailored to the ensemble, producing global feature-importance rankings and event-level attribution maps, and explicitly contrasting normal-day behavior against Hampel-flagged extreme events. 4) An empirical demonstration on eight years of ERCOT and ASOS data that the unified framework simultaneously improves accuracy on extreme events and produces actionable, operator-facing explanations. To our knowledge, this is the first framework to integrate physics-informed learning, deep-ensemble validation, and SHAP interpretability for U.S. grid load forecasting. This paper extends the authors’ prior work in two directions. Debnath et al. [ 7 ] NAPS 2025 established the weather-informed LSTM/Transformer baseline on ERCOT; the present work introduces a physics-informed training paradigm and an ensemble interpretability layer on top of that baseline. Debnath et al. [ 8 ] the IEEE Access attention-based CNN-LSTM study, demonstrated multi-scale feature extraction; here we replace the recurrent long-range module with a Transformer and add the explainability layer that explicitly identified as future work. The remainder of the paper is organized as follows. Section II reviews related work. Section III details the methodology. Section IV describes the experimental setup. Section V presents results and discussion, divided into forecasting performance, physics-constraint impact, and SHAP-based interpretability. Section VI concludes. II RELATED WORK II-A Deep Learning for Load Forecasting Traditional electricity load forecasting relied on ARIMA, exponential smoothing, and linear regression, which assume linear relationships between weather and demand and therefore fail during the nonlinear, non-stationary regimes induced by polar vortex intrusions or prolonged heat domes [ 2 ] , [ 4 ] . The introduction of LSTM networks [ 9 , 14 ] enabled explicit modeling of long-term temporal dependencies, and multi-layer LSTM variants have become a standard reference for short-term load forecasting [ 2 ] , [ 20 ] . CNN-LSTM hybrids exploit the CNN’s capacity to extract local multivariate motifs alongside the LSTM’s sequential modeling strength; Guo et al. [ 20 ] proposed a multi-modal attention CNN-LSTM that improved forecasting accuracy on Chinese grid data. Transformer-based architectures, following Vaswani et al. [ 17 ] , have demonstrated particular strength in capturing long-range dependencies without vanishing-gradient pathology, and time-series adaptations such as Informer [ 31 ] , PatchTST [ 1 , 8 ] and ETSformer [ 19 ] continue to advance the state of the art. Probabilistic extensions of Transformer architectures, using Bayesian attention with Monte Carlo Dropout and variational feed-forward layers, have further demonstrated calibrated uncertainty quantification on ERCOT and multi-grid benchmarks [ 35 ] . Parallel work on short-term renewable energy forecasting under extreme weather events [ 29 ] further demonstrated the resilience of hybrid deep learning architectures to tail-regime conditions, corroborating the need for weather-aware designs across energy modalities. Nevertheless, all of these architectures share a common limitation: they are opaque point predictors whose internal reasoning is not verifiable by the human operator. II-B Physics-Informed Neural Networks in Energy Systems Physics-Informed Neural Networks (PINNs),