Physics-guided Emulators Reveal Resilience and Fragility under Operational Latencies and Outages
Sarth Dubey, Subimal Ghosh, Udit Bhatia · 2025
Read Physics-guided Emulators Reveal Resilience and Fragility under Operational Latencies and Outages by Sarth Dubey, Subimal Ghosh, Udit Bhatia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18535.txt.
Introduction
Sarth Dubey, together with Subimal Ghosh and Udit Bhatia, builds a stand-in model for the Global Flood Awareness System that stays trustworthy when data arrive late or go missing. Most rainfall-runoff research grades models only under perfect data, yet real forecasting must cope with delays and outages. Their emulator pairs memory-based neural networks with a relaxed water-balance rule, so its river flows still obey basic physics.
Five versions of the system were tested, spanning full historical and forecast data down to harsh latency and outage cases. Training used lightly managed catchments in the United States, and testing covered more than five thousand basins, including heavily regulated rivers in India. Performance fell smoothly as information quality dropped, and results stayed physically sensible in new climates. The work treats operational toughness as something flood models should be scored on, not assumed.
Catalog record
| CREATOR | Sarth Dubey, Subimal Ghosh, Udit Bhatia |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-18535
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Physics-guided Emulators Reveal Resilience and Fragility under Operational Latencies and Outages Sarth Dubey, Subimal Ghosh, Udit Bhatia Abstract Reliable hydrologic and flood forecasting requires models that remain stable when input data are delayed, missing, or inconsistent. However, most advances in rainfall–runoff prediction have been evaluated under ideal data conditions, emphasizing accuracy rather than operational resilience. Here, we develop an operationally ready emulator of the Global Flood Awareness System (GloFAS) that couples long- and short-term memory networks with a relaxed water-balance constraint to preserve physical coherence. Five architectures span a continuum of information availability: from complete historical and forecast forcings to scenarios with data latency and outages, allowing systematic evaluation of robustness. Trained in minimally managed catchments across the United States and tested in more than 5,000 basins, including heavily regulated rivers in India, the emulator reproduces the hydrological core of GloFAS and degrades smoothly as information quality declines. Transfer across contrasting hydroclimatic and management regimes yields reduced yet physically consistent performance, defining the limits of generalization under data scarcity and human influence. The framework establishes operational robustness as a measurable property of hydrological machine learning and advances the design of reliable real-time forecasting systems. keywords Operational forecasting, Rainfall–runoff emulation, Data latency and outages, Streamflow prediction 1 Main Rainfall–runoff modeling underpins hydrological forecasting, water management, and risk assessment across diverse environments beven2012rainfall ; hrachowitz2013decade . Catchment response to precipitation varies in space and time with climate, storage dynamics, and human regulation, making reliable prediction dependent on both data availability and model adaptability nearing2021role ; shen2018transdisciplinary . Although advances in observations, reanalysis products, and computational methods have expanded predictive capability kratzert2019towards ; kratzert2019toward ; nearing2024global ; feng2022differentiable ; song2025high , translating this progress into forecasting systems that operate continuously and robustly in real time remains unresolved. Operational forecasting requires models that sustain accuracy and physical realism when input data are asynchronous, incomplete, or inconsistent with the conditions used for training, and that can do so with limited human intervention harrigan2020glofas ; krajewski2021real ; ouyang2021continental . Meeting this requirement demands frameworks that test not only predictive skill but also stability, interpretability, and resilience to data degradation—criteria that define whether a rainfall–runoff model can perform under true operational constraints cloke2009ensemble ; demargne2014hefs . Rainfall–runoff modeling has evolved along two principal approaches. Process-based approaches, from lumped catchment formulations to continental forecasting systems such as the Global Flood Awareness System and the United States National Water Model, simulate water and energy fluxes through conservation laws and calibrated parameters. These frameworks are physically interpretable but computationally demanding and rely on extensive calibration that restricts transfer between hydroclimates beven2012rainfall ; harrigan2020glofas ; alfieri2013glofas ; harrigan2020daily ; johnson2023comprehensive ; cosgrove2024noaa . Data-driven approaches, particularly those employing long short-term memory (LSTM) networks, have shown that hydrologic behavior can be learned directly from meteorological inputs nearing2021role ; shen2018transdisciplinary . Large-sample studies demonstrate that these models can reproduce streamflow dynamics and match the predictive ability of process-based systems kratzert2019towards ; kratzert2019toward ; nearing2024global ; feng2022differentiable ; song2025high ; ouyang2021continental . However, both paradigms face limitations when viewed operationally. Physically based models scale poorly and adapt slowly, while data-driven models are typically trained and tested on fully synchronized datasets rather than the asynchronous and incomplete forcings typical of real forecasting hrachowitz2013decade ; kratzert2019towards ; nearing2024global ; harrigan2020glofas ; che2018recurrent . These limitations are most evident when models are transferred between contrasting regimes. Forecasting systems must accommodate delays in satellite and reanalysis products, outages in meteorological inputs, and structural changes in forcing distributions hersbach2020era5 ; skofronick2017global ; yu2021global . Machine learning applied as post-processing can correct systematic bias but does not extend lead time or mitigate data outages frame2021post . Unconstrained learning may violate mass balance, producing implausible hydrologic states hoedt2021mc ; frame2023strictly . Transfer from data-rich, minimally regulated basins to data-scarce, heavily managed systems can lead to unstable or collapsed representations, but the mechanisms of such degradation have not been examined systematically hrachowitz2013decade ; frame2022extreme ; ouyang2021continental . As a result, progress in hydrological machine learning continues to be measured by performance on curated datasets rather than by reliability under the data constraints that define operational forecasting gauch2023defense ; hrachowitz2013decade . Here we develop an operationally ready emulator of the GloFAS hydrological core that couples the learning capacity of long short-term memory networks with the physical coherence of a water-balance constraint karpatne2017theory ; hoedt2021mc ; frame2023strictly . We use the term emulator to emphasize that the network approximates the physically based GloFAS core using the same meteorological forcings and training targets, thereby serving as a computational surrogate rather than a replacement. This formulation preserves the physical coherence and temporal reference of GloFAS while enabling systematic tests of robustness to data degradation and latency. The emulator explicitly represents the availability of asynchronous data through binary masks applied to encoder and decoder inputs, allowing the model to learn under the same latency and outage conditions encountered in real forecasting streams che2018recurrent . Five encoder–decoder configurations represent progressive levels of information availability: one with complete ERA5 inputs for both encoder and decoder; a second with partial masking of decoder variables to emulate intermittent data access; a third with historical inputs only; a fourth representing complete meteorological outage; and a fifth that supplements masked inputs with short-range ECMWF HRES forecasts. Models are trained in minimally managed US catchments addor2017camels and applied across more than 5,000 basins arsenault2020comprehensive , including regulated and data-scarce rivers in India mangukiya2025camels , to quantify transfer from data-rich to data-poor regimes (see Figure S1 ). The results show that predictive performance declines gradually rather than abruptly under missing or delayed data, that the soft physical constraint stabilizes learning across data regimes, and that transfer experiments reveal the conditions under which adaptation fails in data-scarce settings. Collectively, these findings reveal how hydrologic emulators behave under operational latencies and outages, identifying resilient and fragile responses. In doing so, it establishes operational robustness as a measurable property of hydrologic machine learning and reframes the evaluation from benchmark accuracy to sustained, physically consistent performance under real forecast conditions. 1.1 Regional fidelity and national-scale generalization in data-rich domains To evaluate whether the hybrid emulator can generalize across hydrologically distinct regions, we trained individual models on each hydrologic unit (HUC 01–18) using the source domain \mathcal{S} (CAMELS-US) and tested them on all others (Fig. 2a-b; see Figure S2 for remaining metrics of Table S1 ). The median NSE was 0.88 (95% CI [0.86, 0.89]) within training regions (in-HUC), confirming regional fidelity, while cross-HUC testing yielded a median of 0.44 [0.41, 0.47], indicating partial transferability. Different pockets of negative NSE (4% in-HUC; 25% cross-HUC) expose the limits of regional extrapolation when the runoff mechanisms differ. The median F1 score for peak capture was 0.84 [0.83, 0.86] in-HUC and 0.73 [0.72, 0.74] across HUCs. All differences were statistically significant in most regions (see Table S2 for full statistical summaries). Replacement of the 18 regional models with a single national scale model trained in all 395 CAMELS-US basins (Fig. 2c-d; see Figure S3 for remaining metrics) further stabilized performance. The national model achieved median NSE and F1 values of 0.62 and 0.73 , respectively, with markedly fewer low-skill outliers and smoother performance across regions (Table S2). Gains were widespread rather than dominated