A Staged Deep Learning Approach to Spatial Refinement in 3D Temporal Atmospheric Transport Manuscript received XX Month XXXX; revised XX Month XXXX. The co-authors are listed in alphabetical order. Details of the authors’ contributions are provided in subsection Author Declarations ( Author Contribu

M. Giselle Fernández-Godino 1 , Wai Tong Chung 2 , Akshay A. Gowardhan 1 , Matthias Ihme 2 , Qingkai Kong 1 , Donald D. Lucas 1 , and Stephen C. Myers 1 · 2024

Read A Staged Deep Learning Approach to Spatial Refinement in 3D Temporal Atmospheric Transport Manuscript received XX Month XXXX; revised XX Month XXXX. The co-authors are listed in alphabetical order. Details of the authors’ contributions are provided in subsection Author Declarations ( Author Contribu by M. Giselle Fernández-Godino 1 , Wai Tong Chung 2 , Akshay A. Gowardhan 1 , Matthias Ihme 2 , Qingkai Kong 1 , Donald D. Lucas 1 , and Stephen C. Myers 1 (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-10945.txt.

Introduction

Giselle Fernandez-Godino and six co-authors build a deep learning model that predicts how a pollutant plume spreads through complex terrain, far faster than direct simulation. Their paper came out in 2024. Detailed airflow simulations capture plume behavior well but cost too much for urgent response or repeated analysis.

Their model works in two stages. The first stage predicts how the plume evolves over time at coarse resolution. The second stage then sharpens each frame spatially. Training data came from high-fidelity turbulence simulations. The combined model ran about a thousand times faster than the simulations it imitates. It could also absorb fresh observations mid-run, which improved accuracy near the source where concentrations run highest. The speed opens plume forecasting to planning and emergency use.

Catalog record

CREATORM. Giselle Fernández-Godino 1 , Wai Tong Chung 2 , Akshay A. Gowardhan 1 , Matthias Ihme 2 , Qingkai Kong 1 , Donald D. Lucas 1 , and Stephen C. Myers 1
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-10945

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Staged Deep Learning Approach to Spatial Refinement in 3D Temporal Atmospheric Transport Manuscript received XX Month XXXX; revised XX Month XXXX. The co-authors are listed in alphabetical order. Details of the authors’ contributions are provided in subsection Author Declarations ( Author Contributions ). M. Giselle Fernández-Godino 1 , Wai Tong Chung 2 , Akshay A. Gowardhan 1 , Matthias Ihme 2 , Qingkai Kong 1 , Donald D. Lucas 1 , and Stephen C. Myers 1 Abstract High-resolution spatiotemporal simulations effectively capture the complexities of atmospheric plume dispersion in complex terrain. However, their high computational cost makes them impractical for applications requiring rapid responses or iterative processes, such as optimization, uncertainty quantification, or inverse modeling. To address this challenge, this work introduces the Dual-Stage Temporal Three-dimensional UNet Super-resolution (DST3D-UNet-SR) model, a highly efficient deep learning model for plume dispersion prediction. DST3D-UNet-SR is composed of two sequential modules: the temporal module (TM), which predicts the transient evolution of a plume in complex terrain from low-resolution temporal data, and the spatial refinement module (SRM), which subsequently enhances the spatial resolution of the TM predictions. We train DST3D-UNet-SR using a comprehensive dataset derived from high-resolution large eddy simulations (LES) of plume transport. We propose the DST3D-UNet-SR model to significantly accelerate LES simulations of three-dimensional plume dispersion by three orders of magnitude. Additionally, the model demonstrates the ability to dynamically adapt to evolving conditions through the incorporation of new observational data, substantially improving prediction accuracy in high-concentration regions near the source. I Introduction Modeling atmospheric plume dispersion requires resolving the many scales of turbulence in fluid flows, a task for which large eddy simulations (LES) is particularly suited. LES captures the dynamics of turbulent eddies, yielding high-fidelity insights into atmospheric dispersion phenomena. However, the computational cost of LES is prohibitive for real-time applications, such as emergency response, and for iterative processes like optimization and uncertainty quantification (UQ) that demand large-scale simulations. To address these constraints, machine learning-based models have been developed, offering a trade-off between computational efficiency and predictive accuracy. In this context, we introduce the Dual-Stage Temporal 3D UNet Super-Resolution (DST3D-UNet-SR) model, a deep learning framework that significantly accelerates LES-based plume dispersion modeling while retaining high spatial resolution. DST3D-UNet-SR leverages a dual-stage neural network architecture: a temporal module (TM) and a spatial refinement module (SRM). The TM, built on a U-Net architecture augmented with ConvLSTM layers, processes temporal sequences of low-resolution input data to predict plume evolution over time while capturing dependencies across time steps. Following this, the SRM enhances the spatial resolution of the TM outputs using a 3D U-Net architecture optimized with skip connections and transposed convolutions, enabling a fourfold increase in resolution. By combining these two specialized modules, DST3D-UNet-SR significantly reduces computational costs by orders of magnitude while retaining the fidelity of turbulence-resolving LES simulations. II Related Work The field of atmospheric plume dispersion modeling has seen significant advancements through the integration of machine learning techniques. While traditional approaches such as LES provide unparalleled accuracy, their computational demands have motivated the development of alternative methods that prioritize efficiency without sacrificing reliability. In this section, we review prior work on integrating convolutional neural networks (CNNs) and Long Short-Term Memory (LSTMs) for spatiotemporal modeling in atmospheric sciences. CNNs have shown remarkable success in spatial pattern prediction tasks, outperforming traditional methods in various domains, including atmospheric modeling [ 1 ] . In our prior work [ 2 ] , we demonstrated the applicability of CNNs to spatial deposition modeling, highlighting their ability to reconstruct fine-scale features. Additionally, in a related study [ 3 ] , we explored the use of CNNs as feature extractors for seismic waveform data, demonstrating the effectiveness of CNN in enhancing encoded features for tasks such as event discrimination and phase picking. Of particular relevance is the Super-Resolution Convolutional Neural Network (SRCNN) developed by Dong et al. (2015) [ 4 ] , a foundational DL framework for enhancing the spatial resolution of low-quality images. SRCNN directly learns an end-to-end mapping from low-resolution to high-resolution representations, leveraging its deep CNN architecture to achieve superior single-image super-resolution. We studied this technique in previous work [ 5 ] , establishing that super-resolution techniques perform well in turbulent flows up to 16x-refinement, indicating that our 4x-refinement dual-stage model is well within this effective range. Long Short-Term Memory (LSTM) have proven to be highly effective in modeling temporal sequences involving atmospheric plume dispersion. LSTMs effectively capture long-term dependencies in time-series data, crucial for forecasting and assessing plume dispersion dynamics. The study by Marcos et al. (2024) [ 6 ] highlights the great performance achieved by LSTMs in modeling the intricate temporal evolution of plume dispersion dynamics, specifically demonstrating their application in predicting the atmospheric dispersion of radioactive plumes during nuclear power plant emergencies. Similarly, our prior research [ 7 , 8 , 9 , 10 ] has shown that LSTMs achieve high accuracy in forecasting temporal patterns, emphasizing their potential to enhance real-time decision-making scenarios. Previous research has explored the integration of CNNs and LSTMs for spatiotemporal modeling; however, the DST3D-UNet-SR model introduces significant advancements. The model employs LSTMs for temporal predictions using low-resolution input data, effectively and efficiently capturing temporal dependencies through the TM before applying the SRM. DST3D-UNet-SR model integrates a 3D U-Net architecture within its SRM to achieve a fourfold enhancement in spatial resolution. A defining feature of DST3D-UNet-SR is its modular design, which allows for the choice to apply super-resolution sequentially at each timestep or collectively after completing the temporal modeling. This modularity ensures that enhancements to either the TM or SRM can be independently achieved, streamlining model refinement and adaptation for future applications. DST3D-UNet-SR unifies temporal modeling and spatial refinement in a single framework, offering a more comprehensive solution compared to prior models, which often address isolated aspects or lack super-resolution capabilities. For example, Tsokov et al. (2022) [ 11 ] presented a hybrid model integrating CNNs and LSTMs for air pollution forecasting in two dimensions. Their Deep-Air model captures spatial and temporal dependencies within a single framework and is conceptually similar to the baseline HRTM model used in this study (see section V instead of the DST3D-UNet-SR staged approach. Moreover, the SRM incorporates ConvLSTM layers to further refine spatial features, a capability not present in Deep-Air. Similarly, Ding et al. (2021) introduced a hybrid CNN-LSTM model to predict daily PM2.5 concentrations by leveraging spatiotemporal correlations between Beijing and its neighboring cities. While effective for analyzing 2D spatial data, their approach does not incorporate super-resolution techniques or U-Net architectures, which limits its applicability to high-resolution 3D atmospheric modeling. To the best of our knowledge, this work is the first to integrate U-Net architectures, super-resolution techniques, LSTMs, and CNNs into a modular framework, the DST3D-UNet-SR, specifically designed for modeling the 3D temporal evolution of plume dispersion over complex terrain. III Data The simulations, referred in this work as ground truth , were originally designed to replicate similar conditions of the REACT (RElease ACTivity) experiment, conducted in October 2022 at the Nevada National Security Site (NNSS), where real-time xenon sensors monitored radiotracer releases [ 12 , 13 ] (Fig. 9 ). Xenon is a reliable indicator of nuclear explosions, particularly underground nuclear tests. We collaborate with researchers who utilize data

Read the complete text