Deep Wave Network for Modeling Multi-Scale Physical Dynamics
Alexander I. Khrabry, Edward A. Startsev, Andrew T. Powis, Igor D. Kaganovich · 2026
Read Deep Wave Network for Modeling Multi-Scale Physical Dynamics by Alexander I. Khrabry, Edward A. Startsev, Andrew T. Powis, Igor D. Kaganovich (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04198.txt.
Introduction
Alexander I. Khrabry and three co-authors look at how the shape of a neural network affects its skill at modelling moving gases, fluids, and plasmas. They focus on U-Net models, which shrink an image to capture large patterns and then expand it again for a forecast.
Width is often tuned in these models while depth stays fixed, so the authors test deeper designs made by stacking blocks. Their aim is a fair view of the trade-off between accuracy and computing cost as both width and depth change, rather than a comparison at one fixed size alone.
Catalog record
| CREATOR | Alexander I. Khrabry, Edward A. Startsev, Andrew T. Powis, Igor D. Kaganovich |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.04198
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deep Wave Network for Modeling Multi-Scale Physical Dynamics Alexander I. Khrabry, Edward A. Startsev, Andrew T. Powis, Igor D. Kaganovich Abstract Performance of virtually any deep learning model is strongly governed by its architectural capacity, with width and depth serving as two primary controls. Yet, model comparisons in the physical-science applications are often reported at a single chosen model size or by treating accuracy and computational cost separately, which can be misleading because different architectures exhibit different accuracy–cost scaling as width and depth vary. This issue is especially pronounced for U-Net-type encoder-decoder models, which are widely used for multiscale gas, fluid, and plasma dynamics because they efficiently model features across spatial scales. A U-Net builds a multiresolution representation through a down-sampling (encoder) path that progressively reduces spatial resolution, followed by an up-sampling (decoder) path that restores resolution for prediction. Skip connections link encoder and decoder features at the same spatial resolution, preserving fine-scale information and improving gradient flow. In practice, U-Net width (channels per resolution) is routinely tuned, while depth is commonly kept effectively fixed (a fixed number of down/up-sampling stages and a small number of convolutions per stage), limiting systematic exploration of depth as a means to improve the accuracy-cost trade-off. We address this limitation by increasing effective depth through stacking multiple encoder-decoder “waves” (U-Net modules) in series, with skip connections both within each wave and across successive waves to enable progressive cross-scale feature refinement. We term this architecture a Deep Wave Network (DW-Net). We keep the training data and learning schedule identical across models and quantify computational cost using measured GPU time. Rather than comparing isolated configurations, we train multiple width variants of each architecture and compare accuracy–GPU-time Pareto fronts. Across several published benchmarks of 2D and 3D flows, DW-Net models with a few waves improve the Pareto frontier relative to single-wave U-Net baselines, achieving higher accuracy at matched GPU time or comparable accuracy at lower GPU time, and reaching low-error thresholds with up to 3× less training time under the same training schedule. 1 Introduction Accurate prediction of the dynamics of complex multi-scale physical systems is essential in many fields, including high Reynolds number fluid dynamics [ 96 ] , magnetized plasma systems [ 35 ] , weather forecasting, and atmospheric modeling [ 50 ] . The dynamics of these systems are characterized by the emergence of interacting structures across a wide range of spatial scales, manifesting in nonlinear phenomena such as turbulent energy cascades [ 48 ] . In such systems, the ratio between the largest and smallest relevant scales can span multiple orders of magnitude, making high-fidelity numerical simulations computationally expensive or infeasible. Moreover, resolving fast information propagation often necessitates implicit time integration schemes, further increasing computational cost. This has motivated growing interest in machine learning (ML) models for fast prediction of the systems evolution. In this context, ML can be used in several roles [ 93 , 58 ] : (1) to accelerate traditional solvers by modeling sub-grid physics [ 90 , 47 , 28 , 6 , 5 , 51 , 87 , 69 ] or learning effective initial conditions [ 74 ] ; or (2) to fully replace solvers via learned surrogates [ 8 , 9 , 2 , 56 , 64 , 95 , 43 ] . Surrogate models can be further divided into two categories: (1) physics-informed neural networks (PINNs), which incorporate known governing equations into the loss function during the model training [ 77 , 42 , 19 , 106 , 103 , 41 , 22 , 57 ] , and purely data-driven models that rely only on observed data [ 16 , 85 , 94 , 24 , 59 , 102 , 44 ] . In this work, we focus on the data-driven setting, motivated by scenarios where training data has a low temporal or spatial resolution which renders in not directly applicable to the underlying partial differential equations (PDEs). While our experiments are conducted on high-fidelity numerical solutions of known PDEs, the data was sampled at relatively large output time steps, which is a common practical setup [ 85 ] that accelerates surrogate evaluation but leads to violations of the original numerical constraints. Surrogate models are used for tasks ranging from predicting the detailed evolution of a system over a limited time horizon. which are useful, e.g., in predictive control, to making long-term predictions beyond the Lyapunov time, where accurately forecasting the system’s detailed evolution becomes infeasible and statistical characteristics are needed, which is particularly useful for optimization studies. U-Net architecture has become very popular in modeling 2D and 3D multi-scale gas, liquid, and plasma systems [ 102 , 32 , 70 ] . It effectively captures multi-scale features in these turbulent systems and the interactions between them, utilizing a down-sampling path followed by an up-sampling path. At each subsequent layer in the down-sampling path, representations have 2x lower spatial resolution, which is compensated by an increasing feature map size. Skip connections between these paths at each resolution layer alleviate the loss of information and improve training, especially when it comes to retaining fine-grained details. While U-Net width (number of channels per resolution layer) is routinely tuned, its effective depth is commonly kept fixed (a fixed number of down/up-sampling stages with a small number of convolutions per stage), limiting systematic exploration of depth as a means to improve the accuracy-cost trade-off. Moreover, U-Net can exhibit temporal misalignment between encoder and decoder embeddings at the same resolution layer, as skip-connected features correspond to different effective times, particularly when predicting the temporal evolution of dynamic systems [ 102 ] . To address this limitation, we introduce Multi-Wave Network (DW-Net), a deep learning architecture designed for efficient modeling of multi-scale physical dynamics. DW-Net builds upon the U-Net architecture by stacking multiple encoder-decoder “waves” (i.e., U-Nets), connected not only within each wave but also across waves via skip connections at matched spatial resolutions. This design enables repeated interactions across spatial scales, progressive refinement of learned dynamics, and explicit control over network depth, allowing for a more flexible and effective exploration of the depth-accuracy trade-off in complex physical system modeling. Our contributions are: • We present DW-Net, an efficient convolutional architecture for learning multi-scale dynamics in complex physical systems. • We evaluate DW-Net on four challenging physical systems: 2D Kolmogorov turbulence, 2D Hasegawa–Wakatani (HW) plasma turbulence, buoyant smoke flow (2D and 3D), and a 2D shallow-water planetary atmosphere. DW-Net demonstrated consistent improvements over strong state-of-the-art (SOTA) baselines achieving substantially lower prediction error and 3× faster convergence compared to best-performing baselines. • For systems with longer Lyapunov times (i.e., Kolmogorov flow, buoyant smoke, and the shallow-water planetary system), we compare the predicted trajectory to the ground truth data (high-fidelity numerical solution) for exact frame-wise agreement. In contrast, for the HW plasma turbulence, which has a with very short Lyapunov, we compare statistical characteristics of the predicted trajectory to those of the ground truth, as exact frame-wise alignment is not feasible due to the system’s chaotic dynamics. The paper is organized as follows: Section 2 outlines various types of surrogate models used in the literature to learn multi-scale physical dynamics and introduces the U-Net architecture. Section 3 describes the different U-Net variants compared in