Deep Learning-Based Metamodeling of Nonlinear Stochastic Dynamic Systems under Parametric and Predictive Uncertainty Journal: Preprint submitted to Engineering Structures

Haimiti Atila, Seymour M.J. Spence · 2026

Read Deep Learning-Based Metamodeling of Nonlinear Stochastic Dynamic Systems under Parametric and Predictive Uncertainty Journal: Preprint submitted to Engineering Structures by Haimiti Atila, Seymour M.J. Spence (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12012.txt.

Introduction

Atila and Spence build deep learning metamodels for nonlinear systems shaken by random loads. Their three frameworks pair a feature extractor with an LSTM network that tracks time steps. Monte Carlo dropout and a likelihood-based loss let each model state its own prediction uncertainty. Tests use a Bouc-Wen system and a tall steel frame under earthquake-like shaking with unsure parameters. The plain extractor wins on the simpler case, while graph and autoencoder versions do best on the frame.

Catalog record

CREATORHaimiti Atila, Seymour M.J. Spence
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61326
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.12012

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Deep Learning-Based Metamodeling of Nonlinear Stochastic Dynamic Systems under Parametric and Predictive Uncertainty Journal: Preprint submitted to Engineering Structures Haimiti Atila, Seymour M.J. Spence Abstract Modeling high-dimensional, nonlinear dynamic structural systems under natural hazards presents formidable computational challenges, especially when simultaneously accounting for uncertainties in external loads and structural parameters. Studies have successfully incorporated uncertainties related to external loads from natural hazards, but few have simultaneously addressed loading and parameter uncertainties within structural systems while accounting for prediction uncertainty of neural networks. To address these gaps, three metamodeling frameworks were formulated, each coupling a feature-extraction module—implemented through a multi-layer perceptron (MLP), a message-passing neural network (MPNN), or an autoencoder (AE)—with a long short-term memory (LSTM) network using Monte Carlo dropout and a negative log-likelihood loss. The resulting architectures (MLP-LSTM, MPNN-LSTM, and AE-LSTM) were validated on two case studies: a multi-degree-of-freedom Bouc–Wen system and a 37-story fiber-discretized nonlinear steel moment-resisting frame, both subjected to stochastic seismic excitation and structural parameter uncertainty. All three approaches achieved low prediction errors: the MLP-LSTM yielded the most accurate results for the lower-dimensional Bouc–Wen system, whereas the MPNN-LSTM and AE-LSTM provided superior performance on the more complex steel-frame model. Moreover, a consistent correlation between predictive variance and actual error confirms the suitability of these frameworks for active-learning strategies and for assessing model confidence in structural response predictions. 1 Introduction Nonlinear dynamic response analysis is frequently required for nonlinear multi-degree-of-freedom (MDOF) structural systems subjected to time-varying excitations. Such analyses capture essential dynamic behaviors and allow for the calculation of key performance metrics, including peak responses, residual responses, and cumulative damage assessments. Typically, dynamic response analyses are conducted numerically using various integration schemes. However, for high-dimensional structural systems exhibiting complex nonlinear behavior, these numerical methods become computationally intensive. This challenge intensifies further in applications like uncertainty quantification and design optimization, which require multiple simulations under varying loading sequences and structural model parameters. Metamodeling techniques are essential for reducing such computational barriers. Researchers have previously employed approaches such as kriging, radial basis functions, support vector machines, and polynomial regression to approximate the input-output relationship of high-fidelity numerical models, significantly reducing computational demands [ 1 , 2 , 3 , 4 , e.g.] . Nonetheless, traditional metamodeling approaches frequently struggle to accurately replicate dynamic response time histories, particularly under stochastic excitations. These types of problems, defined as sequence-to-sequence learning tasks, can become prohibitively high-dimensional due to the necessity of predicting responses across numerous discrete time steps. Many works have used methodologies such as Multi-Input Multi-Output Nonlinear AutoRegressive eXogenous (MIMO-NARX) models to overcome such a challenge; however, NARX models are limited by the need for predefined function forms, which generally require prior knowledge of the system for identification [ 5 , 6 , 7 , 8 ] . More recently, to break free from the limitation of the NARX models, researchers have turned their attention to deep learning frameworks, such as recurrent neural networks, physics-informed machine learning architectures, and neural operators to improve metamodeling capabilities for dynamic nonlinear structural systems [ 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 ] . Despite the demonstrated capability of recent machine learning methods to reproduce dynamic responses under stochastic excitation and generalize across loading sequences, many existing studies fail to account for two critical sources of uncertainty: (1) structural parameter uncertainty—encompassing variations in mass, damping, material properties, and other physical characteristics—and (2) prediction uncertainty, which includes both epistemic uncertainty arising from limited training data and aleatoric uncertainty stemming from inherent variability or modeling limitations in the learning algorithm. Neglecting structural variability undermines the generalizability of these approaches when applied to structures with differing physical attributes. While, disregarding prediction uncertainty hinders the reliable interpretation of metamodel outputs and limits the model’s utility for informed decision-making during the model’s inference time. Although several recent studies have begun to incorporate structural parameter variability under stochastic loading (e.g., [ 19 , 20 , 21 , 22 , 23 ] ), and in one case have attempted to quantify predictive uncertainty (e.g., [ 22 ] ), such efforts remain limited. In particular, the latter addresses only aleatoric uncertainty while neglecting epistemic contributions. Furthermore, the predictive scope in these works is typically restricted to a subset of degrees of freedom rather than encompassing the full structural system. To the best of the authors’ knowledge, no existing study has developed a comprehensive metamodel capable of predicting the complete time-history response across all degrees of freedom in large-scale nonlinear structural systems, while simultaneously accounting for stochastic excitations, structural parameter uncertainty, and both epistemic and aleatoric forms of uncertainty. To address the aforementioned research gap, this study introduces three metamodeling frameworks that not only generalize across diverse stochastic excitation scenarios and structural parameter variations but also provide prediction uncertainty quantification. Each framework consists of two interdependent modules: a feature extraction/fusion module and a time-series prediction module. The feature extraction/fusion module is designed to distill salient information from both the structural configuration and stochastic excitation into compact feature vectors. Three distinct architectures are explored for this purpose: a multi-layer perceptron (MLP), for its architectural simplicity; a message passing neural network (MPNN), which captures relational dependencies by leveraging the system’s graph-based representation; and an autoencoder (AE), which facilitates nonlinear dimensionality reduction, particularly advantageous for high-dimensional systems. These fused feature vectors are subsequently processed by a long short-term memory (LSTM) network integrated with Monte-Carlo dropout and trained using the negative log-likelihood loss function. This configuration enables the LSTM to learn temporal dynamics while simultaneously quantifying both aleatoric and epistemic uncertainty. To mitigate the computational burden and enhance training efficiency, wavelet-based approximations are incorporated into the LSTM module. The resulting architectures—MLP–LSTM, MPNN–LSTM, and AE–LSTM—are evaluated using two case studies: (1) a multi-degree-of-freedom Bouc–Wen system, and (2) a 37-story nonlinear fiber-discretized steel moment-resisting frame. Both systems are subjected to stochastic seismic excitations and incorporate uncertainty in their structural properties. These case studies are designed to assess and compare the performance of the proposed methods, with the goal of elucidating their respective strengths and limitations in capturing the dynamic response and associated predictive uncertainties. The MLP–LSTM model, owing to its architectural simplicity, was designated as the baseline against which the more advanced MPNN–LSTM and AE–LSTM variants were benchmarked. The remainder of this paper is organized as follows. Sec. 2 provides a formal statement of the problem. Sec. 3 presents the detailed architectures of the three proposed schemes. Sec. 4.2 and 4.3 describe the experimental setups and results for the Bouc–Wen system and the fiber-discretized nonlinear steel moment-resisting frame system, respectively. Finally, Sec. 5 offers concluding remarks and discusses the limitations and potential extensions of the current work. 2 Problem Setting The dynamic response of nonlinear structural systems subjected to stochastic excitation can be characterized by solving the set of nonlinear ordinary differential equations: \mathbf{M(\mathbf{\Gamma})}\ddot{\mathbf{u}}(t)+\mathbf{C(\mathbf{\Gamma})}\dot{\mathbf{u}}(t)+\mathbf{f}_{nl}(t;\mathbf{u}(t),\mathbf{\Gamma})=\mathbf{F}(t) (1) where \mathbf{u}(t) , \dot{\mathbf{u}}(t) , and \ddot{\mathbf{u}}(t) denote the displacement, velocity, and acceleration vectors, respectively, for a system with n degrees of freedom; the matrices \mathbf{M}(\mathbf{\Gamma}) and \mathbf{C}(\mathbf{\Gamma}) are the mass and damping matrices of size n\times n , both of which depend on the random vector \mathbf{\Gamma} that encapsulates uncertainty in structural parameters; \mathbf{f}_{\mathrm{nl}}(t;\mathbf{u}(t),\mathbf{\Gamma}) represents the nonlinear restoring force, which is generally

Read the complete text