Environment Inference for Learning Generalizable Dynamical System

Shixuan Liu, Yue He, Haotian Wang, Wenjing Yang, Yunfei Wang, Peng Cui, Zhong Liu · 2025

Read Environment Inference for Learning Generalizable Dynamical System by Shixuan Liu, Yue He, Haotian Wang, Wenjing Yang, Yunfei Wang, Peng Cui, Zhong Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19784.txt.

Introduction

Shixuan Liu and six co-authors tackle a hidden obstacle in learning models of dynamical systems: data gathered in different environments behave differently, but environment labels are often missing. Without labels, methods that generalize across environments cannot get started, a common problem in large public and privacy-sensitive datasets. Their method, DynaInfer, infers the labels from the data itself.

Within each training round, fixed neural networks score the data, and their prediction errors reveal which examples belong together environmentally. The authors prove the procedure solves the underlying alternating optimization problem and test it on diverse systems. DynaInfer assigned environments more accurately than existing techniques, converged quickly to the true labels, and sometimes beat methods that were given the true labels.

Catalog record

CREATORShixuan Liu, Yue He, Haotian Wang, Wenjing Yang, Yunfei Wang, Peng Cui, Zhong Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-19784

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Environment Inference for Learning Generalizable Dynamical System Shixuan Liu, Yue He, Haotian Wang, Wenjing Yang, Yunfei Wang, Peng Cui, Zhong Liu Abstract Data-driven methods offer efficient and robust solutions for analyzing complex dynamical systems but rely on the assumption of I.I.D. data, driving the development of generalization techniques for handling environmental differences. These techniques, however, are limited by their dependence on environment labels, which are often unavailable during training due to data acquisition challenges, privacy concerns, and environmental variability, particularly in large public datasets and privacy-sensitive domains. In response, we propose DynaInfer, a novel method that infers environment specifications by analyzing prediction errors from fixed neural networks within each training round, enabling environment assignments directly from data. We prove our algorithm effectively solves the alternating optimization problem in unlabeled scenarios and validate it through extensive experiments across diverse dynamical systems. Results show that DynaInfer outperforms existing environment assignment techniques, converges rapidly to true labels, and even achieves superior performance when environment labels are available. 1 Introduction Data-driven approaches, especially neural networks, offer a powerful alternative or complement to traditional physics-based methods for understanding complex dynamical systems ( brunton2016discovering ) . Neural network-based emulators are particularly valuable for their ability to provide fast, cost-effective approximations of complex simulations ( duraisamy2019turbulence ; li2020fourier ) , making them especially useful in scenarios where the underlying physics are poorly understood or misinterpreted, or where external disturbances are difficult to model ( yin2021leads ; sirignano2018dgm ) . These emulators are adept at handling large sets of variables and solving problems that are challenging for conventional solvers. Recent advancements in deep learning, along with innovative methods for modeling temporal and spatio-temporal systems, have led to a significant increase in applications across various fields, ranging from simple Hamiltonian dynamics to more complex areas like fluid dynamics and climatology ( shaier2021data ; de2019deep ) . While recent advancements have shown promising results, they often rely on the assumption that abundant, static data are available to satisfy the independent and identically distributed (IID) hypothesis. However, this assumption is frequently violated in practice due to challenges in data collection, associated costs, and environmental changes driven by exogenous factors ( madec2017nemo ; neic2017efficient ) . Recent work in dynamical systems addresses this by introducing a multi-environment setting, where trajectories follow distinct dynamics across environments. These studies developed generalization methods that learn a shared global component while accounting for environment-specific variations, avoiding the limitations of underperforming averaged models ( yin2021leads ; kirchmeyer2022generalizing ) . Figure 1: Environment labels, required by current generalization methods, are often unavailable. Nevertheless, a key limitation of many generalization techniques is their reliance on partitioning datasets across distinct domains or environments, which are assumed to capture underlying variations. These environment labels enable algorithms to identify and exploit both similarities and differences across environments. However, obtaining such environment labels during training is often challenging due to data acquisition difficulties or privacy constraints. For example, in scientific research, data may be collected over time under uncontrolled or unknown conditions ( willard2020integrating ) . In ecological studies, critical environmental parameters such as temperature or rainfall may vary unpredictably or remain unrecorded. ( ben2009robust ) . Similarly, when aggregating data from multiple sources, environment labels are frequently lost or omitted, a common issue in large public datasets ( srivastava2020robustness ) . Furthermore, in privacy-sensitive domains like healthcare, finance, or social networking, access to environment-specific information is often restricted ( lahoti2020fairness ) . These limitations highlight the need for generalization methods that do not depend on explicit environment labels. To address the challenge of unknown environment labels, we propose a novel approach that infers environment specifications by leveraging the key insight that trajectories within the same environment share consistent dynamics and exhibit similar prediction losses under the same neural network. This inherent consistency enables us to automatically derive meaningful environment assignments directly from the training data. We introduce an environment inference objective designed for dynamical systems, which minimizes environment-specific prediction losses. Using fixed neural networks, we first infer environments and then iteratively refine these networks with the inferred environments, ultimately learning a generalizable dynamical system. Our model identifies environment labels directly from mixed trajectories of dynamical systems, facilitating the training of off-the-shelf generalization algorithms in scenarios where such labels are absent. Importantly, our findings demonstrate that inferring environments from mixed sequence data can improve the performance of generalization strategies, even compared to cases where environments are manually assigned. Our main contributions are as follows: • We present the first investigation into the challenge of unlabeled environment conditions in the context of learning generalizable dynamical systems, and propose a general framework named DynaInfer that utilizes the prediction loss to accurately infer latent environment labels from mixed sequence data 1 1 1 Code is available at https://github.com/shixuanliu-andy/DynaInfer . • We theoretically establish that our algorithm effectively solves the alternating optimization problem without requiring environment labels, demonstrating its capacity to discern heterogeneous environments and infer generalizable mechanisms. • We examine the efficacy of DynaInfer through experiments in both in-domain settings and adaptation scenarios using three representative dynamical systems. Results confirm that the environment labels assigned by DynaInfer converge rapidly to the true labels. The remainder of this paper is structured as follows. Section 2 clarifies the problem definition. Section 3 introduces our framework and provides the theoretical underpinnings. Section 4 details the experimental setup and discusses the results. Related work is reviewed in Section 5, and Section 6 concludes the paper. 2 Problem Definition 2.1 Dynamical Systems We examine dynamical systems determined by unidentified differential equations evolving over time, expressed as, \frac{dx_{t}}{dt}=f(x_{t}) (1) where t\in\mathbb{R} is the time index within a time interval I=[0,T] , and x_{t} is a time-variant state within a bounded set \mathcal{A} . The evolution function f:\mathcal{A}\rightarrow T\mathcal{A} maps x_{t} to its temporal derivative in the tangent space T\mathcal{A} and belongs to a class of vector fields \mathcal{F} . In this paper, we consider both ordinary differential equation (ODE) and partial differential equation (PDE). For ODEs, \mathcal{A}\subset\mathbb{R}^{d} ; for PDEs, \mathcal{A} represents a d^{\prime} -dimensional vector field within a bounded spatial domain (such as 2D or 3D Euclidean space) denoted as S\subset\mathbb{R}^{d^{\prime}} . The function f characterizes the data distribution of trajectories \mathcal{T} . Trajectories initiated from x_{0}\sim p(X_{0}) are computed by integrating the derivatives: x_{t}=x_{0}+\int_{0}^{t}f(x_{u})du,\forall t\in I . 2.2 Multi-Environment Dynamical Systems Learning In contrast to the standard expected risk minimization (ERM) framework, which assumes i.i.d. trajectories, the multi-environment learning problem involves learning trajectories from M different environments. In each environment e\in[M]=\{1,2,\dots,M\} , the trajectories are governed by unique differential equations described by function f_{e} . Specifically, consider N trajectories \{x^{1},x^{2},\dots,x^{N}\} , where each trajectory x^{i} is associated with an environment e_{i}\in[M] . The dynamics of each trajectory x^{i} are thus modeled by the differential equation dx^{i}_{t}/dt=f_{e_{i}}(x^{i}_{t}) . The set of environments for all trajectories is denoted by \boldsymbol{e}=\{e_{1},e_{2},\dots,e_{N}\}\in[M]^{N} . In multi-environment learning, the goal is to enhance traditional ERM methods by exploiting both the commonalities and disparities across diverse environments. To this end, the dynamics is decomposed into two components: a global component shared across all environments, parameterized by \theta , and an environment-specific component, parameterized by \phi_{e} for each environment e . The set of environment-specific parameters is denoted

Read the complete text