Learning Permutation-invariant Macroscopic Dynamics
Zhichao Han, Mengyi Chen, Qianxiao Li · 2026
Read Learning Permutation-invariant Macroscopic Dynamics by Zhichao Han, Mengyi Chen, Qianxiao Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30812.txt.
Introduction
Han, Chen, and Li model large-scale motion of tiny systems, where the state is inherently unordered, as in particle systems. Many approaches learn a latent state through an autoencoder trained for reconstruction, assuming an ordering of microscopic degrees of freedom. The authors adopt a permutation-invariant encoder and design the decoder to reconstruct mass distribution at observed points. They jointly learn dynamics of observables and latent states. The method proves effective and robust. Examples include energy dynamics in particle systems, mixing in fluids, and stretching from polymer video data.
Catalog record
| CREATOR | Zhichao Han, Mengyi Chen, Qianxiao Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57245 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30812
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Permutation-invariant Macroscopic Dynamics Zhichao Han, Mengyi Chen, Qianxiao Li Abstract Accurately modeling the macroscopic dynamics of high-dimensional microscopic systems is of broad interest across the sciences. Many data-driven approaches learn a low-dimensional latent state through an autoencoder trained for pointwise input reconstruction. These methods typically assume a fixed ordering of microscopic degrees of freedom in the input. However, in many settings, such as particle systems, the microscopic state is inherently unordered. This motivates an autoencoder framework that learns permutation-invariant latent representations. To this end, we adopt a permutation-invariant encoder and design the decoder to reconstruct the mass distribution centered at the observed points rather than per-sample reconstruction. We then jointly learn the macroscopic dynamics of the observables together with the latent states. We demonstrate the effectiveness and robustness of the proposed method across a range of microscopic settings, including learning the energy dynamics in interacting particle systems, predicting mixing dynamics in Lennard–Jones fluids, and modeling the stretching dynamics from video data of polymers moving in an elongational force field. Figure 1 : Existing and desired autoencoder for learning closure variables. (a) Standard autoencoder to learn the latent \hat{\bm{z}} . Microstate X is represented by a vector based on the ordering. The encoder \hat{\bm{\varphi}} and decoder \bm{\psi} are typically implemented as MLPs. (b) The desired autoencoder to learn \hat{\bm{z}} . The model should preduce a permutation-invariant latent variable \hat{\bm{z}} for inputs that lack the canonical ordering. 1 Introduction Given high-dimensional microscopic observations of a physical system, accurately modeling its macroscopic dynamics is of broad interest across disciplines ( 18 ) . A central challenge is to construct a closed macroscopic model: the evolution of macroscopic quantities depends on microscopic degrees of freedom, and we therefore seek closure variables that encode the microscopic information. Recent data-driven approaches leverage neural networks to automatically discover low-dimensional descriptions that serve as closure variables. These methods have achieved notable success for many scientific applications, including learning reduced thermodynamic coordinates and predicting stretching length dynamics of polymers ( 12 ) , discovering slow collective variables and reduced kinetic models for molecular conformational dynamics ( 50 ; 34 ) , and learning macroscopic internal variables for history-dependent heterogeneous materials ( 33 ) . Most existing approaches learn closure variables using an autoencoder trained to minimize the pointwise reconstruction loss. The encoder and decoder are typically parameterized by the Multilayer Perceptron (MLP) ( 12 ; 9 ) or Convolutional Neural Network (CNN) ( 29 ) , assuming that the microscopic degrees of freedom admit a fixed ordering to be represented as vectors or tensors (Fig. 1 (a)). However, many physical systems have no intrinsic ordering, such as a set of interacting particles. The desired closure variable must be permutation-invariant with respect to the input (Fig. 1 (b)). Applying existing methods, which require a canonical ordering on the input, can be prohibitively difficult in practice. This gap arises because the autoencoders parameterized by MLP or CNN are not symmetric to permutation. The input and output are both indexed by an ordering, and the usual pointwise reconstruction loss fixes an index-by-index correspondence. Consequently, the learned latent vector encodes the input information with a specific ordering, and can change when the same microstate is presented under a different permutation. One may consider adopting models for sets (e.g., DeepSet ( 57 ) or Set Transformer ( 27 ) ) as the encoder to produce a permutation-invariant latent variable. Yet, a fundamental difficulty remains on the decoding side: without a specified ordering, there is no natural mechanism to reconstruct the microstate from a single low-dimensional embedding using an index-wise loss. For instance, consider a microstate \{{\bm{x}}^{i}\}_{i=1}^{N} with N=3 particles. If a decoder is trained with a pointwise MSE loss to output an ordered list (\hat{{\bm{x}}}^{1},\ldots,\hat{{\bm{x}}}^{N}) , the loss will penalize (\hat{{\bm{x}}}^{1},\hat{{\bm{x}}}^{2},\hat{{\bm{x}}}^{3}) and (\hat{{\bm{x}}}^{3},\hat{{\bm{x}}}^{2},\hat{{\bm{x}}}^{1}) differently, even though they correspond to the same physical configuration. Crucially, the number of such physically equivalent permutations scales as N! . Therefore, training often relies on explicit matching ( 58 ; 39 ) or permutation-invariant losses ( 1 ; 54 ) ; both add substantial computational cost ( 35 ) and may introduce optimization instability ( 30 ; 43 ) . To overcome this difficulty, we propose an alternative reconstruction objective for closure modeling. Rather than reconstructing the microscopic degrees of freedom directly, we reconstruct their distribution. Concretely, we induce a mass distribution concentrated at the observed points, and train the decoder to reconstruct this density from the latent representation. This distributional reconstruction eliminates the need to align individual points or impose an ordering, thereby enabling learning of permutation-invariant latent variables. The learned latent variable summarizes the input distribution and serves as closure variables for modeling macroscopic dynamics. Our contributions can be summarized as follows. • We propose a novel strategy for closure modeling that trains an autoencoder to reconstruct the distributional information instead of pointwise reconstruction. • We demonstrate the effectiveness and robustness of the proposed approach across multiple microscopic settings, including learning the energy dynamics of interacting particle systems, the mixing dynamics of Lennard–Jones fluid and predicting the stretching dynamics of polymers from videos. 2 Related Work Learning Reduced Dynamics Reduced-order models (ROMs) and closure modeling approximate high-dimensional dynamical systems using low-dimensional latent variables and learn latent dynamics, often with the goal of improving computational efficiency ( 42 ; 3 ) . ROMs typically aim to approximate the full-order state by evolving latent variables and decoding them back to the full-order space ( 6 ; 28 ; 10 ) . In contrast, closure modeling targets accurately modeling the dynamics of selected macroscopic observables and, in principle, does not have to reconstruct the full-order state ( 41 ; 12 ; 4 ) . Nevertheless, many data-driven closure approaches adopt a reconstruction objective to learn closure coordinates. The reconstruction loss offers a convenient objective that enforces the latent variables to encode microstate information and regularizes the latent variable ( 7 ; 12 ; 49 ; 60 ) . Accordingly, existing closure modeling methods often consist of two components: (i) an autoencoder for discovery of closure variables trained with a reconstruction loss and (ii) a reduced dynamical model for predicting the latent dynamics ( 7 ; 12 ; 49 ; 60 ) . Our method belongs to closure modeling, as we focus on modeling the dynamics of macroscopic quantities and leverage a reconstruction-based objective to learn closure variables. Prior work has mainly focused on dynamical systems whose state variables have a fixed indexing, such as discretized partial differential equation (PDE) solutions on grids ( 7 ; 36 ; 10 ) . However, these methods are not directly applicable when the microstate has no canonical ordering. Our method addresses this challenge through a permutation-invariant architecture and a newly designed permutation-invariant training objective. Learning Permutation-invariant Representations for Sets General machine learning models have been proposed to learn permutation-invariant representations of sets. Classic examples include pooling-based architectures such as DeepSet ( 57 ) and PointNet ( 37 ) , as well as attention-based models such as the Set Transformer ( 27 ) . In our model, we adopt their architecture as the encoder. Unlike many previous works that use set encoders as standalone modules for supervised prediction ( 57 ; 27 ; 22