Learning Deformable Body Interactions With Adaptive Spatial Tokenization
Hao Wang, Yu Liu, Daniel Biggs, Haoru Wang, Jiandong Yu, Ping Huang · 2025
Read Learning Deformable Body Interactions With Adaptive Spatial Tokenization by Hao Wang, Yu Liu, Daniel Biggs, Haoru Wang, Jiandong Yu, Ping Huang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13707.txt.
Introduction
Hao Wang and co-authors sim soft-body clashes by cast of the space as grid cells that feed care nets. The work dates to 2025. Soft clashes drive work in stuff fields, design, and bots. Graph nets learn such runs well, yet pair links cross all nodes cost too much at scale.
Their form lays the raw mesh on a cell grid, which groups near nodes by place. A cross-care step packs the sparse cells in a fixed set of marks. Self-care steps then call the next state in that mark space. Tests beat top past tools, and the form held on meshes past one hundred thousand nodes.
Catalog record
| CREATOR | Hao Wang, Yu Liu, Daniel Biggs, Haoru Wang, Jiandong Yu, Ping Huang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-13707
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Deformable Body Interactions With Adaptive Spatial Tokenization Hao Wang, Yu Liu, Daniel Biggs, Haoru Wang, Jiandong Yu, Ping Huang Abstract Simulating interactions between deformable bodies is vital in fields like material science, mechanical design, and robotics. While learning-based methods with Graph Neural Networks (GNNs) are effective at solving complex physical systems, they encounter scalability issues when modeling deformable body interactions. To model interactions between objects, pairwise global edges have to be created dynamically, which is computationally intensive and impractical for large-scale meshes. To overcome these challenges, drawing on insights from geometric representations, we propose an Adaptive Spatial Tokenization (AST) method for efficient representation of physical states. By dividing the simulation space into a grid of cells and mapping unstructured meshes onto this structured grid, our approach naturally groups adjacent mesh nodes. We then apply a cross-attention module to map the sparse cells into a compact, fixed-length embedding, serving as tokens for the entire physical state. Self-attention modules are employed to predict the next state over these tokens in latent space. This framework leverages the efficiency of tokenization and the expressive power of attention mechanisms to achieve accurate and scalable simulation results. Extensive experiments demonstrate that our method significantly outperforms state-of-the-art approaches in modeling deformable body interactions. Notably, it remains effective on large-scale simulations with meshes exceeding 100,000 nodes , where existing methods are hindered by computational limitations. Additionally, we contribute a novel large-scale dataset encompassing a wide range of deformable body interactions to support future research in this area. 1 Introduction Solving interactions between deformable bodies plays a vital role in a wide range of applications, including material science [ 6 , 2 ] , mechanical design [ 26 , 35 ] , and robotics [ 4 ] . The finite element method (FEM) is a widely used numerical approach for addressing such problems [ 5 ] . However, FEM typically incurs high computational costs and requires significant manual effort from engineers to ensure solver stability and convergence [ 7 ] . Recently, there has been growing interest in leveraging learning-based methods to address deformable body simulation. MeshGraphNet (MGN) and related approaches [ 20 , 24 , 9 ] represent unstructured meshes as graphs and employ stacked message-passing blocks to propagate physical information across the mesh. Subsequent variants have introduced various graph pooling operations and U-Net-like architectures [ 17 , 7 , 3 ] to solve the multi-scale challenges in different simulation tasks. To model interactions between distinct deformable bodies, these methods typically construct dynamic edges based on the proximity of mesh nodes [ 20 , 32 ] . However, maintaining global pairwise edges across all mesh nodes becomes a significant computational bottleneck, limiting the scalability of such models to larger or more complex scenes. Rubanova et al. [ 23 ] proposed to use 3D implicit representations like Signed Distance Function (SDF) for more efficient collision detection, but it has to be built on the solid body prior. Methods such as GraphCast [ 14 ] propose creating a background grid to which the mesh is attached, enabling more efficient message passing. However, this effectively converts an unstructured mesh into a structured one, which can work well for simple, regular geometries such as spheres. When applied to complex shapes, however, this approach may suffer from reduced accuracy and efficiency. Transformer-based models such as HCMT [ 32 ] propose using two sets of attention blocks to model contacts and collisions between deformable objects. However, the attention matrices are constructed over mesh nodes and global edges, resulting in high memory consumption. This makes the approach computationally prohibitive when scaling to larger meshes. Recent advances in computer vision [ 8 , 22 , 15 ] and computer geometry [ 33 , 16 ] have shown that applying learnable tokenization to raw input signals is critical for downstream understanding and generation tasks. In computer vision [ 8 , 22 ] , input images are typically divided into patches, which are then mapped via linear layers to patch embeddings. These embeddings, along with added positional information, are processed further using token-wise operations. Similarly, in geometric tasks, 3D shapes—represented as meshes, point clouds, or signed distance functions (SDFs)—are typically embedded into compact latent representations before being passed to downstream components [ 34 , 16 ] . These approaches inspired us to design an effective tokenization strategy for physical states in simulation, where the state can be viewed as a set of vector fields defined over a given 3D geometry. In this work, we introduce Adaptive Spatial Tokenization (AST) , a novel method for encoding diverse physical states into fixed-length embeddings. We begin by quantizing the spatial domain into a grid of cells, effectively mapping the unstructured mesh onto a structured spatial partition. To manage this representation efficiently, we also provide the option to use an octree-like hierarchical indexing system for scalable storage and fast lookup. As showed in Figure 1 , in our proposed representation, adjacent mesh nodes are naturally grouped into shared cells, enabling structured local interactions. We then apply sparse convolution to propagate information between cells, allowing inter-object interactions to emerge naturally. This approach eliminates the need for explicitly constructing costly pairwise global edges, which is a common bottleneck in prior graph-based methods. Inspired by the use of cross-attention in Transformer architectures and its success in 3D shape representation [ 33 , 16 ] , we design a cross-attention module that queries features from the quantized sparse cells using compact, fixed-length vectors—our adaptive spatial tokens. These tokens are then processed in latent space using a Transformer-style network composed of a series of self-attention layers , enabling next-step prediction of the physical state. We conduct extensive experiments across various scenarios involving deformable body interactions. Our method consistently outperforms state-of-the-art baselines, particularly in modeling inter-object interactions. Furthermore, in large-scale simulations involving meshes with over 100,000 nodes —where most existing methods fail due to memory constraints—our approach continues to produce accurate and stable predictions. Our primary contributions can be summarized as follows: 1. We propose Adaptive Spatial Tokenization (AST) to efficiently represent physical states in simulation. 2. We develop an attention-based model that operates on spatial tokens in latent space to simulate interactions between deformable bodies. 3. Our method achieves significant improvements over state-of-the-art baselines, particularly in modeling complex object interactions. 4. We introduce a novel large-scale dataset featuring diverse deformable body interactions for benchmarking. Figure 1: Spatial Cells for interactions. 2 Related Work In recent years, solving physics simulation with learning based methods have been an active research area. One of the most representative work is MGN [ 20 ] , in which mesh data with physical states is treated as graph. It adopts Encode-Process-Decode architecture [ 24 ] , stacking multiple message passing layers as the core processing module to propagate the physics information through the graph. Several variants, such as BSMS [ 3 ] , MAgNET [ 7 ] , and GNN-U-Net [ 10 ] , introduce enhancements including virtual edges, graph pooling, and U-Net structures to improve computational efficiency and handle long-range interactions. To simulate interactions between objects, these methods typically construct dynamic world edges by connecting spatially close mesh nodes across objects at each time step. FIGNet [ 1 ] extends this