DeformGen: Dynamics-Based Topology Augmentation for Deformable Manipulation Policy Learning
2026
Read DeformGen: Dynamics-Based Topology Augmentation for Deformable Manipulation Policy Learning (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25939.txt.
Introduction
DeformGen comes from a joint robotics effort. Its listed sites include Shanghai Jiao Tong University, Tsinghua University, and the Hong Kong Polytechnic University. The problem is teaching robots to handle soft, deformable objects by imitation. Augmenting demonstrations the usual way fails here: valid poses of a deforming object cannot be reached by small rigid shifts, and a copied trajectory does not follow material points as they move.
Two mechanisms solve the two halves of that problem. Small physical disturbances come first. Forward simulation of the dynamics then yields new plausible states with changed topology. Deformation-field warping then adapts the original manipulation trajectory to each new shape, lifting per-particle motion into a smooth spatial field. On demanding deformable test tasks, policies trained with the added data learn better. They beat policies trained on the raw demonstrations alone. They also beat rigid-style augmentation.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.25939
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DeformGen: Dynamics-Based Topology Augmentation for Deformable Manipulation Policy Learning Abstract Demonstration augmentation is proposed for cost-efficient data acquisition, but existing methods are fundamentally limited in deformable manipulation due to two challenges: (1) the state space is high-dimensional with physics-induced constraints, making valid configurations impossible to reach via low-dimensional pose perturbations; and (2) trajectory transfer is non-equivariant, as material points no longer move rigidly together under deformation. We present DeformGen , a dynamics-based augmentation framework that achieves topological diversity for deformable objects. For the state challenge, DeformGen expands the valid state distribution by applying localized physical disturbances and forward-simulating the dynamics to obtain topology-coherent, physically plausible deformable states. For the trajectory challenge, DeformGen transfers source manipulation trajectories via deformation-field warping, which lifts per-particle displacements into a continuous spatial function to adapt the end-effector trajectory consistently with the deformed geometry. In this way, our method jointly augments the state distribution and its associated manipulation behavior. Experiments on high-fidelity deformable manipulation benchmarks show that DeformGen generally improves policy learning compared with training on the original demonstrations alone and with rigid-style augmentation baselines. 1]Shanghai Jiao Tong University 2]Eastern Institute of Technology, Ningbo 3]Tsinghua University 4]The Hong Kong Polytechnic University 5]University of Science and Technology of China 6]Zhongguancun Academy \contribution [†]Project Lead \contribution [ 🖂 ]Corresponding author \metadata [Project Page] https://zili2002.github.io/DeformGen \metadata [Github] https://github.com/Zili2002/DeformGen Figure 1 : Top: We identify two core challenges – the state-space challenge and the trajectory-transfer challenge – that prevent rigid-style augmentation from extending to deformable manipulation. DeformGen addresses them through dynamics-based topology transformation and deformation-field warping. Bottom: Starting from a single demonstration, DeformGen synthesizes diverse demonstrations across deformable states, leading to improved policy generalization to unseen states. 1 Introduction Imitation learning and visuomotor policy learning have shown remarkable success in robot manipulation, enabling policies to conduct various tasks across diverse environments [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 ] . However, this progress has been driven in large part by access to large-scale, diverse demonstration data, whose collection remains expensive, time-consuming, and difficult to scale. To mitigate this bottleneck, a data augmentation paradigm has emerged: rather than collecting or synthesizing more demonstrations [ 10 ] , these methods typically augment a single human demonstration to many training trajectories [ 11 , 12 , 13 , 14 ] . This idea is based on the simple but powerful equivariant assumption : rigid bodies satisfy the equivariant constraint that the Euclidean distance between any two material points is invariant under motion or contact forces. With the same rigid transformation applied to the end-effector, the relative pose between it and the object is preserved, leading to a valid trajectory. This augmentation paradigm, however, is fundamentally mismatched to deformable object manipulation [ 15 , 16 ] . As illustrated in Fig. 1 , we identify two core challenges that break the rigid-object recipe. State-Space Challenge(Fig. 1 (a)): (i) High degrees of freedom. For rigid bodies, a 6-DoF pose provides a sufficient state abstraction. Deformable objects, in contrast, exhibit rich, high-dimensional shape and topology variations [ 17 , 18 ] . As a result, rigid transformations alone cannot meaningfully expand the valid state distribution required for deformable manipulation. (ii) Dynamic constraint. For rigid and articulated objects, valid perturbations can be constructed directly in pose or joint space via kinematic constraints. For deformable objects, however, internal constraints are dynamic, which means the deformation depends on the interaction between internal particles; therefore, naive geometric perturbations typically yield implausible shapes and discontinuous structural changes. Trajectory-Transfer Challenge(Fig. 1 (b)): The equivariant assumption no longer holds for deformable objects: material points are not equivariant [ 15 ] . Consequently, directly applying a global rigid isometry to augment the trajectories for topological variants of deformable objects introduces two problems: (i) the grasp pose becomes misaligned with the object’s local geometry, so the end-effector can no longer grip the object correctly; and (ii) a rigid-style trajectory transfer can only translate and rotate the trajectory as a whole, and cannot capture or compensate for the object’s local deformation. These challenges suggest that effective augmentation for deformable manipulation must jointly address two problems: synthesizing physically valid deformable states and transferring demonstrations in a deformation-aware manner. To this end, we propose DeformGen , a dynamics-based topology data augmentation framework for deformable manipulation. Unlike prior rigid augmentation methods that are confined to SE(3) perturbations and thus only produce spatial diversity, DeformGen achieves effective topological diversity for deformable objects by jointly synthesizing physically valid deformed states and transferring demonstrations in a deformation-aware manner. Specifically, for the state-space challenge, the key insight is that physically plausible states form a constrained manifold within the high-dimensional particle state space, and naive geometric perturbations almost always fall off this manifold. Therefore, we propose Dynamic Topological Transformation to augment the state distribution by applying randomized, spatially localized forces to the object and forward-simulating the resulting dynamics to prevent leaving the valid manifold. These augmented assets can be used both to enrich the support of training demonstrations and to broaden policy evaluation beyond the narrow state distribution covered by the original data. In response to the trajectory-transfer challenge, DeformGen transfers source demonstrations to each augmented state via Deformation-Field Warping . We compute per-particle displacements between the source and target object states and lift them, through K -nearest-neighbor inverse-distance interpolation, into a continuous deformation field D(\mathbf{x}) over the workspace. Applying D to the demonstration trajectory simultaneously re-orients the gripper pose according to local geometric changes near the grasp region and compensates the global trajectory to remain aligned with the deformed object as a whole. A single demonstration then can be reused across an entire family of deformable states without breaking contact or violating the object’s physical structure(Fig. 1 (c)). As shown in Fig. 1 (d), we train policies on the resulting augmented dataset to improve generalization and robustness. Experiments on high-fidelity deformable manipulation benchmark [ 19 ] show that DeformGen generally improves policy learning: compared with training on the original demonstrations alone, or with rigid-style augmentation baselines, policies trained with DeformGen achieve higher success rates in most settings. These results suggest that effective augmentation for deformable manipulation requires dynamics-consistent state synthesis coupled with deformation-aware trajectory transfer, rather than rigid pose perturbation alone. The contributions of this work are three-fold: • Formulation of demonstration augmentation for deformable manipulation that identifies physically valid deformable state synthesis as the key missing ingredient beyond rigid-style augmentation. • A dynamics-consistent pipeline that generates topology-coherent deformable assets through localized perturbation, physics rollout, and stabilization, and synthesizes corresponding manipulation trajectories via deformation-field warping; • Extensive empirical evidence that the resulting synthetic demonstrations significantly improve policy learning, providing gains over both no augmentation and rigid-style augmentation baselines. 2 Related Works 2.1 Data augmentation for robot manipulation Unlike pipelines that generate demonstrations from scratch using planners [ 20 ] , generative models, or learned agents [ 21 , 22 , 23 ] , data augmentation expands an existing dataset through task-agnostic transformations [ 11 , 12 ] . Beyond appearance-only visual perturbations [ 24 , 25 ] , behavioral augmentation modifies object configurations and re-solves for task-successful trajectories, typically via physics-based planning [ 11 , 26 , 12 , 13 , 14