Lightweight Learning from Actuation-Space Demonstrations via Flow Matching for Whole-Body Soft Robotic Grasping

Liudi Yang, Yang Bai, Yuhao Wang, Ibrahim Alsarraj, Gitta Kutyniok, Zhanchi Wang*, Ke Wu* · 2025

Read Lightweight Learning from Actuation-Space Demonstrations via Flow Matching for Whole-Body Soft Robotic Grasping by Liudi Yang, Yang Bai, Yuhao Wang, Ibrahim Alsarraj, Gitta Kutyniok, Zhanchi Wang*, Ke Wu* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01770.txt.

Introduction

Liudi Yang and six colleagues teach a soft robot to grasp with its whole body. Rigid hands, stiff and sparsely jointed, need heavy sensing and control to handle uncertain contact. A soft robot's flexible, underactuated body instead conforms passively to objects; the challenge is converting that mechanical intelligence into control.

Their framework learns directly in actuation space from demonstrations, using a flow matching model, specifically rectified flow, to infer a distribution of control signals, with no dense sensing or heavy feedback loops. From only 30 demonstrations, under 8 percent of the reachable workspace, the learned policy grasped successfully in 97.5 percent of trials across the whole workspace. It tolerated object size changes of about a third and stayed stable when execution speed was scaled from a fifth to double.

Catalog record

CREATORLiudi Yang, Yang Bai, Yuhao Wang, Ibrahim Alsarraj, Gitta Kutyniok, Zhanchi Wang*, Ke Wu*
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-01770

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lightweight Learning from Actuation-Space Demonstrations via Flow Matching for Whole-Body Soft Robotic Grasping Liudi Yang, Yang Bai, Yuhao Wang, Ibrahim Alsarraj, Gitta Kutyniok, Zhanchi Wang*, Ke Wu* Abstract Robotic grasping under uncertainty remains a fundamental challenge due to its uncertain and contact-rich nature. Traditional rigid robotic hands, with limited degrees of freedom and compliance, rely on complex model-based and heavy feedback controllers to manage such interactions. Soft robots, by contrast, exhibit embodied mechanical intelligence: their underactuated structures and passive flexibility of their whole body, naturally accommodate uncertain contacts and enable adaptive behaviors. To harness this capability, we propose a lightweight actuation-space learning framework that infers distributional control representations for whole-body soft robotic grasping, directly from deterministic demonstrations using a flow matching model (Rectified Flow), without requiring dense sensing or heavy control loops. Using only 30 demonstrations (less than 8% of the reachable workspace), the learned policy achieves a 97.5% grasp success rate across the whole workspace, generalizes to grasped-object size variations of ±33%, and maintains stable performance when the robot’s dynamic response is directly adjusted by scaling the execution time from 20% to 200%. These results demonstrate that actuation-space learning, by leveraging its passive redundant DOFs and flexibility, converts the body’s mechanics into functional control intelligence and substantially reduces the burden on central controllers for this uncertain-rich task. I Introduction Robotic grasping under uncertainty remains a central challenge due to its uncertain and contact-rich nature [ 1 ] . These tasks involve high-dimensional, nonlinear, and uncertain dynamics, making them inherently difficult to model and control [ 2 ] . Traditional rigid robotic hands, with limited degrees of freedom and low compliance, often exhibit poor adaptability and safety when interacting under such conditions. Soft robots, by contrast, embody mechanical intelligence [ 3 ] : their intrinsic redundancy, flexibility, and compliance of their whole body, allow them to passively absorb uncertainty, enabling safe and adaptive physical interaction while reducing reliance on precise centralized control [ 4 ] . Despite these morphological advantages, developing motion planning and control strategies for soft robots remains challenging [ 5 ] . Their dynamics are high-dimensional and history-dependent, while uncertain contacts resulting from friction [ 6 ] , material fatigue [ 7 ] , and geometric constraints [ 8 ] further complicate both planning and real-time control. Existing approaches on the control of soft robots can be broadly categorized into model-based [ 5 ] and learning-based methods [ 9 ] . Model-based control relies on explicit physical formulations, ranging from piecewise constant curvature (PCC) models [ 10 ] and pseudo–rigid-body approximations [ 8 ] , to geometrically nonlinear beam and rod theories [ 11 , 12 ] , and finite-element or solid-mechanics-based approaches [ 13 , 14 ] . These controllers offer interpretable descriptions of soft-body mechanics and can often guarantee stability or convergence. However, their practical deployment is hindered by high modeling complexity [ 11 , 12 ] , computationally expensive inverse solutions [ 13 ] , and large sim-to-real discrepancies arising from material and contact uncertainties [ 15 , 16 ] . Consequently, purely model-based control remains difficult to scale and lacks robustness when dealing with unmodeled deformations or uncertain interactions. In contrast, learning-based control circumvents explicit modeling by leveraging data [ 9 ] . Artificial neural networks (ANNs) have been widely adopted in soft robotics for tasks such as kinematics, dynamics, and state estimation [ 17 ] . For instance, ANNs have been used to approximate the inverse statics of cable-driven soft arms [ 18 ] , to model forward dynamics for predictive control [ 19 ] , and to implement imitation learning policies for soft robotic hands trained from human demonstrations [ 20 ] . With their universal function approximation capability [ 21 ] , ANNs can capture nonlinear dynamics directly from data without explicit physical models. However, their accuracy and generalization strongly depend on the amount and quality of training data, and limited demonstrations often constrain their robustness and adaptability [ 22 ] . While this suffices for low-level tasks [ 9 ] , these methods generally fail to cope with robotic manipulation scenarios involving strong dynamics and significant uncertainty [ 23 ] . To move beyond supervised imitation, reinforcement learning (RL) has been explored as an alternative that enables autonomous exploration and policy optimization [ 24 ] . In soft robotics, RL has been demonstrated in locomotion and basic trajectory tracking, such as soft snake robots [ 25 ] and continuum arms [ 19 , 26 ] , yet applications to whole-body grasping remain scarce [ 17 ] . Although RL can theoretically surpass expert demonstrations, it is notoriously sample inefficient, requires carefully engineered rewards, and poses safety risks on hardware [ 7 , 24 ] . More recently, Diffusion Policy (DP)has achieved impressive performance in rigid robot visuomotor control, modeling multimodal action distributions and handling high-dimensional spaces [ 27 ] . Extensions include on-device diffusion transformers [ 28 ] , hierarchical policies for multi-task manipulation [ 29 ] , and 3D visual representations [ 30 ] . Despite their success, diffusion-based methods require multi-step denoising at inference, introducing latency and significant computational cost [ 27 ] . Such precise and high-frequency closed-loop corrections may not align with the nature of soft robots, which inherently exhibit nonlinearities, uncertain contacts, and history dependence [ 3 , 6 ] . In soft robotic systems, embodied mechanical intelligence, arising from redundancy, flexibility, and compliance, already absorbs part of the uncertainty [ 3 , 4 ] , suggesting that increasingly heavy computation may not yield proportional benefits. Fig. 1: Learning from Actuation-Space Demonstration for Grasping. A. SpiRob. B. Distinction in LfD schemes between rigid and soft robots. These observations motivate a lightweight distributional control framework that generates robust patterns, preserves multimodality, and leverages the embodied mechanical intelligence of soft robots to handle uncertainty. A natural solution is Learning from Demonstrations (LfD), since expert demonstrations inherently encode feasible and multimodal strategies without requiring explicit modeling or reward design [ 31 ] . Performing such learning in actuation space may better exploit the robot’s passive flexibility and redundancy, providing a potential pathway for embodied intelligence to emerge through coordinated actuation behaviors. Building on this idea, we propose a lightweight framework for Learning from actuation-space demonstrations that learns control distributions directly aligned with the soft robot’s physical characteristics. Within this framework, we employ the Rectified Flow (RF) model [ 32 ] , a flow-matching generative approach that efficiently learns control distributions with minimal sampling [ 33 ] . We validate the proposed approach on a spiral-shaped soft robot (SpiRob) [ 8 ] , performing whole-body grasping under uncertainty. The policy, trained with only 30 demonstrations covering less than 8% of the reachable workspace, achieved a 97.5% grasp success rate across the workspace. It also generalized to objects with size variations of \pm 33% and maintained stable grasping performance when the execution duration was scaled between 20% and 200%, demonstrating robust adaptability under uncertainty. The contributions are summarized as follows: • Framework. A lightweight framework for Learning from actuation-space demonstrations that couples the embodied mechanical intelligence of soft robots with distributional learning to handle uncertainty. • Method. A concrete implementation using the Rectified Flow model, enabling efficient distributional control

Read the complete text