Cross-Embodiment Robotic Manipulation Synthesis via Guided Demonstrations through CycleVAE and Human Behavior Transformer
Apan Dastider, Hao Fang, Mingjie Lin · 2025
Read Cross-Embodiment Robotic Manipulation Synthesis via Guided Demonstrations through CycleVAE and Human Behavior Transformer by Apan Dastider, Hao Fang, Mingjie Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08622.txt.
Description
Apan Dastider, Hao Fang, and Mingjie Lin wrote a paper from 2025 on teaching a robot a new body by watching human experts. A motion learned by one machine rarely transfers to a machine with a different shape, and paired training data across bodies is scarce. Hand-building controllers for each body is slow and intricate. Their approach learns from human demonstrations instead, then translates the motion.
An unsupervised translation model first aligns the hidden motion patterns of human and robot sequences, using a two-way subspace method. A transformer then learns the inner dynamics of expert human motion. At run time, the transformer dreams up a fresh expert-style demonstration for the new task. The translator maps that dream onto the robot's body. In tests with a dexterous arm and hand, the pipeline produced smooth paths for intricate tasks. It beat past learning-based planners on the same jobs.
Catalog record
| CREATOR | Apan Dastider, Hao Fang, Mingjie Lin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-08622