Cross-Embodiment Robotic Manipulation Synthesis via Guided Demonstrations through CycleVAE and Human Behavior Transformer

Apan Dastider, Hao Fang, Mingjie Lin · 2025

Read Cross-Embodiment Robotic Manipulation Synthesis via Guided Demonstrations through CycleVAE and Human Behavior Transformer by Apan Dastider, Hao Fang, Mingjie Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08622.txt.

Description

Apan Dastider, Hao Fang, and Mingjie Lin wrote a paper from 2025 on teaching a robot a new body by watching human experts. A motion learned by one machine rarely transfers to a machine with a different shape, and paired training data across bodies is scarce. Hand-building controllers for each body is slow and intricate. Their approach learns from human demonstrations instead, then translates the motion.

An unsupervised translation model first aligns the hidden motion patterns of human and robot sequences, using a two-way subspace method. A transformer then learns the inner dynamics of expert human motion. At run time, the transformer dreams up a fresh expert-style demonstration for the new task. The translator maps that dream onto the robot's body. In tests with a dexterous arm and hand, the pipeline produced smooth paths for intricate tasks. It beat past learning-based planners on the same jobs.

Catalog record

CREATORApan Dastider, Hao Fang, Mingjie Lin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-08622

Browse the full library · About the Tower of Babel