Motion Tracks : A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learning

Juntao Ren, Priya Sundaresan, Dorsa Sadigh, Sanjiban Choudhury, Jeannette Bohg · 2025

Read Motion Tracks : A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learning by Juntao Ren, Priya Sundaresan, Dorsa Sadigh, Sanjiban Choudhury, Jeannette Bohg (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-06994.txt.

Description

Juntao Ren and four co-authors present in 2025 a way for robots to learn skills from ordinary human videos, using very few examples. Teaching robots by demonstration usually means hours of remote-controlled robot practice, while human videos are everywhere but carry no robot action labels.

Their answer is motion tracks: short two-dimensional paths drawn on the image that show where things should move next. Human hands and robot grippers can both be described this way, giving one shared language for action. A policy trained on motion tracks can then carry a human demonstration over to a real robot arm.

Catalog record

CREATORJuntao Ren, Priya Sundaresan, Dorsa Sadigh, Sanjiban Choudhury, Jeannette Bohg
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-06994

Browse the full library · About the Tower of Babel