Motion Tracks : A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learning
Juntao Ren, Priya Sundaresan, Dorsa Sadigh, Sanjiban Choudhury, Jeannette Bohg · 2025
Read Motion Tracks : A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learning by Juntao Ren, Priya Sundaresan, Dorsa Sadigh, Sanjiban Choudhury, Jeannette Bohg (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-06994.txt.
Description
Juntao Ren and four co-authors present in 2025 a way for robots to learn skills from ordinary human videos, using very few examples. Teaching robots by demonstration usually means hours of remote-controlled robot practice, while human videos are everywhere but carry no robot action labels.
Their answer is motion tracks: short two-dimensional paths drawn on the image that show where things should move next. Human hands and robot grippers can both be described this way, giving one shared language for action. A policy trained on motion tracks can then carry a human demonstration over to a real robot arm.
Catalog record
| CREATOR | Juntao Ren, Priya Sundaresan, Dorsa Sadigh, Sanjiban Choudhury, Jeannette Bohg |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-06994