UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representations
Hanjung Kim Jaehyun Kang Hyolim Kang Meedeum Cho Seon Joo Kim Youngwoon Lee [0.3cm] Yonsei University[0.3cm] https://kimhanjung.github.io/UniSkill · 2025
Read UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representations by Hanjung Kim Jaehyun Kang Hyolim Kang Meedeum Cho Seon Joo Kim Youngwoon Lee [0.3cm] Yonsei University[0.3cm] https://kimhanjung.github.io/UniSkill (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08787.txt.
Description
People learn new skills by watching others, but a robot's body differs so much from a human's that copying is hard. Hanjung Kim and five co-authors present UniSkill in a 2025 paper, a framework that learns skills in a form both bodies can share. Earlier methods needed matched human and robot recordings of the same scenes, which are costly to gather at scale.
UniSkill instead learns from large piles of unlabeled cross-embodiment video. It pulls out skill representations that ignore which body performs them. A short human video prompt can then steer a robot policy that was trained only on robot data. Tests in simulation and on real robots show the shared skills guide apt actions, even for prompts the system had not seen. The approach points to teaching robots from the vast store of human video online.
Catalog record
| CREATOR | Hanjung Kim Jaehyun Kang Hyolim Kang Meedeum Cho Seon Joo Kim Youngwoon Lee [0.3cm] Yonsei University[0.3cm] https://kimhanjung.github.io/UniSkill |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08787