UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representations

Hanjung Kim Jaehyun Kang Hyolim Kang Meedeum Cho Seon Joo Kim Youngwoon Lee [0.3cm] Yonsei University[0.3cm] https://kimhanjung.github.io/UniSkill · 2025

Read UniSkill: Imitating Human Videos via Cross-Embodiment Skill Representations by Hanjung Kim Jaehyun Kang Hyolim Kang Meedeum Cho Seon Joo Kim Youngwoon Lee [0.3cm] Yonsei University[0.3cm] https://kimhanjung.github.io/UniSkill (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08787.txt.

Description

People learn new skills by watching others, but a robot's body differs so much from a human's that copying is hard. Hanjung Kim and five co-authors present UniSkill in a 2025 paper, a framework that learns skills in a form both bodies can share. Earlier methods needed matched human and robot recordings of the same scenes, which are costly to gather at scale.

UniSkill instead learns from large piles of unlabeled cross-embodiment video. It pulls out skill representations that ignore which body performs them. A short human video prompt can then steer a robot policy that was trained only on robot data. Tests in simulation and on real robots show the shared skills guide apt actions, even for prompts the system had not seen. The approach points to teaching robots from the vast store of human video online.

Catalog record

CREATORHanjung Kim Jaehyun Kang Hyolim Kang Meedeum Cho Seon Joo Kim Youngwoon Lee [0.3cm] Yonsei University[0.3cm] https://kimhanjung.github.io/UniSkill
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-08787

Browse the full library · About the Tower of Babel