ViSA-Flow: Accelerating Robot Skill Learning via Large-Scale Video Semantic Action Flow

Changhe Chen, Quantao Yang, Xiaohao Xu, Nima Fazeli, Olov Andersson · 2025

Read ViSA-Flow: Accelerating Robot Skill Learning via Large-Scale Video Semantic Action Flow by Changhe Chen, Quantao Yang, Xiaohao Xu, Nima Fazeli, Olov Andersson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01288.txt.

Description

Robots learn manipulation slowly because demonstrations are expensive, while humans learn by watching. Changhe Chen and co-authors built ViSA-Flow in 2025 to let robots learn from vast unlabeled human videos.

Their key representation, semantic action flow, captures how hands and objects move together over time, stripped of surface appearance. A generative model first learns this flow from large-scale human-object videos. A small set of robot demonstrations then adapts the model to a real machine. On a standard benchmark and real tasks, the method led the field, above all when robot data were scarce. Knowledge, it seems, transfers across the human-robot gap.

Catalog record

CREATORChanghe Chen, Quantao Yang, Xiaohao Xu, Nima Fazeli, Olov Andersson
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-01288

Browse the full library · About the Tower of Babel