MARVL: Multi-Stage Guidance for Robotic Manipulation via Vision-Language Models

Xunlan Zhou, Xuanlin Chen, Shaowei Zhang, Xiangkun Li, ShengHua Wan, Xiaohai Hu, Yuan Lei, Le Gan, De-chuan Zhan · 2026

Read MARVL: Multi-Stage Guidance for Robotic Manipulation via Vision-Language Models by Xunlan Zhou, Xuanlin Chen, Shaowei Zhang, Xiangkun Li, ShengHua Wan, Xiaohai Hu, Yuan Lei, Le Gan, De-chuan Zhan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-15872.txt.

Description

Zhou and colleagues propose MARVL, vision-language models giving multi-stage guidance for robotic manipulation. Designing dense reward functions is key for efficient robotic reinforcement learning, yet most dense rewards still need manual engineering, which limits scalability and automation. Vision-language models look like a promising route to reward design, yet naive VLM rewards often drift from task progress, struggle with spatial grounding, and grasp task semantics only weakly.

MARVL first adjusts a VLM so it stays spatially and semantically consistent, then breaks tasks into multi-stage subtasks, using task direction projection to keep trajectories sensitive. On the Meta-World benchmark, MARVL beats existing VLM-reward methods by a wide margin, showing stronger sample efficiency and robustness when rewards are sparse in manipulation tasks.

Catalog record

CREATORXunlan Zhou, Xuanlin Chen, Shaowei Zhang, Xiangkun Li, ShengHua Wan, Xiaohai Hu, Yuan Lei, Le Gan, De-chuan Zhan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-15872

Browse the full library · About the Tower of Babel