MARVL: Multi-Stage Guidance for Robotic Manipulation via Vision-Language Models
Xunlan Zhou, Xuanlin Chen, Shaowei Zhang, Xiangkun Li, ShengHua Wan, Xiaohai Hu, Yuan Lei, Le Gan, De-chuan Zhan · 2026
Read MARVL: Multi-Stage Guidance for Robotic Manipulation via Vision-Language Models by Xunlan Zhou, Xuanlin Chen, Shaowei Zhang, Xiangkun Li, ShengHua Wan, Xiaohai Hu, Yuan Lei, Le Gan, De-chuan Zhan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-15872.txt.
Description
Zhou and colleagues propose MARVL, vision-language models giving multi-stage guidance for robotic manipulation. Designing dense reward functions is key for efficient robotic reinforcement learning, yet most dense rewards still need manual engineering, which limits scalability and automation. Vision-language models look like a promising route to reward design, yet naive VLM rewards often drift from task progress, struggle with spatial grounding, and grasp task semantics only weakly.
MARVL first adjusts a VLM so it stays spatially and semantically consistent, then breaks tasks into multi-stage subtasks, using task direction projection to keep trajectories sensitive. On the Meta-World benchmark, MARVL beats existing VLM-reward methods by a wide margin, showing stronger sample efficiency and robustness when rewards are sparse in manipulation tasks.
Catalog record
| CREATOR | Xunlan Zhou, Xuanlin Chen, Shaowei Zhang, Xiangkun Li, ShengHua Wan, Xiaohai Hu, Yuan Lei, Le Gan, De-chuan Zhan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-15872