: Dex terous V ision- L anguage- G rasp Model at Scale

Jiawei He, Danshi Li, Xinqiang Yu, Zekun Qi, Wenyao Zhang, Jiayi Chen, Zhaoxiang Zhang, Zhizheng Zhang, Li Yi, He Wang · 2025

Read : Dex terous V ision- L anguage- G rasp Model at Scale by Jiawei He, Danshi Li, Xinqiang Yu, Zekun Qi, Wenyao Zhang, Jiayi Chen, Zhaoxiang Zhang, Zhizheng Zhang, Li Yi, He Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-02747.txt.

Description

Ten researchers present DexVLG, a large model that tells a many-fingered robot hand how to grasp objects in line with spoken or written instructions. Robots with simple grippers have advanced quickly, but dexterous hands are harder, mostly because training data is scarce. The team works from a single color-and-depth view of a tabletop scene.

To train the model, they built DexGraspNet 3.0 in simulation: 170 million grasp poses spread over 174,000 objects. Each pose was matched to a named part of the object and a detailed written caption. A vision-language model reads the scene and the instruction, and a pose generator then shapes the hand's approach. In physics simulations the system reached over 76 percent success on objects it had never seen, with leading accuracy for grasping the requested part. Trials on a real robot hand confirmed that the grasps work on physical objects too.

Catalog record

CREATORJiawei He, Danshi Li, Xinqiang Yu, Zekun Qi, Wenyao Zhang, Jiayi Chen, Zhaoxiang Zhang, Zhizheng Zhang, Li Yi, He Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-02747

Browse the full library · About the Tower of Babel