: Dex terous V ision- L anguage- G rasp Model at Scale
Jiawei He, Danshi Li, Xinqiang Yu, Zekun Qi, Wenyao Zhang, Jiayi Chen, Zhaoxiang Zhang, Zhizheng Zhang, Li Yi, He Wang · 2025
Read : Dex terous V ision- L anguage- G rasp Model at Scale by Jiawei He, Danshi Li, Xinqiang Yu, Zekun Qi, Wenyao Zhang, Jiayi Chen, Zhaoxiang Zhang, Zhizheng Zhang, Li Yi, He Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-02747.txt.
Description
Ten researchers present DexVLG, a large model that tells a many-fingered robot hand how to grasp objects in line with spoken or written instructions. Robots with simple grippers have advanced quickly, but dexterous hands are harder, mostly because training data is scarce. The team works from a single color-and-depth view of a tabletop scene.
To train the model, they built DexGraspNet 3.0 in simulation: 170 million grasp poses spread over 174,000 objects. Each pose was matched to a named part of the object and a detailed written caption. A vision-language model reads the scene and the instruction, and a pose generator then shapes the hand's approach. In physics simulations the system reached over 76 percent success on objects it had never seen, with leading accuracy for grasping the requested part. Trials on a real robot hand confirmed that the grasps work on physical objects too.
Catalog record
| CREATOR | Jiawei He, Danshi Li, Xinqiang Yu, Zekun Qi, Wenyao Zhang, Jiayi Chen, Zhaoxiang Zhang, Zhizheng Zhang, Li Yi, He Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-02747