PointVLA: Injecting the 3D World into Vision-Language-Action Models
Chengmeng Li, Yichen Zhu, Junjie Wen, Yan Peng, Yaxin Peng, Feifei Feng · 2025
Read PointVLA: Injecting the 3D World into Vision-Language-Action Models by Chengmeng Li, Yichen Zhu, Junjie Wen, Yan Peng, Yaxin Peng, Feifei Feng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07511.txt.
Description
Chengmeng Li and colleagues give robot control models eyes for depth by adding point clouds to vision-language-action systems. Such models learn from flat images and vast image-text training, yet flat views limit their sense of space. Retraining them on 3D data costs too much, and dropping the 2D training wastes it. PointVLA instead freezes the trained action part and slips 3D features into its least useful blocks.
In tests the system beat leading 2D methods on both simulated and real robot tasks. It learned four tasks from twenty demos each, told real objects from photos of them, and coped with table heights never seen in training. It also handled long jobs like packing goods off a moving belt.
Catalog record
| CREATOR | Chengmeng Li, Yichen Zhu, Junjie Wen, Yan Peng, Yaxin Peng, Feifei Feng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-07511