All in One: Visual-Description-Guided Unified Point Cloud Segmentation
Zongyan Han, Mohamed El Amine Boudjoghra, Jiahua Dong, Jinhong Wang, Rao Muhammad Anwer · 2025
Read All in One: Visual-Description-Guided Unified Point Cloud Segmentation by Zongyan Han, Mohamed El Amine Boudjoghra, Jiahua Dong, Jinhong Wang, Rao Muhammad Anwer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05211.txt.
Description
Han and co-authors propose in 2025 one framework for all 3D point cloud segmentation tasks, guided by visual descriptions. Unified segmentation aids scene understanding, but sparse structure, few labels, and fine class splits make it hard. Past methods lacked rich semantic and context cues.
Their VDG-Uni3DSeg draws text descriptions from large language models and reference images from the web, through pretrained vision language models. A contrastive loss aligns point features with those queries. A spatial module models scene wide relations at low cost. The work runs in a closed set mode with knowledge made offline, and reports leading results across semantic, instance, and panoptic tasks.
Catalog record
| CREATOR | Zongyan Han, Mohamed El Amine Boudjoghra, Jiahua Dong, Jinhong Wang, Rao Muhammad Anwer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-05211