All in One: Visual-Description-Guided Unified Point Cloud Segmentation

Zongyan Han, Mohamed El Amine Boudjoghra, Jiahua Dong, Jinhong Wang, Rao Muhammad Anwer · 2025

Read All in One: Visual-Description-Guided Unified Point Cloud Segmentation by Zongyan Han, Mohamed El Amine Boudjoghra, Jiahua Dong, Jinhong Wang, Rao Muhammad Anwer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05211.txt.

Description

Han and co-authors propose in 2025 one framework for all 3D point cloud segmentation tasks, guided by visual descriptions. Unified segmentation aids scene understanding, but sparse structure, few labels, and fine class splits make it hard. Past methods lacked rich semantic and context cues.

Their VDG-Uni3DSeg draws text descriptions from large language models and reference images from the web, through pretrained vision language models. A contrastive loss aligns point features with those queries. A spatial module models scene wide relations at low cost. The work runs in a closed set mode with knowledge made offline, and reports leading results across semantic, instance, and panoptic tasks.

Catalog record

CREATORZongyan Han, Mohamed El Amine Boudjoghra, Jiahua Dong, Jinhong Wang, Rao Muhammad Anwer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05211

Browse the full library · About the Tower of Babel