Name That Part: 3D Part Segmentation and Naming
Soumava Paul ⋆ Prakhar Kaushik ⋆‡ Ankit Vaidya Anand Bhattad Alan Yuille ⋆ \star Equal Contribution ‡ {\ddagger} Project Lead · 2025
Read Name That Part: 3D Part Segmentation and Naming by Soumava Paul ⋆ Prakhar Kaushik ⋆‡ Ankit Vaidya Anand Bhattad Alan Yuille ⋆ \star Equal Contribution ‡ {\ddagger} Project Lead (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18003.txt.
Introduction
Soumava Paul and four coauthors teach computers to cut a 3D object into named parts, like the legs, seat, and back of a chair. Past data sets name parts in clashing ways, which blocks steady training. Their method, ALIGN-Parts, treats naming as a matching task between shape pieces and word labels.
Shape clues, photo features from many views, and hints about how a part is used all feed the match, so new names can be added without new labels by hand. With human checks, the team merged three big data sets into one shared list of 1,794 parts. They also offer two new scores for judging named part work.
Catalog record
| CREATOR | Soumava Paul ⋆ Prakhar Kaushik ⋆‡ Ankit Vaidya Anand Bhattad Alan Yuille ⋆ \star Equal Contribution ‡ {\ddagger} Project Lead |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-18003
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Name That Part: 3D Part Segmentation and Naming Thanks: Project page: https://name-that-part.github.io Soumava Paul ⋆ Prakhar Kaushik ⋆‡ Ankit Vaidya Anand Bhattad Alan Yuille ⋆ \star Equal Contribution ‡ {\ddagger} Project Lead Abstract . We address semantic 3D part segmentation: decomposing objects into parts with meaningful names. While datasets exist with part annotations, their definitions are inconsistent across datasets, limiting robust training. Previous methods produce unlabeled decompositions or retrieve single parts without complete shape annotations. We propose ALIGN-Parts, which formulates part naming as a direct set alignment task. Our method decomposes shapes into partlets - implicit 3D part representations - matched to part descriptions via bipartite assignment. We combine geometric cues from 3D part fields, appearance from multi-view vision features, and semantic knowledge from language-model-generated affordance descriptions. Text-alignment loss ensures partlets share embedding space with text, enabling a theoretically open-vocabulary matching setup, given sufficient data. Our efficient and novel, one-shot, 3D part segmentation and naming method finds applications in several downstream tasks, including serving as a scalable annotation engine. As our model supports zero-shot matching to arbitrary descriptions and confidence-calibrated predictions for known categories, with human verification, we create a unified ontology that aligns PartNet, 3DCoMPaT++, and Find3D, consisting of 1,794 unique 3D parts. We also show examples from our newly created Tex-Parts dataset. We also introduce 2 novel metrics appropriate for the named 3D part segmentation task. Figure 1 . ALIGN-Parts is the first large-scale method to be able to efficiently and semantically segment and name 3D parts of an object, unlike previous methods, which could only do class-agnostic part segmentation. Our method is also feed-forward, and defines 3D parts according to human-oriented, object-specific affordance descriptions. Teaser figure illustrating the main idea. Method Complete Named Open Permutation Part-level Feed Decomposition Parts Vocabulary Invariant Features Forward PartField - SAMPart3D Find3D Ours Table 1. Comparison with 3D part methods. 1. Introduction Many vision tasks require 3D parts, not just whole-object labels. Examples include robots grasping handles and creators editing assets. This requires solving two problems simultaneously: geometrically segmenting the parts and semantically naming them. While large datasets of 3D objects exist, only a few provide part annotations, and these annotations are often inconsistent across datasets ( 21 ; 24 ; 20 ) . An algorithm that can provide accurate and consistent annotations of named parts on any 3D object would enable scalable training data and support human-in-the-loop annotation pipelines. Existing methods address only one aspect of this problem. Part segmentation models can identify geometric boundaries but produce unnamed regions ( 17 ) . Language-grounded systems can retrieve a single part from a text query but fail to produce a complete set of names for all parts of an object ( 20 ) . Classical unsupervised part discovery lacks the semantic grounding to derive consistent definitions. This gap has created a bottleneck: the absence of large-scale, consistently-annotated 3D part data. Inducing consistent parts from unlabeled web assets requires coupling geometric features and semantic knowledge with human verification. Figure 2 . ALIGN-Parts segments and names 3D parts, unlike PartField ( 17 ) , which only segments. Our method is 100\times (post data pre-processing) faster at generating these segments along with names compared to PartField. We propose ALIGN-Parts, which formulates 3D part naming as a direct set alignment problem. Rather than deciding per-point which text label to assign, we decompose the shape into a small set of shape-conditioned partlets . Each partlet consists of a set of points (a segmentation mask) and a text description (embedding) corresponding to one part. These partlets aggregate information across all points belonging to a part: a single point on a chair seat contains limited information, but the set of all points on the seat specifies the part. We align this set of partlets to a set of candidate part descriptions via bipartite matching in a single forward pass. Each partlet inherits a name from its matched description. A “null” class allows the model to discard unused partlets, enabling the number of parts to adapt per shape while ensuring permutation consistency: each predicted part receives at most one name, and each name is used at most once. Our key contribution is applying set-level matching to 3D part fields. This enables lower computational complexity: we match a handful of partlets to descriptions instead of all points to all labels. It provides permutation consistency: each predicted part receives at most one name, and each name is used at most once. Because of this, ALIGN-Parts is 100× faster at generating these segments along with names. To ensure partlets are both geometrically separable and semantically meaningful, we combine three signals. (1) Geometry features from a 3D part-field backbone ( 17 ) capture shape structure. (2) Appearance features from multi-view image encoders ( 22 ) lifted onto 3D geometry provide texture cues. (3) Semantic knowledge comes from affordance-aware part descriptions that encode form-and-function relationships ( 5 ) . For example, a chair seat becomes “the horizontal surface where a person sits,” linking its flat, horizontal geometry to its sitting affordance. For text grounding, we generate these descriptions using a large language model ( 4 ) and embed them using MPNet sentence transformers ( 25 ) . By representing part descriptions as embeddings in a continuous space, our approach supports scenarios where the model can match partlets to any user-provided set of part descriptions without retraining. Our approach provides a tool to address the data bottleneck. We construct a unified part ontology using a hybrid LLM-and-human process that normalizes labels and verifies geometric consistency across PartNet, 3DCoMPaT++, and Find3D. We then apply ALIGN-Parts to bootstrap annotations from unlabeled TexVerse assets, creating Tex-Parts: a dataset with 8450 objects spanning 14k part categories. ALIGN-Parts serves as a scalable annotation engine that proposes named parts for human verification, converting raw meshes into training data with minimal effort and enabling the construction of large, consistently-annotated 3D datasets. In summary, our contributions are: • Direct 3D parts alignment for open-world part naming. We introduce partlets - shape-conditioned part proposals with text embeddings - and match them to candidate descriptions via bipartite assignment, enabling efficient labeling of 3D part segmentation and naming. • Geometry-appearance-semantic fusion. We combine geometric structure, appearance features, and affordance-aware LLM-generated descriptions to produce semantically grounded, visually coherent partlets. • Metrics for evaluating 3D part semantic segmentation We introduce 2 metrics suitable for our 3D part segmentation and naming task, which evaluate ALIGN-Parts and related baselines for both part segmentation accuracy and semantic correctness of the predicted part label. • Unified ontology and scalable annotation engine. We harmonize part taxonomies across PartNet, 3DCoMPaT++, and Find3D, and demonstrate a human-in-the-loop pipeline that bootstraps TexParts , a verified benchmark of 8450 objects spanning 14k categories derived from Texverse ( 35 ) . ALIGN-Parts converts raw meshes into training data with 5 - 8\times less human effort than manual annotation. 2. Related Work 3D Part Segmentation. Traditional methods operate in a purely geometric regime. PartField ( 17 ) , the current state-of-the-art, learns dense per-point feature fields but produces unlabeled regions. Recent works lift 2D foundation models into 3D: SAM-based approaches ( 19 ; 34 ; 28 ) adapt Segment-Anything via multi-view projection but require prompts and lack semantic names. PartSTAD