GraphSeg: Segmented 3D Representations via Graph Edge Addition and Contraction

Haozhan Tang, Tianyi Zhang, Oliver Kroemer, Matthew Johnson-Roberson, Weiming Zhi · 2025

Read GraphSeg: Segmented 3D Representations via Graph Edge Addition and Contraction by Haozhan Tang, Tianyi Zhang, Oliver Kroemer, Matthew Johnson-Roberson, Weiming Zhi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03129.txt.

Description

Haozhan Tang and co-authors cut a robot's view of a tabletop into objects that stay the same from every angle. Two-dimensional segmentation models are superb on single photos but shatter in 3D, over-splitting objects and losing track of which mask in one view matches which in another. Their 2025 paper, GraphSeg, works from a sparse handful of photos with no depth information at all.

The method builds two correspondence graphs. One comes from pixel-level similarity between views, the other from inferred 3D structure. Segmentation is then phrased as adding edges and contracting the graph until masks merge into objects. A 3D foundation model finally lifts the merged segments into a full spatial representation. On tabletop scenes the approach beat prior methods in accuracy while using far fewer images, and robots using its segmentations manipulated objects better downstream.

Catalog record

CREATORHaozhan Tang, Tianyi Zhang, Oliver Kroemer, Matthew Johnson-Roberson, Weiming Zhi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-03129

Browse the full library · About the Tower of Babel