IGGT: Instance-Grounded Geometry Transformer for Semantic 3D Reconstruction

Hao Li, Zhengyu Zou, Fangfu Liu, Xuanyang Zhang, Fangzhou Hong, Yukang Cao, Yushi Lan, Manyuan Zhang, Gang Yu, Dingwen Zhang, Ziwei Liu · 2025

Read IGGT: Instance-Grounded Geometry Transformer for Semantic 3D Reconstruction by Hao Li, Zhengyu Zou, Fangfu Liu, Xuanyang Zhang, Fangzhou Hong, Yukang Cao, Yushi Lan, Manyuan Zhang, Gang Yu, Dingwen Zhang, Ziwei Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22706.txt.

Description

Humans read a scene's geometry and its objects together, while most computer systems treat them apart. Hao Li, with ten co-authors, proposes IGGT in 2025, a unified transformer that reconstructs three dimensional scenes while also grounding individual object instances in them.

A contrastive learning strategy, which pulls matching views together, teaches one representation holding both structure and instance grouping. Training uses only two dimensional visual inputs, yet the model lifts them into a coherent three dimensional scene with distinct objects. Earlier systems either rebuilt geometry alone or borrowed a fixed language model's limits. IGGT aims for better generalization across downstream three dimensional understanding tasks.

Catalog record

CREATORHao Li, Zhengyu Zou, Fangfu Liu, Xuanyang Zhang, Fangzhou Hong, Yukang Cao, Yushi Lan, Manyuan Zhang, Gang Yu, Dingwen Zhang, Ziwei Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-22706

Browse the full library · About the Tower of Babel