LabelAny3D: Label Any Object 3D in the Wild

Jin Yao, Radowan Mahmud Redoy, Sebastian Elbaum, Matthew B. Dwyer, Zezhou Cheng · 2026

Read LabelAny3D: Label Any Object 3D in the Wild by Jin Yao, Radowan Mahmud Redoy, Sebastian Elbaum, Matthew B. Dwyer, Zezhou Cheng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-01676.txt.

Description

Finding objects in three dimensions from a single photograph remains hard outside tidy indoor scenes and road data, largely because labeled 3D examples from everyday photos barely exist. Jin Yao and four co-authors respond with LabelAny3D. The system rebuilds a full 3D scene from a 2D image. It then labels objects from that reconstruction.

From their pipeline they build COCO3D, a benchmark drawn from the MS-COCO photo collection with a far wider range of object types than earlier 3D datasets. Detectors trained with the generated labels perform better across several benchmarks than those using prior automatic labeling. The results support using large foundation models to scale up 3D training data.

Catalog record

CREATORJin Yao, Radowan Mahmud Redoy, Sebastian Elbaum, Matthew B. Dwyer, Zezhou Cheng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-01676

Browse the full library · About the Tower of Babel