HIPPo: H arnessing I mage-to-3D P riors for Model-free Zero-shot 6D Po se Estimation

Yibo Liu, Member, IEEE, Zhaodong Jiang, Binbin Xu, Guile Wu, Yuan Ren, Tongtong Cao, Bingbing Liu, Rui Heng Yang, Amir Rasouli, Jinjun Shan, Senior Member, IEEE · 2025

Read HIPPo: H arnessing I mage-to-3D P riors for Model-free Zero-shot 6D Po se Estimation by Yibo Liu, Member, IEEE, Zhaodong Jiang, Binbin Xu, Guile Wu, Yuan Ren, Tongtong Cao, Bingbing Liu, Rui Heng Yang, Amir Rasouli, Jinjun Shan, Senior Member, IEEE (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10606.txt.

Description

Yibo Liu and co-authors teach robots to judge the pose of objects they have never seen, without any ready-made 3D model or reference photo. Their 2025 paper covers six-degree pose, the full position and tilt of an object, which robots need before they can grasp. Making model files by hand is slow, and the files may not exist at all.

Their system first dreams up a rough 3D mesh of the object from a single view, using image-generating models. As the robot sees more of the object, it reshapes that mesh to match real readings. The pose is tracked the whole time. Tests on standard benchmarks beat older methods when reference material was scarce.

Catalog record

CREATORYibo Liu, Member, IEEE, Zhaodong Jiang, Binbin Xu, Guile Wu, Yuan Ren, Tongtong Cao, Bingbing Liu, Rui Heng Yang, Amir Rasouli, Jinjun Shan, Senior Member, IEEE
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-10606

Browse the full library · About the Tower of Babel