Fast-SAM3D: 3Dfy Anything in Images but Faster

Weilun Feng, Mingqiang Wu, Zhiliang Chen, Chuanguang Yang 🖂, Haotong Qin, Yuqi Li, Xiaokun Liu, Guoxin Fan, Zhulin An 🖂, Libo Huang, Yulun Zhang, Michele Magno, Yongjun Xu · 2026

Read Fast-SAM3D: 3Dfy Anything in Images but Faster by Weilun Feng, Mingqiang Wu, Zhiliang Chen, Chuanguang Yang 🖂, Haotong Qin, Yuqi Li, Xiaokun Liu, Guoxin Fan, Zhulin An 🖂, Libo Huang, Yulun Zhang, Michele Magno, Yongjun Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05293.txt.

Description

Turning a single photo into a 3D scene is now possible with SAM3D, but the rebuild is slow. Weilun Feng and 12 co-authors present Fast-SAM3D in this 2026 computer vision paper, accepted at ICML 2026. Their first step was diagnosis: a systematic study of where the inference time goes, which showed generic acceleration tricks fail because the pipeline is heterogeneous at several levels.

Shape and layout evolve differently, texture refinement is intrinsically sparse, and geometries vary spectrally. The scheme answers each trait with its own mechanism. Caching splits structural updates from delicate layout updates, token carving that concentrates refinement on high-entropy regions, and token aggregation that adapts decoding resolution to the spectrum. The result is up to about 2.67 times faster end-to-end generation with negligible fidelity loss, a new speed-quality frontier for single-view 3D generation. Code is public.

Catalog record

CREATORWeilun Feng, Mingqiang Wu, Zhiliang Chen, Chuanguang Yang 🖂, Haotong Qin, Yuqi Li, Xiaokun Liu, Guoxin Fan, Zhulin An 🖂, Libo Huang, Yulun Zhang, Michele Magno, Yongjun Xu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-05293

Browse the full library · About the Tower of Babel