Enhancing Monocular 3D Scene Completion with Diffusion Model

Changlin Song, Jiaqi Wang, Liyun Zhu, He Weng · 2025

Read Enhancing Monocular 3D Scene Completion with Diffusion Model by Changlin Song, Jiaqi Wang, Liyun Zhu, He Weng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-00726.txt.

Description

Changlin Song, Jiaqi Wang, Liyun Zhu, and He Weng introduce FlashDreamer, a method that builds a full 3D scene from a single photo. Rebuilding scenes in 3D serves virtual reality, robots, and self-driving cars. Standard tools need photos from many angles, which many settings cannot give.

FlashDreamer asks a vision-language model to describe the scene in words, then uses those words to guide an image maker that dreams up the scene from fresh angles. The dreamed views are merged into one solid 3D model. Tests showed the method works well and holds up under varied inputs, with no extra training needed. The code is shared in public.

Catalog record

CREATORChanglin Song, Jiaqi Wang, Liyun Zhu, He Weng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-00726

Browse the full library · About the Tower of Babel