WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories

Yisu Zhang, Chenjie Cao, Tengfei Wang, Xuhui Zuo, Junta Wu, Jianke Zhu, Chunchao Guo · 2026

Read WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories by Yisu Zhang, Chenjie Cao, Tengfei Wang, Xuhui Zuo, Junta Wu, Jianke Zhu, Chunchao Guo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02049.txt.

Description

Yisu Zhang, Chenjie Cao, Tengfei Wang, and colleagues link camera-guided video generation with 3D scene reconstruction. Their 2026 framework, WorldStereo, attacks a split: generated videos look great, yet rebuilding consistent 3D scenes from them fails. Camera control is loose and content shifts between viewpoints in raw generator output.

Two geometric memory modules bridge the gap inside the generation process itself. A global memory injects coarse structure through point clouds updated as generation proceeds, enabling precise camera control. A spatial-stereo memory constrains attention with 3D correspondence, so fine details stay consistent across views. The control branch design stays efficient by reusing a distilled video backbone without joint training. Benchmarks for camera-guided generation and reconstruction both favor the approach, from single and panoramic inputs alike.

Catalog record

CREATORYisu Zhang, Chenjie Cao, Tengfei Wang, Xuhui Zuo, Junta Wu, Jianke Zhu, Chunchao Guo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46258
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02049

Browse the full library · About the Tower of Babel