CT-1 : Vision-Language-Camera Models Transfer Spatial Reasoning Knowledge to Camera-Controllable Video Generation

Haoyu Zhao 1, ♠ \spadesuit, Zihao Zhang 1, Jiaxi Gu 2, ♢ \diamondsuit, Haoran Chen 1, Qingping Zheng 3, Pin Tang 4, Yeyin Jin 2, Yuang Zhang 2, Junqi Cheng 2, Zenghui Lu 2, Peng Shu 2, Zuxuan Wu 1, † \dagger, Yu-Gang Jiang 1, † \dagger · 2026

Read CT-1 : Vision-Language-Camera Models Transfer Spatial Reasoning Knowledge to Camera-Controllable Video Generation by Haoyu Zhao 1, ♠ \spadesuit, Zihao Zhang 1, Jiaxi Gu 2, ♢ \diamondsuit, Haoran Chen 1, Qingping Zheng 3, Pin Tang 4, Yeyin Jin 2, Yuang Zhang 2, Junqi Cheng 2, Zenghui Lu 2, Peng Shu 2, Zuxuan Wu 1, † \dagger, Yu-Gang Jiang 1, † \dagger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09201.txt.

Description

Zhao and twelve colleagues present CT-1, a vision-language-camera model that carries spatial reasoning into camera-controlled video generation. Earlier tools either steer cameras loosely from text or demand hand-set trajectory parameters. CT-1 estimates camera paths with vision-language modules and a diffusion transformer, using a wavelet-based loss to learn path distributions. Built on over 47 million frames, it improves camera control accuracy by 25.7 percent over prior methods.

Catalog record

CREATORHaoyu Zhao 1, ♠ \spadesuit, Zihao Zhang 1, Jiaxi Gu 2, ♢ \diamondsuit, Haoran Chen 1, Qingping Zheng 3, Pin Tang 4, Yeyin Jin 2, Yuang Zhang 2, Junqi Cheng 2, Zenghui Lu 2, Peng Shu 2, Zuxuan Wu 1, † \dagger, Yu-Gang Jiang 1, † \dagger
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80507
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.09201

Browse the full library · About the Tower of Babel