Beyond Static Scenes: Camera-controllable Background Generation for Human Motion

Mingshuai Yao, Mengting Chen†, Qinye Zhou, Yabo Zhang, Ming Liu, Xiaoming Li✉, Shaohui Liu, Chen Ju, Shuai Xiao, Qingwen Liu, Jinsong Lan✉, Wangmeng Zuo · 2025

Read Beyond Static Scenes: Camera-controllable Background Generation for Human Motion by Mingshuai Yao, Mengting Chen†, Qinye Zhou, Yabo Zhang, Ming Liu, Xiaoming Li✉, Shaohui Liu, Chen Ju, Shuai Xiao, Qingwen Liu, Jinsong Lan✉, Wangmeng Zuo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-02004.txt.

Description

Mingshuai Yao and co-authors build a system that paints new video backgrounds behind a moving person, steered by the camera path, in a 2025 arXiv paper. The task takes a human clip, a camera path, and a still scene photo, and grows a fresh backdrop. The backdrop must track the person's own camera moves.

Their system, DynaScene, reads the camera path from the source clip and uses it as an open control. Two side tasks, filling unseen edges and varying the scene, teach the model to keep new areas smooth and textures steady as the view swings. To train it, the team built a set of two hundred thousand clips with people, scene stills, and camera paths. That set is ten times the size of past real world human video sets.

Catalog record

CREATORMingshuai Yao, Mengting Chen†, Qinye Zhou, Yabo Zhang, Ming Liu, Xiaoming Li✉, Shaohui Liu, Chen Ju, Shuai Xiao, Qingwen Liu, Jinsong Lan✉, Wangmeng Zuo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-02004

Browse the full library · About the Tower of Babel