Vivid4D: Improving 4D Reconstruction from Monocular Video by Video Inpainting

Jiaxin Huang, Sheng Miao, BangBang Yang, Yuewen Ma, Yiyi Liao · 2025

Read Vivid4D: Improving 4D Reconstruction from Monocular Video by Video Inpainting by Jiaxin Huang, Sheng Miao, BangBang Yang, Yuewen Ma, Yiyi Liao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-11092.txt.

Description

Huang, Miao, Yang, Ma, and Liao present a study from twenty twenty-five on rebuilding dynamic scenes from single-camera video. Each moment is seen from one viewpoint only, which makes four-dimensional rebuilds hard. Their method augments views by synthesizing multi-view video from the single input. Observed views are warped into new angles using depth estimates. A video inpainting model then fills the gaps left by warping. Training uses unposed web videos with fake masks that mimic warp holes. An iterative plan and robust loss counter depth errors.

Tests show better scene rebuilds and completions than prior methods. Filled regions stay consistent in space and time. The authors frame view synthesis as inpainting, a fresh angle on the problem. A project page hosts their results.

Catalog record

CREATORJiaxin Huang, Sheng Miao, BangBang Yang, Yuewen Ma, Yiyi Liao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-11092

Browse the full library · About the Tower of Babel