SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generation

Chun-Han Yao, Yiming Xie, Vikram Voleti, Huaizu Jiang, Varun Jampani · 2025

Read SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generation by Chun-Han Yao, Yiming Xie, Vikram Voleti, Huaizu Jiang, Varun Jampani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16396.txt.

Description

Chun-Han Yao, Yiming Xie, Vikram Voleti, Huaizu Jiang, and Varun Jampani present SV4D 2.0, a 2025 system that turns video into moving 3D objects. Such 4D assets, three dimensions plus time, are wanted for games, film, and simulation. Earlier versions struggled when objects were partly hidden or moved a long way.

The upgrade changes the network design, uses more and better training data, and trains in stages from still 3D to full motion. A two-stage cleanup step then fixes mismatches between views. In tests the new system beat its predecessor clearly on sharpness and on consistency across views and time. The gains were largest exactly where the old system failed: hidden surfaces and fast movement.

Catalog record

CREATORChun-Han Yao, Yiming Xie, Vikram Voleti, Huaizu Jiang, Varun Jampani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-16396

Browse the full library · About the Tower of Babel