KeyVID: Keyframe-Aware Video Diffusion for Audio-Synchronized Visual Animation

Xingrui Wang, Jiang Liu, Ze Wang, Xiaodong Yu, Jialian Wu, Ximeng Sun, Yusheng Su, Alan Yuille, Zicheng Liu, Emad Barsoum · 2025

Read KeyVID: Keyframe-Aware Video Diffusion for Audio-Synchronized Visual Animation by Xingrui Wang, Jiang Liu, Ze Wang, Xiaodong Yu, Jialian Wu, Ximeng Sun, Yusheng Su, Alan Yuille, Zicheng Liu, Emad Barsoum (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-09656.txt.

Description

Xingrui Wang and co-authors present KeyVID, a system that makes video move in time with sound. Their twenty twenty-five paper starts from a still image plus an audio track. Sharp moves need key frames at the right beats, or the motion looks flat.

Most past tools sampled frames at even gaps, which misses peak moments. KeyVID first finds key beats in the audio, then builds frames around them. This keeps the strong moments while saving memory and compute. Tests cover tasks where a face or scene must match speech or music. Readers see how smart frame choice lifts quality at low frame rates.

Catalog record

CREATORXingrui Wang, Jiang Liu, Ze Wang, Xiaodong Yu, Jialian Wu, Ximeng Sun, Yusheng Su, Alan Yuille, Zicheng Liu, Emad Barsoum
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-09656

Browse the full library · About the Tower of Babel