MEMO : Memory-Guided Diffusion for Expressive Talking Video Generation

Longtao Zheng, Yifan Zhang, Hanzhong Guo, Jiachun Pan, Zhenxiong Tan, Jiahao Lu, Chuanxin Tang, Bo An, Shuicheng Yan · 2024

Read MEMO : Memory-Guided Diffusion for Expressive Talking Video Generation by Longtao Zheng, Yifan Zhang, Hanzhong Guo, Jiachun Pan, Zhenxiong Tan, Jiahao Lu, Chuanxin Tang, Bo An, Shuicheng Yan (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-04448.txt.

Description

Zheng and eight co-authors build a talk film tool with a long past bank in this twenty twenty-four paper. Sound-led face films oft drift in face form cross long runs. Mood match tween voice and face also lags in past tools.

Inside, a past bank holds long tales to steer the film's time flow. That bank keeps face form firm and moves smooth cross the run. A mood read from the voice then tunes face acts in line. Joint sight-sound care swaps the stock cross-care in their build. Tests beat past tools on sync, face keep, and mood match.

Catalog record

CREATORLongtao Zheng, Yifan Zhang, Hanzhong Guo, Jiachun Pan, Zhenxiong Tan, Jiahao Lu, Chuanxin Tang, Bo An, Shuicheng Yan
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-04448

Browse the full library · About the Tower of Babel