SyncAnimation: A Real-Time End-to-End Framework for Audio-Driven Human Pose and Talking Head Animation

Yujian Liu, Shidang Xu, Jing Guo, Dingbin Wang, Zairan Wang, Xianfeng Tan, Xiaoli Liu · 2025

Read SyncAnimation: A Real-Time End-to-End Framework for Audio-Driven Human Pose and Talking Head Animation by Yujian Liu, Shidang Xu, Jing Guo, Dingbin Wang, Zairan Wang, Xianfeng Tan, Xiaoli Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14646.txt.

Description

Seven researchers wrote a computer graphics paper in two thousand twenty-five on making a talking avatar from sound alone. The avatar must move its lips, face, and upper body in step with speech, and do so live. Past methods cost too much computing, lacked facial detail, or let the face and body drift apart.

Their system, SyncAnimation, is built on a method that renders a person from learned scene data. One part matches body poses to the audio, and another matches facial expression to the emotion in the voice. A renderer then joins head and body into one smooth result. The authors report stable, real-time output.

Catalog record

CREATORYujian Liu, Shidang Xu, Jing Guo, Dingbin Wang, Zairan Wang, Xianfeng Tan, Xiaoli Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-14646

Browse the full library · About the Tower of Babel