EmoDiffusion: Enhancing Emotional 3D Facial Animation with Latent Diffusion Models

Yixuan Zhang, Qing Chang, Yuxi Wang, Guang Chen, Zhaoxiang Zhang, Junran Peng · 2025

Read EmoDiffusion: Enhancing Emotional 3D Facial Animation with Latent Diffusion Models by Yixuan Zhang, Qing Chang, Yuxi Wang, Guang Chen, Zhaoxiang Zhang, Junran Peng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11028.txt.

Description

Yixuan Zhang and co-authors present EmoDiffusion, a method for emotional 3D face animation from speech, in a 2025 paper. Talking faces in games and film should match both the words and the feeling behind them. Older methods often flatten emotion or tangle it with speech content. The team's method splits emotion from content so each can be steered.

Two encoder networks handle the upper face and the mouth apart, which sharpens the learned motion code. A diffusion step then runs inside that compact code rather than on raw frames. An extra adapter judges upper face movement, where much emotion shows. Lacking good data, the team filmed expert-guided performances on a phone to build a new data set. Tests and viewer ratings favored their results.

Catalog record

CREATORYixuan Zhang, Qing Chang, Yuxi Wang, Guang Chen, Zhaoxiang Zhang, Junran Peng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-11028

Browse the full library · About the Tower of Babel