EmoDiffusion: Enhancing Emotional 3D Facial Animation with Latent Diffusion Models
Yixuan Zhang, Qing Chang, Yuxi Wang, Guang Chen, Zhaoxiang Zhang, Junran Peng · 2025
Read EmoDiffusion: Enhancing Emotional 3D Facial Animation with Latent Diffusion Models by Yixuan Zhang, Qing Chang, Yuxi Wang, Guang Chen, Zhaoxiang Zhang, Junran Peng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11028.txt.
Description
Yixuan Zhang and co-authors present EmoDiffusion, a method for emotional 3D face animation from speech, in a 2025 paper. Talking faces in games and film should match both the words and the feeling behind them. Older methods often flatten emotion or tangle it with speech content. The team's method splits emotion from content so each can be steered.
Two encoder networks handle the upper face and the mouth apart, which sharpens the learned motion code. A diffusion step then runs inside that compact code rather than on raw frames. An extra adapter judges upper face movement, where much emotion shows. Lacking good data, the team filmed expert-guided performances on a phone to build a new data set. Tests and viewer ratings favored their results.
Catalog record
| CREATOR | Yixuan Zhang, Qing Chang, Yuxi Wang, Guang Chen, Zhaoxiang Zhang, Junran Peng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-11028