MoCoTalk: Multi-Conditional Diffusion with Adaptive Router for Controllable Talking Head Generation
Xinyan Ye, Jiankang Deng, Abbas Edalat · 2026
Read MoCoTalk: Multi-Conditional Diffusion with Adaptive Router for Controllable Talking Head Generation by Xinyan Ye, Jiankang Deng, Abbas Edalat (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08050.txt.
Description
Xinyan Ye, Jiankang Deng, and Abbas Edalat present a system for generating talking-head videos with fine control. A good result must match identity, head pose, expression, and mouth motion at once. Earlier systems handled only some of these factors and mixed control signals with fixed weights, which lets the signals interfere.
MoCoTalk is a video diffusion framework that combines a reference image, facial keypoints, rendered shading meshes, and speech audio. An adaptive router sets channel-wise gates that change with the noise level, so each signal leads where it helps most. A mouth-augmented mesh separates head, mouth, expression, and lighting, giving steady geometry for speech-driven motion.
Catalog record
| CREATOR | Xinyan Ye, Jiankang Deng, Abbas Edalat |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08050