MoCoTalk: Multi-Conditional Diffusion with Adaptive Router for Controllable Talking Head Generation

Xinyan Ye, Jiankang Deng, Abbas Edalat · 2026

Read MoCoTalk: Multi-Conditional Diffusion with Adaptive Router for Controllable Talking Head Generation by Xinyan Ye, Jiankang Deng, Abbas Edalat (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08050.txt.

Description

Xinyan Ye, Jiankang Deng, and Abbas Edalat present a system for generating talking-head videos with fine control. A good result must match identity, head pose, expression, and mouth motion at once. Earlier systems handled only some of these factors and mixed control signals with fixed weights, which lets the signals interfere.

MoCoTalk is a video diffusion framework that combines a reference image, facial keypoints, rendered shading meshes, and speech audio. An adaptive router sets channel-wise gates that change with the noise level, so each signal leads where it helps most. A mouth-augmented mesh separates head, mouth, expression, and lighting, giving steady geometry for speech-driven motion.

Catalog record

CREATORXinyan Ye, Jiankang Deng, Abbas Edalat
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08050

Browse the full library · About the Tower of Babel