DIDiffGes: Decoupled Semi-Implicit Diffusion Models for Real-time Gesture Generation from Speech

Yongkang Cheng, Shaoli Huang, Xuelin Chen, Jifeng Ning, Mingming Gong · 2025

Read DIDiffGes: Decoupled Semi-Implicit Diffusion Models for Real-time Gesture Generation from Speech by Yongkang Cheng, Shaoli Huang, Xuelin Chen, Jifeng Ning, Mingming Gong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17059.txt.

Description

Yongkang Cheng and four co-authors present in 2025 a fast way to make a digital figure gesture along with speech. Diffusion models make rich, varied gestures, but they need many sampling steps, which blocks live use. Their system, DIDiffGes, cuts that cost sharply.

The method splits gesture data into body and hands, then splits each part again into base and linked parts. Rival networks learn the base parts while a simple loss learns the linked parts, which keeps training steady. A root noise step adds calm and realism. With just ten steps, a hundredfold cut, the gestures still pleased viewers more than rival methods in a user study.

Catalog record

CREATORYongkang Cheng, Shaoli Huang, Xuelin Chen, Jifeng Ning, Mingming Gong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-17059

Browse the full library · About the Tower of Babel