Co 3 Gesture: Towards Co herent Co ncurrent Co -speech 3D Gesture Generation with Interactive Diffusion

Xingqun Qi, Yatian Wang, Hengyuan Zhang, Jiahao Pan, Wei Xue, Shanghang Zhang, Wenhan Luo, Qifeng Liu, Yike Guo · 2025

Read Co 3 Gesture: Towards Co herent Co ncurrent Co -speech 3D Gesture Generation with Interactive Diffusion by Xingqun Qi, Yatian Wang, Hengyuan Zhang, Jiahao Pan, Wei Xue, Shanghang Zhang, Wenhan Luo, Qifeng Liu, Yike Guo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01746.txt.

Description

Xingqun Qi and eight co-authors generate hand and body gestures for two people talking at once, in a 2025 paper. Virtual avatars that gesture along with speech have mostly performed solo monologues. Real conversation is a duet, with listeners nodding and speakers reacting, and no large dataset captured that interplay.

The team first built one: over seven million frames of paired posture sequences from two-person interactions. Their generation system then runs two cooperating branches, one per speaker, each driven by that person's audio. A timing module keeps each body's motions synced to its own voice while staying aware of the partner. The result is coherent paired gesture, a step toward avatars that can hold a conversation instead of delivering a speech.

Catalog record

CREATORXingqun Qi, Yatian Wang, Hengyuan Zhang, Jiahao Pan, Wei Xue, Shanghang Zhang, Wenhan Luo, Qifeng Liu, Yike Guo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-01746

Browse the full library · About the Tower of Babel