Talking Together: Synthesizing Co-Located 3D Conversations from Audio

Mengyi Shan, Shouchieh Chang, Ziqian Bai, Shichen Liu, Yinda Zhang, Luchuan Song, Rohit Pandey, Sean Fanello, Zeng Huang · 2026

Read Talking Together: Synthesizing Co-Located 3D Conversations from Audio by Mengyi Shan, Shouchieh Chang, Ziqian Bai, Shichen Liu, Yinda Zhang, Luchuan Song, Rohit Pandey, Sean Fanello, Zeng Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08674.txt.

Description

Mengyi Shan and colleagues animate two people talking face to face in 3D from one mixed audio track. Past tools make floating heads like a video call, missing the shared space, gaze, and relative poses of a real chat. Their dual-stream design splits the audio by speaker, models gaze and pose from text cues, and trains on over two million curated chat pairs.

Catalog record

CREATORMengyi Shan, Shouchieh Chang, Ziqian Bai, Shichen Liu, Yinda Zhang, Luchuan Song, Rohit Pandey, Sean Fanello, Zeng Huang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57198
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08674

Browse the full library · About the Tower of Babel