MIDAS: M ultimodal I nteractive D igital-hum A n S ynthesis via Real-time Autoregressive Video Generation

Ming Chen, Liyuan Cui, Wenyuan Zhang, Haoxian Zhang, Yan Zhou Xiaohan Li Songlin Tang Jiwen Liu, Borui Liao Hejia Chen Xiaoqiang Liu Pengfei Wan · 2025

Read MIDAS: M ultimodal I nteractive D igital-hum A n S ynthesis via Real-time Autoregressive Video Generation by Ming Chen, Liyuan Cui, Wenyuan Zhang, Haoxian Zhang, Yan Zhou Xiaohan Li Songlin Tang Jiwen Liu, Borui Liao Hejia Chen Xiaoqiang Liu Pengfei Wan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-19320.txt.

Description

Ming Chen and co-authors introduced MIDAS in 2025, a system that makes digital human videos in real time. Older systems often cost too much computing power and react too slowly for live talk. MIDAS aims to take in sound, pose, and text, and reply with video as the talk goes on.

The design adds multi-input coding to a large language model, then guides a video step that cleans up each frame. Training used a dialogue set of about twenty thousand hours from many sources. A strong compression step cuts the load of long runs. Tests cover two-way talk, work in several tongues, and live world scenes.

Catalog record

CREATORMing Chen, Liyuan Cui, Wenyuan Zhang, Haoxian Zhang, Yan Zhou Xiaohan Li Songlin Tang Jiwen Liu, Borui Liao Hejia Chen Xiaoqiang Liu Pengfei Wan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-19320

Browse the full library · About the Tower of Babel