Voila: Voice-Language Foundation Models for Real-Time Autonomous Interaction and Voice Role-Play
Yemin Shi *, Yu Shu *, Siwei Dong *, Guangyi Liu *, Jaward Sesay, Jingwen Li, Zhiting Hu · 2025
Read Voila: Voice-Language Foundation Models for Real-Time Autonomous Interaction and Voice Role-Play by Yemin Shi *, Yu Shu *, Siwei Dong *, Guangyi Liu *, Jaward Sesay, Jingwen Li, Zhiting Hu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-02707.txt.
Description
Yemin Shi and co-authors introduce Voila, a family of voice AI models built for live conversation, in a 2025 paper. Most voice assistants chain separate tools for hearing, thinking, and speaking, which adds delay and flattens tone. Voila folds the steps into one system that can listen and speak at the same time, like a person.
The model answers in about one hundred and ninety-five milliseconds, faster than the average human reply. It keeps tone, rhythm, and feeling in its voice, and users can define a speaker's character with plain written instructions. More than a million ready voices are included, and new ones can be cloned from ten seconds of audio. The same model also handles speech recognition, speech synthesis, and, with small tweaks, translation. The team released it openly.
Catalog record
| CREATOR | Yemin Shi *, Yu Shu *, Siwei Dong *, Guangyi Liu *, Jaward Sesay, Jingwen Li, Zhiting Hu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-02707