NTPP : Generative Speech Language Modeling for Dual-Channel Spoken Dialogue via Next-Token-Pair Prediction

Qichao Wang, Ziqiao Meng, Wenqian Cui, Yifei Zhang, Pengcheng Wu, Bingzhe Wu, Irwin King, Liang Chen, Peilin Zhao · 2025

Read NTPP : Generative Speech Language Modeling for Dual-Channel Spoken Dialogue via Next-Token-Pair Prediction by Qichao Wang, Ziqiao Meng, Wenqian Cui, Yifei Zhang, Pengcheng Wu, Bingzhe Wu, Irwin King, Liang Chen, Peilin Zhao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00975.txt.

Description

Qichao Wang and eight co-authors introduce a 2025 method for spoken dialogue between two channels. Speech language models aim to talk with people in a fluid way, like the best voice systems. Most past models do not fully use two-channel speech, which holds both speakers and shows how turns pass back and forth.

Their method, called NTPP, trains a model to predict the next token pair, one token for each channel at once. The setup works with a plain decoder design and does not tie the model to one speaker. On standard tests, it improved turn-taking, reply fit, and how natural replies sound. It also answered with much lower delay than rival methods, which helps real-time talk.

Catalog record

CREATORQichao Wang, Ziqiao Meng, Wenqian Cui, Yifei Zhang, Pengcheng Wu, Bingzhe Wu, Irwin King, Liang Chen, Peilin Zhao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00975

Browse the full library · About the Tower of Babel