SoulX-Transcriber: A Robust End-to-End Framework for Multi-Speaker Speech Transcription

Yuhang Dai, Haopeng Lin, Zhennan Lin, Jiale Qian, Jun Wu, Hanke Xie, Hao Meng, Hanlin Wen, Chuang Ding, Shunshun Yin, Ming Tao, Lei Xie, Xinsheng Wang · 2026

Read SoulX-Transcriber: A Robust End-to-End Framework for Multi-Speaker Speech Transcription by Yuhang Dai, Haopeng Lin, Zhennan Lin, Jiale Qian, Jun Wu, Hanke Xie, Hao Meng, Hanlin Wen, Chuang Ding, Shunshun Yin, Ming Tao, Lei Xie, Xinsheng Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02400.txt.

Description

Dai and co-authors present SoulX-Transcriber, a system that writes down speech from many speakers at once. The task is hard for clear reasons. Voices can sound alike. Turns switch fast. Speech overlaps. Speaker boundaries are easy to miss. The system joins diarization and recognition in one language-model frame.

Training runs in two stages. First, speaker-aware pre-training sharpens speaker sense and boundary skills. Next, supervised fine-tuning tunes the full end-to-end task. The goal is text with the right speaker attached. Tests span AliMeeting, AISHELL-4, and AMI benchmarks. The authors report strong scores and robust behavior on all three. The system also adapts well across domains. It offers a unified route for messy, real-world group audio.

Catalog record

CREATORYuhang Dai, Haopeng Lin, Zhennan Lin, Jiale Qian, Jun Wu, Hanke Xie, Hao Meng, Hanlin Wen, Chuang Ding, Shunshun Yin, Ming Tao, Lei Xie, Xinsheng Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.02400

Browse the full library · About the Tower of Babel