TalTech Systems for the Interspeech 2025 ML-SUPERB 2.0 Challenge

Tanel, Artem · 2025

Read TalTech Systems for the Interspeech 2025 ML-SUPERB 2.0 Challenge by Tanel, Artem (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01458.txt.

Description

Speech technology must handle many languages at once, and shared test challenges drive progress. This short paper describes the systems built at Tallinn University of Technology for the Interspeech 2025 ML-SUPERB 2.0 Challenge. The entry covers two tasks: naming the language being spoken, and transcribing speech in many languages. Language naming uses a hybrid design, pairing a pretrained language embedding model with a light speech recognizer that shares one encoder across languages and keeps a small word model per language.

For transcription, the team keeps three models and picks one per language based on training data and test results. The set includes a finetuned SeamlessM4T, a large multilingual model with custom language adapters, and a zero-shot variant. The combined system takes the top overall score in the challenge. The authors credit the per-language model choice for much of the gain.

Catalog record

CREATORTanel, Artem
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-01458

Browse the full library · About the Tower of Babel