An Exploration of ECAPA-TDNN and x-vector Speaker Representations in Zero-shot Multi-speaker TTS

Marie Kunešová, Zdeněk Hanzlíček, Jindřich Matoušek · 2025

Read An Exploration of ECAPA-TDNN and x-vector Speaker Representations in Zero-shot Multi-speaker TTS by Marie Kunešová, Zdeněk Hanzlíček, Jindřich Matoušek (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20190.txt.

Description

Marie Kunešová and co-authors compare voice fingerprints for speech synthesis in a 2025 paper. Zero-shot text-to-speech systems clone an unseen speaker's voice from a short clip, guided by a numeric embedding of that voice.

The team fixed one synthesis system and swapped in three encoders that make the embeddings: the system's own H/ASP encoder, x-vectors, and ECAPA-TDNN. All were trained on Czech read speech and tested on 24 new speakers. Listeners judged how alike the fake and real voices sounded, and math checks on the embeddings agreed. The built-in encoder won both tests, with ECAPA-TDNN ahead of x-vectors. The result helps builders pick encoders for new voices.

Catalog record

CREATORMarie Kunešová, Zdeněk Hanzlíček, Jindřich Matoušek
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-20190

Browse the full library · About the Tower of Babel