SelfTTS: Cross-Speaker Style Transfer through Explicit Embedding Disentanglement and Self-Refinement using Self-Augmentation
Lucas H, João G. T, Pedro R, Flávio O, Mário U, Paula D. P · 2026
Read SelfTTS: Cross-Speaker Style Transfer through Explicit Embedding Disentanglement and Self-Refinement using Self-Augmentation by Lucas H, João G. T, Pedro R, Flávio O, Mário U, Paula D. P (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22252.txt.
Description
Ueda and co-authors present SelfTTS, a speech system that moves speaking style across voices. Most systems lean on pre-trained speaker or emotion encoders. SelfTTS needs neither. It separates speaker and emotion information with gradient reversal layers and a cosine similarity loss. A contrastive method then clusters the speaker and emotion embeddings by label. The system also refines its own output through self-augmentation, using its voice conversion skill. Tests show stronger emotional naturalness than top baselines. Target timbre and emotion also stay more stable.
Catalog record
| CREATOR | Lucas H, João G. T, Pedro R, Flávio O, Mário U, Paula D. P |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41765 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22252