Speech to Speech Synthesis for Voice Impersonation

Bjorn Johnson, Jared Levy · 2026

Read Speech to Speech Synthesis for Voice Impersonation by Bjorn Johnson, Jared Levy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-16721.txt.

Description

Bjorn Johnson and Jared Levy propose a Speech to Speech Synthesis Network for voice impersonation. Speech recognition and speech synthesis have each seen great success, but speech-to-speech processing is far less explored. The new model fuses the two fields to perform speech-to-speech style transfer, aiming to render one voice in the style of another.

Despite limits in capacity, the model generates realistic audio samples. It is benchmarked against a generative adversarial model for a similar task, and the authors report more convincing results. Voice researchers get a fused architecture for style transfer, along with a cautionary example of how readily voice identity can now be cloned.

Catalog record

CREATORBjorn Johnson, Jared Levy
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-16721

Browse the full library · About the Tower of Babel