Collecting, Curating, and Annotating Good Quality Speech deepfake dataset for Famous Figures: Process and Challenges

Hashim, Surya, Raksha, Nithin, Lekha, Hafiz · 2025

Read Collecting, Curating, and Annotating Good Quality Speech deepfake dataset for Famous Figures: Process and Challenges by Hashim, Surya, Raksha, Nithin, Lekha, Hafiz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00324.txt.

Description

Speech synthesis tools can now imitate a person's voice well enough to fool many listeners, and public figures are frequent targets of such impersonation. Malik and co-authors describe how they built a dataset of real and fake speech for ten public figures, including political leaders, and they document the problems they met along the way. Their pipeline gathers high-quality real speech samples on its own and uses transcription-based segmentation to cut the audio into clean pieces, which raised the quality of the fake clips.

The team tried several synthesis routes, from single-speaker training to zero-shot methods, and records how its approach changed over time. The resulting dataset pairs real and synthetic samples and reached a naturalness score of 3.69 on a standard quality scale. In listening tests, people misclassified the fake speech 61.9 percent of the time, which shows how hard such fakes are to spot.

Catalog record

CREATORHashim, Surya, Raksha, Nithin, Lekha, Hafiz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-00324

Browse the full library · About the Tower of Babel