Raon-OpenTTS: Open Models and Data for Robust Text-to-Speech

Semin Kim ∗†, Seungjun Chung ∗, Taehong Moon, Sangheon Lee †, Minyoung Ahn †, Keon Lee, Nam Soo Kim, Jaewoong Cho, Ludwig Schmidt, Kangwook Lee, Dongmin Park · 2026

Read Raon-OpenTTS: Open Models and Data for Robust Text-to-Speech by Semin Kim ∗†, Seungjun Chung ∗, Taehong Moon, Sangheon Lee †, Minyoung Ahn †, Keon Lee, Nam Soo Kim, Jaewoong Cho, Ludwig Schmidt, Kangwook Lee, Dongmin Park (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20830.txt.

Introduction

Semin Kim and ten colleagues present Raon-OpenTTS, open models and data for robust text-to-speech. The part of large-scale open data in recent speech progress remains underexplored, though closed-data models set the pace. Their pooled dataset aggregates 615,000 hours and 240 million speech segments from public English corpora and web recordings. A model-based filtering pipeline derives a curated core of 510,000 hours and 194 million segments, used to train diffusion-transformer models from 0.3 to 1 billion parameters.

Catalog record

CREATORSemin Kim ∗†, Seungjun Chung ∗, Taehong Moon, Sangheon Lee †, Minyoung Ahn †, Keon Lee, Nam Soo Kim, Jaewoong Cho, Ludwig Schmidt, Kangwook Lee, Dongmin Park
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53217
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20830

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Raon-OpenTTS: Open Models and Data for Robust Text-to-Speech Semin Kim ∗†, Seungjun Chung ∗, Taehong Moon, Sangheon Lee †, Minyoung Ahn †, Keon Lee, Nam Soo Kim, Jaewoong Cho, Ludwig Schmidt, Kangwook Lee, Dongmin Park Abstract Recent advances in text-to-speech (TTS) models show impressive speech naturalness and quality, yet the role of large-scale open data in driving this progress remains underexplored. In this work, we introduce Raon-OpenTTS , an open TTS model that performs competitively with state-of-the-art closed-data TTS models, and Raon-OpenTTS-Pool , a large-scale open dataset for reproducible TTS training. Raon-OpenTTS-Pool consists of 615K hours of 240M speech segments aggregated from publicly available English speech corpora and web-sourced recordings. With a model-based filtering pipeline applied to Raon-OpenTTS-Pool, we derive Raon-OpenTTS-Core , a curated, high-quality subset of 510K hours and 194M speech segments. Using Raon-OpenTTS-Core, we train Raon-OpenTTS, a series of diffusion transformer (DiT)-based TTS models from 0.3B to 1B parameters. On multiple benchmarks, Raon-OpenTTS-1B shows comparable performance to state-of-the-art models such as Qwen3-TTS and CosyVoice 3, which are trained on several million hours of proprietary speech data. Notably, on Seed-TTS-Eval, Raon-OpenTTS-1B achieves a word error rate (WER) of 1.78 % \% and a speaker similarity (SIM) of 0.749, ranking second on WER and first on SIM among recent open-weight TTS baselines. On CV3-Hard-EN, Raon-OpenTTS-1B achieves a WER of 6.15 % \% and a SIM of 0.775, ranking first on both metrics. Furthermore, to support robust evaluation, we introduce Raon-OpenTTS-Eval , a structured benchmark for assessing TTS robustness across diverse acoustic conditions including clean, noisy, in-the-wild, and expressive speech. On Raon-OpenTTS-Eval, Raon-OpenTTS-1B achieves the best average WER and SIM among all evaluated models, and the second-best human preference, as measured by comparative mean opinion score (CMOS). Our data pool, filtering pipeline, training code, and checkpoints are publicly available at https://github.com/krafton-ai/RAON-OpenTTS . \uselogo \paperdate August 10, 2026 † † footnotetext: ∗ Equal contribution. † † footnotetext: † Work done while doing an internship at KRAFTON. 1 Introduction Text-to-speech (TTS) synthesis has advanced rapidly in recent years, with modern models capable of producing high-quality speech across diverse speakers, styles, and acoustic conditions. Despite the growing number of TTS models, most state-of-the-art models do not fully disclose their training data or data curation pipelines, which limits the research community to systematically study, reproduce, and build upon these advances. Just as open data efforts have played a critical role in accelerating progress in other domains, such as those underlying large language models (LLMs) ( 31 ) , CLIP ( 11 ) , and Whisper ( 27 ) , establishing open datasets and models for TTS is essential to enable systematic and reproducible research at scale. State-of-the-art TTS models trained on large-scale proprietary data, such as Qwen3-TTS ( 18 ) and CosyVoice 3 ( 9 ) , achieve remarkable zero-shot speech generation performance across diverse speakers and acoustic conditions. However, these models are trained on multi-million hours of proprietary speech data unavailable to the public. Among models trained entirely on open speech-text data, F5-TTS ( 7 ) and MaskGCT ( 41 ) show the most competitive performance. Both models are trained on approximately 100K hours of a single speech dataset, Emilia ( 16 ) . Nevertheless, as shown in Table 1 , their performance still exhibits a significant gap compared to state-of-the-art systems trained on proprietary data, highlighting the need for a comprehensive study on whether large-scale, multi-source open datasets can bridge this gap and enable fully reproducible models. In this paper, we establish a high-performing, fully reproducible TTS framework with open data, open weights, and a transparent training pipeline. We first present Raon-OpenTTS-Pool, a 615K-hour English speech-text dataset constructed from 10 publicly available speech corpora together with web-sourced recordings. From this pool, we derive Raon-OpenTTS-Core, a filtered training subset constructed using a model-based pipeline that removes potentially problematic speech segments based on transcription consistency, acoustic quality, and speech activity ratio. Next, we release Raon-OpenTTS, a series of diffusion transformer (DiT)-based TTS models with 0.3B and 1B parameters, trained on our proposed datasets. Notably, Raon-OpenTTS-1B trained on Raon-OpenTTS-Core achieves performance comparable to state-of-the-art TTS models across popular TTS benchmarks such as Seed-TTS-Eval ( 2 ) and CV3-Eval ( 9 ) , ranking first or second in word error rate (WER) and speaker similarity (SIM) among recent zero-shot TTS baselines. Moreover, to support robust evaluation on diverse acoustic conditions, we introduce Raon-OpenTTS-Eval, a structured benchmark constructed from 12 publicly available speech datasets, including CMU-ARCTIC ( 21 ) , TED-LIUM3 ( 17 ) , and EmoV-DB ( 1 ) . We group these datasets into four acoustic regimes, Clean, Noisy, Wild, and Expressive to cover controlled read speech, noisy environments, in-the-wild conversations, and expressive speech. Unlike existing benchmarks that rely on prompts drawn from a single read-speech dataset and evaluate only a limited number of generations, Raon-OpenTTS-Eval comprises 6K speech prompt-text pairs sampled from diverse datasets, enabling robust assessment across acoustic conditions. On Raon-OpenTTS-Eval, Raon-OpenTTS-1B achieves the best average WER and SIM across acoustic regimes while matching the top-performing models in human preference scores, such as comparative mean opinion score (CMOS) and similarity mean opinion score (SMOS). Our contributions are summarized as follows: • We introduce Raon-OpenTTS-Pool , a 615K-hour English speech corpus aggregated from 10 publicly available sources and web-sourced recordings, which is the largest openly available multi-source dataset curated for TTS training to our knowledge. • We derive Raon-OpenTTS-Core , a filtered subset of 510K hours and 194M speech segments from Raon-OpenTTS-Pool, and show that training on Raon-OpenTTS-Core consistently improves zero-shot TTS performance over the unfiltered pool. • We introduce Raon-OpenTTS-Eval , a robustness-oriented evaluation benchmark spanning four acoustic regimes (Clean, Noisy, Wild, Expressive) with 6K prompt-text pairs, enabling systematic analysis of zero-shot TTS across diverse real-world conditions. • We release Raon-OpenTTS , a DiT-based TTS model family (0.3B, 1B parameters), which ranks first or second in WER and SIM among recent zero-shot TTS baselines on Seed-TTS-Eval and CV3-Eval, competitive with models trained on large-scale proprietary data. Table 1 : Results on Seed-TTS-Eval ( 2 ) benchmark. Raon-OpenTTS outperforms the open-data, open-weight baselines while remaining comparable with strong open-weight, closed-data TTS baselines. We report the word error rate (WER) and speaker similarity (SIM). Bold indicates the best performance, and underline indicates the second-best performance among the compared open-weight models. Model Param. Training Data Open-Weight Open-Data WER \downarrow SIM \uparrow Human - - - - 2.14 0.734 Seed-TTS - - 2.25 0.762 CosyVoice 3 1.5B \sim 1M 2.21 0.720 Index-TTS 2 1.5B 55K ✓ 2.18 0.709 Llasa 8B 250K ✓ 3.63 0.581 VoxCPM 0.5B 1.8M ✓ 1.98 0.730 CosyVoice 2 0.5B 170K ✓ 2.61 0.659 CosyVoice 3 0.5B \sim 1M ✓ 2.50 0.698 Qwen3-TTS 1.7B \sim 5M ✓ 1.46 0.715 Voxtral TTS 4B - ✓ 2.19 0.663 MaskGCT 0.6B 100K ✓ ✓ 2.57 0.713 F5-TTS 0.3B 100K ✓ ✓ 2.04 0.671 Raon-OpenTTS-0.3B 0.3B 510K ✓ ✓ 1.95 0.687 Raon-OpenTTS-1B 1.0B 510K ✓ ✓ 1.78 0.749 2 Background & Related Work 2.1 Text-to-speech models Discrete approaches generate speech by modeling sequences of discrete acoustic or codec tokens. VALL-E ( 40 ) introduced the neural codec language modeling paradigm, framing zero-shot TTS as conditional token prediction over discrete codec representations. Building on this, MaskGCT ( 41 ) applies

Read the complete text