DiscoPhon: Benchmarking the Unsupervised Discovery of Phoneme Inventories With Discrete Speech Units

Maxime, Manel, Angelo, Ewan, Emmanuel, Emmanuel · 2026

Read DiscoPhon: Benchmarking the Unsupervised Discovery of Phoneme Inventories With Discrete Speech Units by Maxime, Manel, Angelo, Ewan, Emmanuel, Emmanuel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18612.txt.

Introduction

Poli and co-authors release DiscoPhon, a test bed for finding phoneme sets from raw speech without labels. The benchmark covers six development and six test languages with wide phonemic contrasts. Systems get ten hours of speech in an unseen language. They must output discrete units that map onto a known phoneme inventory. Scores cover unit quality, recognition, and segmentation. Four multilingual baselines based on HuBERT and SpidR are included. Current models do carry phonemic signal, though results vary a lot by language.

Catalog record

CREATORMaxime, Manel, Angelo, Ewan, Emmanuel, Emmanuel
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27275
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.18612

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DiscoPhon: Benchmarking the Unsupervised Discovery of Phoneme Inventories With Discrete Speech Units Maxime, Manel, Angelo, Ewan, Emmanuel, Emmanuel Abstract We introduce DiscoPhon, a multilingual benchmark for evaluating unsupervised phoneme discovery from discrete speech units. DiscoPhon covers 6 dev and 6 test languages, chosen to span a wide range of phonemic contrasts. Given only 10 hours of speech in a previously unseen language, systems must produce discrete units that are mapped to a predefined phoneme inventory, through either a many-to-one or a one-to-one assignment. The resulting sequences are evaluated for unit quality, recognition and segmentation. We provide four pretrained multilingual HuBERT and SpidR baselines, and show that phonemic information is available enough in current models for derived units to correlate well with phonemes, though with variations across languages. Poli Khentout Ortiz Tandazo Dunbar Chemla Dupoux keywords self-supervised learning, discrete speech units, multilinguality † † address: 1 LSCP, ENS, EHESS, CNRS, PSL University, France 2 University of Toronto, Canada † † email: [email protected] 1 Introduction and related work Imagine a linguist arriving in a new community to document the local language. One of the first tasks is to establish its phoneme inventory (consonants and vowels). Could an automatic system help in this process? Half of the world’s languages are at risk of disappearing by the end of the century [ 21 ] , many before they can be documented. Several studies have addressed automatic phoneme inventory discovery [ 17 , 36 , 22 ] . Here, we propose a benchmark that leverages self-supervised speech representation learning (SSL) to accelerate research in this area. Discovering the correct set of phonemes for a language is crucial: encoding the wrong categories distorts or erases contrasts between words. A natural approach is to learn a mapping from speech to a finite set of categories directly from raw audio. This problem can be cast in terms of automatic discovery of discrete speech units, a line of research related to spoken term discovery [ 26 , 19 , 15 , 16 ] . Recent work has shown that self-supervised models encode phonetic and phonemic information at readily accessible levels in their representations [ 9 , 37 , 7 ] . Combining such models with a quantization step, like K -means vector quantization, should therefore yield units that retain this information [ 1 , 38 ] . These resulting pseudo-linguistic units can then serve as input to language models [ 18 , 23 , 27 ] , enabling semantic modeling of speech disentangled from speaker and acoustic characteristics [ 4 , 25 ] . For this to work, however, the units must abstract away from low-level acoustic properties and capture phoneme-level information, which is typically not the case for approaches such as neural codecs [ 24 ] . Whether such units generalize to typologically diverse languages remains largely untested. Our benchmark is designed to evaluate precisely this capability, in a way that integrates naturally with current SSL-based tokenization pipelines. Past benchmarks [ 11 , 10 , 12 ] have primarily focused on the evaluation of SSL representations that carry linguistic contrast as measured through ABX discrimination methods. Here, we go one step further and focus on deriving phoneme-like discrete units from these continuous representations from limited data ( \SI 10 \hour ), without supervision or annotations. This can be framed as an unsupervised clustering problem in which the discovered units should ideally correspond to the phoneme categories a linguist would use to describe this language. This immediately raises the issue of how many phonemes a language contains, which is difficult to answer, even for linguists, due to a long tail of allophones and quasi-phonemes [ 8 ] . Figure 1 : Overview of the streams in the evaluation pipeline. The model maps a waveform to units \bm{u} , evaluated against the gold phones \bm{p} via \textnormal{PNMI}(\bm{p},\bm{u}) . An assignment, here many-to-one, then assign units to phones \bm{a} , assessed for recognition with \textnormal{PER}(\bm{p},\bm{a}) and segmentation with R\textnormal{-value}(\bm{p},\bm{a}) and F_{1}(\bm{p},\bm{a}) . Table 1 : Phonemic categories considered in the benchmark. dev languages: German (41 phonemes), Swahili (29), Tamil (29), Thai (40), Turkish (27), and Ukrainian (35). test languages: Basque (29 phonemes), English (39), French (34), Japanese (42), Mandarin Chinese (42), and Wolof (39). German, English, French, and Wolof data from [ 11 , 13 ] , other languages from [ 3 , 2 ] . \eightpt Fricative Affricate Plosive Vibrant Nasal Approximant Monophthong Diphthong dev languages German \textipa f, \textipa s, \textipa S, \textipa ç, \textipa x, \textipa h \textipa t͡s \textipa p, \textipa t, \textipa k, \textipa b, \textipa d, \textipa \textscriptg \textipa r, \textipa \textfishhookr \textipa m, \textipa n, \textipa ŋ \textipa l, \textipa j \textipa I, \textipa i:, \textipa Y, \textipa y:, \textipa U, \textipa u:, \textipa e:, \textipa ø: \textipa a \textsubarch I, \textipa a \textsubarch U \textipa v, \textipa z \textipa @, \textipa o:, \textipa E, \textipa E:, \textipa \textrevepsilon , \textipa œ, \textipa O, \textipa a, \textipa a: Swahili \textipa f, \textipa T, \textipa s, \textipa S, \textipa h \textipa t͡S \textipa p, \textipa t, \textipa k, \textipa b, \textipa d, \textipa \textbardotlessj , \textipa \textscriptg \textipa \textfishhookr \textipa m, \textipa n, \textipa \textltailn \textipa w, \textipa l, \textipa j \textipa i, \textipa u, \textipa E, \textipa O, \textipa A \textipa v, \textipa D, \textipa z, \textipa G Tamil \textipa s, \textipa \textrtails \textipa t͡S, \textipa d͡Z \textipa p, \textipa \textsubbridge t, \textipa \textrtailt , \textipa k \textipa \textfishhookr \textipa m, \textipa n, \textipa \textrtailn , \textipa \textltailn , \textipa ŋ \textipa V, \textipa l, \textipa \textrtaill , \textipa \textturnrrtail , \textipa j \textipa i, \textipa i:, \textipa u, \textipa u:, \textipa e, \textipa e:, \textipa o, \textipa o:, \textipa a, \textipa a: Thai \textipa f, \textipa s, \textipa h \textipa t͡C, \textipa t͡C \super h \textipa p, \textipa t, \textipa k, \textipa P, \textipa b, \textipa d \textipa r \textipa m, \textipa n, \textipa ŋ \textipa w, \textipa l, \textipa j \textipa i, \textipa i:, \textipa W, \textipa W:, \textipa u, \textipa u:, \textipa e:, \textipa \textramshorns , \textipa \textramshorns : \textipa o, \textipa o:, \textipa E, \textipa E:, \textipa O:, \textipa a, \textipa a: \textipa i: \textsubarch a, \textipa W: \textsubarch a, \textipa u: \textsubarch a \textipa p \super h, \textipa t \super h, \textipa k \super h Turkish \textipa f, \textipa s, \textipa S, \textipa h, \textipa v, \textipa z \textipa t͡S, \textipa d͡Z \textipa p, \textipa t, \textipa k, \textipa b, \textipa d, \textipa \textscriptg \textipa \textfishhookr \textipa m, \textipa n \textipa l, \textipa j \textipa i, \textipa y, \textipa W, \textipa u, \textipa e, \textipa o, \textipa œ, \textipa a Ukrainian \textipa f, \textipa s, \textipa s \super j, \textipa S \textipa t͡s, \textipa t͡s \super j, \textipa t͡S, \textipa d͡Z \textipa p, \textipa t, \textipa t \super j, \textipa k, \textipa b, \textipa d, \textipa d \super j \textipa r, \textipa r \super j \textipa m, \textipa n, \textipa n \super j \textipa V, \textipa l, \textipa l \super j, \textipa j \textipa i, \textipa I, \textipa u, \textipa E, \textipa O, \textipa a \textipa x, \textipa z, \textipa z \super j, \textipa Z, \textipa H test languages Basque \textipa f, \textipa \textsubsquare s, \textipa \textinvsubbridge s, \textipa

Read the complete text