Modelling the Diachronic Emergence of Phoneme Frequency Distributions

Fermín Moscoso del Prado Martín, Suchir Salhan · 2026

Read Modelling the Diachronic Emergence of Phoneme Frequency Distributions by Fermín Moscoso del Prado Martín, Suchir Salhan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09503.txt.

Introduction

Fermín Moscoso del Prado Martín and Suchir Salhan ask why phoneme frequency patterns look so regular across languages, with exponential-tailed rank curves and a link between inventory size and entropy. They build a stochastic model of how sounds change over time and simulate inventories evolving under it. A naive version matches the rank curve shape but misses other facts. Adding a functional load effect and a pull toward a preferred inventory size makes the simulations match both target patterns.

Catalog record

CREATORFermín Moscoso del Prado Martín, Suchir Salhan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27832
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.09503

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Modelling the Diachronic Emergence of Phoneme Frequency Distributions Fermín Moscoso del Prado Martín, Suchir Salhan Abstract Phoneme frequency distributions exhibit robust statistical regularities across languages, including exponential-tailed rank-frequency patterns and a negative relationship between phonemic inventory size and the relative entropy of the distribution. The origin of these patterns remains largely unexplained. In this paper, we investigate whether they can arise as consequences of the historical processes that shape phonological systems. We introduce a stochastic model of phonological change and simulate the diachronic evolution of phoneme inventories. A naïve version of the model reproduces the general shape of phoneme rank-frequency distributions but fails to capture other empirical properties. Extending the model with two additional assumptions –an effect related to functional load and a stabilising tendency toward a preferred inventory size– yields simulations that match both the observed distributions and the negative relationship between inventory size and relative entropy. These results suggest that some statistical regularities of phonological systems may arise as natural consequences of diachronic sound change rather than from explicit optimisation or compensatory mechanisms. 1 Introduction The frequency distributions with which different phonemes occur in a language can provide insights into the nature, representation, and processing of human language. Nevertheless, despite its importance, only a handful of studies have investigated the nature of these distributions; most investigated these distributions from a macroscopic (in the sense of 17 ) perspective, considering the shape of the rank-frequency plots ( 27 ; 8 ; 18 ; 19 ; 15 ; 23 ) . Recently, it has been reported ( 23 ) that –at both macro- and microscopic levels of description– phoneme frequency distributions exhibit detectable effects consistent with the ‘Compensation Hypothesis’ ( 9 ; 20 ) . This hypothesis predicts that increased complexity in one domain of language is offset elsewhere in the language. Several studies had previously found evidence for this hypothesis involving balancing aspects of the phonological system with other aspects of language structure ( 21 ; 25 ; 24 ) . It is, however, remarkable that compensation is already detectable by examining the unigram phoneme frequency distributions alone. An important related question has received little attention: How do phoneme frequency distributions arise in diachronic terms? In particular, one could also ask whether what appear as compensation effects might in fact be unexpected consequences of the historical processes that have shaped the phoneme inventories. This would open the possibility of compensation phenomena being epiphenomenal, rather than the result of any actual optimisation process. 2 and 3 introduce a stochastic split-and-merger model of sound change in which phoneme inventories evolve through repeated splitting and merging events. Their simulations show that statistical patterns commonly associated with phonological markedness can emerge from simple diachronic processes, without assuming markedness as a primitive property of phonological systems. In a similar vein, in this study, we introduce a model of phoneme change based on 11 ’s ( 11 ) typology of phonological changes. We use this model to investigate whether two simple diachronic principles –functional load and a stabilising tendency in phoneme inventory size– are sufficient for generating both the observed phoneme rank-frequency distributions and the negative relationship between phonemic inventory size and relative entropy. In what follows, we first describe the empirical properties of phoneme frequency distributions that our model aims to explain (Section 2). We then introduce a stochastic model of phonological change (Section 3). We examine three incremental versions of the model of increasing complexity: a naïve baseline (Section 3.3), a version incorporating effects related to functional load (Section 3.4), and a model further introducing a central tendency in phonemic inventory size (Section 3.5). We show that the latter reproduces both the observed rank-frequency patterns of phoneme frequencies and the negative relationship between phonemic inventory size and relative entropy, suggesting that these macroscopic patterns may arise as natural consequences of diachronic phonological dynamics. 2 Properties of Phoneme Distributions (a) (b) Figure 1: (a) Rank-frequency plots (note the log-log scale) for the phoneme frequency distributions across the languages in 15 ’s ( 15 ) dataset of Australian language varieties, and those in NorthEuraLex. Each line plots one language. (b) Relationship between PIS and relative entropy for the languages in 15 ’s ( 15 ) dataset of Australian language varieties, and those in NorthEuraLex. Each point plots one language. The solid line plot a log-linear regression, and the shading plots its 95% C.I.. The dashed line plots the relation as predicted by 23 . Exponential tails: Contrary to arguments for power-law distributions of phonemes ( 27 ; 18 ; 19 ; 2 ; 3 ) , phoneme frequency distributions exhibit rank-frequency plots typical of exponential-tailed distributions ( 8 ; 15 ; 23 ) : In the double-logarithmic plane, the right tails of these distributions fall abruptly, quickly deviating from the straight lines that are characteristic of power-law-tailed distributions (e.g., word frequency distributions; 5 ). These patterns are illustrated in Figure 1 a for the 166 languages of 15 ’s ( 15 ) dataset of Australian language varieties, 1 1 1 Downloaded from https://zenodo.org/records/4104116 on May 1, 2025. and for the 107 languages in the NorthEuraLex database ( 6 ) . 2 2 2 v0.9, downloaded from the LexiBank Project at https://github.com/lexibank/northeuralex on March 3, 2026. Correlation between phonemic inventory size and relative entropy: In a recent study, 23 report that –across the world’s languages– there is a negative correlation between a language’s Phonemic Inventory Size (PIS), and the relative entropy 26 of its phoneme distribution. The entropy of the phoneme distribution is an indicator of the per-phoneme informational content of a language ( 4 ) . Generally speaking, increasing the PIS increases the potential value of the distribution’s entropy. However, the reduction in relative entropy attenuates the effect of increasing the PIS on the inventory’s entropy, as would be predicted by the Compensation Hypothesis ( 9 ; 20 ) . This is illustrated in Figure 1 b. The figure plots the negative correlation between PIS and relative entropy across the languages in the Australian languages and NorthEuraLex datasets mentioned above. Note that this relation is rather robust, it is present on the Australian language dataset –which was one of the datasets used by Moscoso del Prado Martín and Salhan–, however, the relation also extends to the NorthEuraLex languages –not used in the previous study. In fact, as shown in the figure, the precise prediction made by Moscoso del Prado Martín and Salhan (dashed line in the figure) extrapolates into the NorthEuraLex observations remarkably well. 3 Modelling Phonological Change 3.1 Phonological changes Phonological changes (also known as phonemic changes) are diachronic changes within a language’s system of contrastive sounds. Such changes go beyond mere shifts in pronunciation, which are referred to as phonetic changes . They affect the oppositions among phonemes, and may result in changes to a language’s phoneme inventory: Contrasts may arise, disappear, or be reorganised, resulting in a restructuring of the language’s sound system. Phonological changes can be of different types. Using 11 ’s ( 11 ) systematisation, we can distinguish between three main types: Primary splits (also known as conditioned mergers) occur when some instances of a phoneme A become an already existing phoneme B in particular contexts. In these cases, the

Read the complete text