I Have No Mouth, and I Must Rhyme: Uncovering Internal Phonetic Representations in LLaMA 3.2
Oliver McLaughlin, Arjun Khurana, Jack Merullo · 2025
Read I Have No Mouth, and I Must Rhyme: Uncovering Internal Phonetic Representations in LLaMA 3.2 by Oliver McLaughlin, Arjun Khurana, Jack Merullo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02527.txt.
Introduction
Oliver McLaughlin, Arjun Khurana, and Jack Merullo probe how a language model stores sound in a 2025 arXiv paper. Llama-3.2 can rhyme and do other phonetic tasks without ever hearing speech. The team asked what inner structure makes that possible.
Their results suggest the model builds a rich inner map of phonemes, the sound units of speech. The map shows clear high-level organization in the model's latent space. They also find a single attention head that moves phonetic information during rhyming tasks. Its output for vowels resembles the standard human vowel chart. The model learned this layout with no direct sound training.
Catalog record
| CREATOR | Oliver McLaughlin, Arjun Khurana, Jack Merullo |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-02527
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
I Have No Mouth, and I Must Rhyme: Uncovering Internal Phonetic Representations in LLaMA 3.2 Oliver McLaughlin, Arjun Khurana, Jack Merullo Abstract Large language models demonstrate proficiency on phonetic tasks, such as rhyming, without explicit phonetic or auditory grounding. In this work, we investigate how Llama-3.2-1B-Instruct represents token-level phonetic information. Our results suggest that Llama uses a rich internal model of phonemes to complete phonetic tasks. We provide evidence for high-level organization of phoneme representations in its latent space. In doing so, we also identify a “phoneme mover head” which promotes phonetic information during rhyming tasks. We visualize the output space of this head and find that, while notable differences exist, Llama learns a model of vowels similar to the standard IPA vowel chart for humans, despite receiving no direct supervision to do so. 1 Introduction Language models (“LMs”) cannot hear speech. In spite of this, many large LMs can consistently produce rhymes, poetry, alliteration, and other phenomena which seem to require a fundamental understanding of phonetic properties. We propose that these models complete these tasks using underlying token-level phonetic representations as well as circuits to retrieve phonetic information. Up to this point, study of LMs’ phonetic behavior has been largely limited to training models on grounded phonetic information [ English et al. 2023 , Popescu-Belis et al. 2023 ] . Anthropic’s recent work On the Biology of a Large Language Model [ Lindsey et al. 2025 ] uses attribution graphs to provide evidence of rhyme planning circuits in Claude 3.5 Haiku, but they do not rigorously study the internal phonetic representations that allow these circuits to function. It is reasonable to ask the extent to which an LM is able to infer phonetic properties directly from tokens. Following results that LMs and even simple text models can extract information about the world without direct supervision [ Louwerse and Benesh 2012 , Mikolov et al. 2013 , Gurnee and Tegmark ] , we hypothesize that LMs also learn a robust, structured model of phonetic information that supports interventions. We investigate how Llama 3.2 [ Grattafiori et al. 2024 ] represents phonetic information through methods commonly used in interpretability analysis and find evidence to support this hypothesis: rather than simply memorizing phonetic information for various tokens, Llama uses structure in its latent space across tokens to represent the phonetics of given input tokens. Our experiments follow a straightforward methodology. To explore linear token-level phonetic information, we employ linear probes to identify subspaces of the residual stream and embedding and inspect the subspaces. To explore the mechanisms that leverage this information, we isolate components of the model which prove to be impactful in expressing the LM’s phonetic beliefs. Using this simple approach, we find evidence of rich phonetic representations within Llama-3.2-1B-Instruct . In Section 2 , we find vectors in the embedding space corresponding to common English phonemes. We perform causal interventions in the embedding space using these vectors to alter the model’s performance on a rhyming task, demonstrating their role in rhyming processes. In Section 3 we identify a single “phoneme mover head” using activation patching. We decode this head’s result vectors using logit lens [ nostalgebraist 2020 ] and demonstrate that the phonetic information in this head is, to some extent, cross-lingual. In Section 4 , we use the result vectors of this phoneme mover head to perform a phonetically-informed dimensionality reduction on the embedding space in order to analyze the geometry of the phoneme vectors from Section 2 . We see consistent linear patterns across internal representations of vowel phonemes (Figure 1 ). Figure 1 : Patterns emerge from vowel representations under our methodology, revealing a world model partially inconsistent with human anatomy. These patterns differ from anatomical properties of vowel phonemes, suggesting the presence of a robust internal vowel model which is distinct from human vowel models. We construct an organized representation of these patterns and contrast it with existing anatomically-grounded vowel organization systems. 2 Phonetic Information in Token Embeddings In Llama 3.2, like in most open-source LMs, the tokenization process does not explicitly encode any phonetic information about input tokens. We hypothesize that some phonetic information is encoded through token embeddings. To investigate this hypothesis, we train a multi-hot linear probe to predict which phonemes are present in a word from its embedding. We differentiate phonemes based on the International Phonetic Alphabet, using WikiPron [ Lee et al. 2020 ] as a pronunciation reference. Probing the embedding space Our probe predicts the correct phonemes for approximately 96\% of single-token words, compared with 42\% for the same probe architecture trained on embeddings from a randomly-generated embedding matrix. This indicates that the model’s embedding matrix encodes some amount of recoverable phonetic information. Since this probe is linear, it essentially constitutes a linear map from Llama 3.2’s 2048-dimensional embedding space to what we call an “IPA phoneme space”: a 44-dimensional space with one axis for each common English-language phoneme. Each row of our probe matrix, therefore, could be considered a representation of its corresponding phoneme in the embedding space. Causal interventions on embeddings To test the degree to which the rows of our probe represent phonemes in latent space, we run a causal intervention experiment to change the expected rhyming output for a given target word by intervening on embedding vectors. We test the model on a simple rhyming task: prompt = """Here are a few examples of words that rhyme with <word>:""" where <word> is a single-token word with one unique vowel sound. We then select two “phoneme vectors” (rows of our probe matrix) in the embedding space: \xi , the phoneme vector corresponding to the vowel in <word> ; and \mu , the phoneme vector corresponding to a different vowel. We perform a forward pass of Llama with the following intervention at the embedding step: E=E+c(\mu-\xi) where E is the embedding vector corresponding to our rhyming word <word> , and c is a scalar. As we increase c (the weight of our intervention), the model’s prediction tends to switch from words with the \xi vowel to words with the \mu vowel. Figure 2 shows example model output results where <word> is leet pronounced /li:t/, \xi corresponds to /i/, and \mu corresponds to E. Figure 2 : Example intervention on rhymes with leet . Blue indicates that the \xi phoneme /i/ is present, red indicates that the \mu phoneme /E/ is present. 3 Phoneme Mover Head Figure 3 : Across three examples: Attention patterns of H13L12 at the final token shows the head attends to the rhyme target token. Running logit lens on the corresponding result vector (shown after \rightarrow ) produces phonetically similar tokens. Given that embeddings seem to contain phonetic information, we seek to identify model components which use this information to complete rhyming tasks. We run activation patching experiments over all attention heads and MLP components across all layers. Patching setup To patch, we perform two full passes of the model using parallel prompts containing two sufficiently different 1 1 1 Two words are “ sufficiently different ” iff there is no third word that rhymes with both simultaneously. rhyme target words. For example, setting <word>="clean" in our above template results in the top predicted token