SonoEdit: Null-Space Constrained Knowledge Editing for Pronunciation Correction in LLM-Based TTS
Ayush Pratap Singh, Harshit Singh, Nityanand Mathur, Akshat Mandloi, Sudarshan Kamath · 2026
Read SonoEdit: Null-Space Constrained Knowledge Editing for Pronunciation Correction in LLM-Based TTS by Ayush Pratap Singh, Harshit Singh, Nityanand Mathur, Akshat Mandloi, Sudarshan Kamath (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17086.txt.
Introduction
Ayush Pratap Singh and a team of four co-authors fix how speech bots say hard names. Speech bots oft botch names from low-resource tongues. Names of folks, brands, and places get the worst of it. Those names are rare in the big English train sets. Past fixes need dear tagged speech from many tongues. Their 2026 preprint edits bot facts in a null-space cage.
The cage keeps edits from harm to the bot's base speech. Just the name's sound path gets the fix. No vast new speech sets are called for. Such fixes aid voice tools in mixed-tongue lands. They curb the sting of a name said wrong.
Catalog record
| CREATOR | Ayush Pratap Singh, Harshit Singh, Nityanand Mathur, Akshat Mandloi, Sudarshan Kamath |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-17086
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SonoEdit: Null-Space Constrained Knowledge Editing for Pronunciation Correction in LLM-Based TTS Ayush Pratap Singh, Harshit Singh, Nityanand Mathur, Akshat Mandloi, Sudarshan Kamath Abstract Neural text-to-speech systems systematically mispronounce low-resource proper nouns, particularly non-English names, brands, and geographic locations due to their underrepresentation in predominantly English training corpora. Existing solutions require expensive multilingual data collection or manual phonetic annotation, limiting TTS deployment in diverse linguistic contexts. We introduce SonoEdit , a model editing technique that surgically corrects pronunciation errors in pre-trained TTS models without retraining. Correcting such errors traditionally requires costly supervised finetuning or manual phoneme injection. In this work, we present a parsimonious alternative using Null-Space Pronunciation Editing, a single-shot parameter update that modifies the pronunciation of specific words while provably preserving the rest of the model’s behavior. We first adapt Acoustic Causal Tracing to identify the specific Transformer layers governing text-to-pronunciation mapping. We then employ Null-Space Constrained Editing to compute a closed-form weight update that rectifies the target pronunciation while remaining mathematically orthogonal to the manifold of general speech, constructing a constrained update that drives the model’s acoustic output toward a desired pronunciation exemplar while ensuring zero first-order change on a preserved corpus. 1 Introduction Modern neural text-to-speech systems have achieved remarkable naturalness and expressiveness, yet they consistently struggle with a fundamental challenge: correctly pronouncing words outside their training distribution. Proper nouns (brand names, personal names, geographic locations), technical terminology, and neologisms are frequently mispronounced, limiting the deployment of TTS in domains requiring accurate pronunciation like customer service, navigation systems, educational content, and accessibility applications. Phoneme dictionaries [ 14 ] require manual annotation and don’t generalize to morphological variations. Traditional TTS systems like Tacotron 2 [ 2 ] and FastSpeech 2 [ 21 ] handle pronunciations through explicit phoneme inputs. Recent codec-based systems like VALL-E [ 27 ] and VoiceBox [ 15 ] learn implicit mappings but struggle with rare words. Global fine-tuning is prohibitively expensive and prone to catastrophic forgetting, where correcting a single pronunciation can degrade prosody, speaker identity, or other acoustic properties. LoRA and similar PEFT methods reduce computational cost but still require task-specific training and lack explicit guarantees about preserving general model behavior. Moreover, prompt engineering for LLM-based TTS is unreliable and context-dependent. All these leads to a very important question in terms of text-speech alignment: Where does pronunciation live in a large language model(LLM) based text-to-speech(TTS) system, and how can we surgically modify it for specific texts while preserving all other model behavior? SonoEdit addresses this very problem through a novel combination of three key ideas: 1. Precise Localization via Acoustic Causal Tracing: By adapting causal tracing techniques from the mechanistic interpretability literature, we identify the specific Transformer layers (often a narrow range such as layers i to j ) that are responsible for handling grapheme-to-phoneme mappings. This localization is more precise than layer-wise or module-level interventions, allowing us to focus corrections exactly where they are needed. 2. Orthogonal Corrections via Null-Space Constrained Editing: Rather than applying arbitrary weight perturbations or training new parameters, we compute a closed-form weight update that rectifies the target pronunciation while remaining mathematically orthogonal to the manifold of general speech. Specifically, we identify the null-space of the projection operator corresponding to general acoustic features, and constrain our weight update to lie entirely within this null-space. This ensures that the correction cannot affect any aspect of model behavior other than the target pronunciation. 3. Parameter Parsimony and One-Shot Correction: Unlike PEFT methods, SonoEdit does not introduce additional trainable parameters. The weight update is computed in closed-form via simple matrix operations, making it computationally efficient and applicable in a one-shot manner without any training loop. This is particularly valuable for deployed TTS systems where re-training is infeasible. To the best of our knowledge, SonoEdit is the first work to explore the application of null-space knowledge editing to neural TTS systems. By synthesizing precise localization, orthogonal constraints, and closed-form solutions, SonoEdit overcomes the current trade-off between computational efficiency, correctness preservation, and parameter efficiency. It enables surgical, parsimonious modifications to LLM-based TTS models that are guaranteed not to introduce catastrophic forgetting while requiring minimal computational overhead. 2 Related Works 2.1 LLM-based Text-to-Speech Modelling Recent advances in neural text-to-speech (TTS) have demonstrated that Large Language Models (LLMs) can be effectively repurposed for high-quality speech synthesis. AudioLM [ 3 ] pioneered language modeling for audio generation, while VALL-E [ 27 ] demonstrated zero-shot voice cloning through in-context learning. SoundStorm [ 4 ] improved efficiency through parallel generation, and NaturalSpeech 2 [ 24 ] achieved human-parity through latent diffusion. These systems leverage neural codecs like EnCodec [ 7 ] and SoundStream [ 28 ] to discretize audio into tokens.Models such as Orpheus [ 5 ] and Sesame [ 23 ] leverage the semantic and linguistic understanding learned during pretraining to generate expressive, natural-sounding speech with superior prosody compared to traditional concatenative or unit-selection methods. These LLM-based TTS approaches operate by conditioning the speech decoder on embeddings derived from text or other linguistic representations. The key advantage is that LLMs capture long-range linguistic dependencies and tonal variations, enabling the generation of speech with nuanced prosody, stress patterns, and intonation contours. However, despite their remarkable performance on in-distribution data, these models exhibit a critical failure mode: the hallucination of incorrect pronunciations for rare or out-of-distribution proper nouns that were rarely encountered during training. This phenomenon is particularly problematic in applications such as navigation systems, news reading, or multilingual voice assistants, where accurate pronunciation of named entities is essential for user comprehension. Figure 1: A schematic diagram illustrating an LLM-based speech generation pipeline. A Raw Waveform is first processed by a Tokenizer to produce a sequence of Discrete Tokens . These tokens are then input into a Large Language Model (LLM) , which generates a sequence of New Tokens . Finally, a Decoder converts the new tokens into a Speech Waveform . 2.2 Locating and Editing Word-Pronunciation Associations in TTS Understanding and modifying the internal representations of neural TTS models is a critical research direction. Prior work has explored localization through probing classifiers [ 1 ] , causal tracing [ 17 ] , and attribution patching [ 10 ] . Layer-wise analysis [ 26 ] in language models revealed that different layers encode different linguistic phenomena. In the context of TTS, recent work has focused on identifying which components of the model are responsible for handling token-to-pronunciation features. Some studies have proposed techniques to directly intervene in specific layers to correct pronunciation errors. However, such approaches often employ crude modification strategies, such as simple weight perturbations or layer-wise interventions, which lack the precision necessary to modify target pronunciations without degrading the model’s general acoustic capabilities or speaker identity preservation. Our work builds upon these insights by employing a more principled approach: we use Acoustic Causal Tracing to precisely identify the Transformer layers responsible for handling G2P mappings, and then apply null-space constrained editing to ensure that corrections are orthogonal to the manifold of general speech characteristics. 2.3 Knowledge Editing Knowledge editing is an emerging paradigm for modifying the factual knowledge encoded in neural networks without catastrophic forgetting. Recent methods such as ROME (Rank-One Model Editing) [ 18 ] , MEMIT [ 19 ] , MEND [ 20 ] ,