Simplifications are Absolutists: How Simplified Language Reduces Word Sense Awareness in LLM-Generated Definitions
Lukas Ellinger, Miriam Anschütz, Georg Groh · 2025
Read Simplifications are Absolutists: How Simplified Language Reduces Word Sense Awareness in LLM-Generated Definitions by Lukas Ellinger, Miriam Anschütz, Georg Groh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-11981.txt.
Introduction
Lukas Ellinger, Miriam Anschutz, and Georg Groh test what simple language does to word definitions in this 2025 paper. Language models can define any word, but definitions written for children or learners may drop some meanings of words that have more than one.
The team built two test sets across languages and asked five models for definitions at three levels: normal, simple, and explain like I am five. Judges and human raters found that simpler text cut completeness sharply, leaving out other senses of homonyms. A fine tuned small model did far better at all levels. The lesson is to balance ease with full coverage for learners.
Catalog record
| CREATOR | Lukas Ellinger, Miriam Anschütz, Georg Groh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-11981
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Simplifications are Absolutists: How Simplified Language Reduces Word Sense Awareness in LLM-Generated Definitions Lukas Ellinger, Miriam Anschütz, Georg Groh Abstract Large Language Models (LLMs) can provide accurate word definitions and explanations for any context. However, the scope of the definition changes for different target groups, like children or language learners. This is especially relevant for homonyms—words with multiple meanings—where oversimplification might risk information loss by omitting key senses, potentially misleading users who trust LLM outputs. We investigate how simplification impacts homonym definition quality across three target groups: Normal, Simple, and ELI5. Using two novel evaluation datasets spanning multiple languages, we test DeepSeek v3, Llama 4 Maverick, Qwen3-30B A3B, GPT-4o mini, and Llama 3.1 8B via LLM-as-Judge and human annotations. Our results show that simplification drastically degrades definition completeness by neglecting polysemy, increasing the risk of misunderstanding. Fine-tuning Llama 3.1 8B with Direct Preference Optimization substantially improves homonym response quality across all prompt types. These findings highlight the need to balance simplicity and completeness in educational NLP to ensure reliable, context-aware definitions for all learners. 1 Introduction Figure 1: GPT-4o-mini definitions of “bat” under normal and simplified style constraints. The normal definition presents multiple senses, showing the word’s ambiguity. The simplified definition provides only one sense, indicating reduced word sense awareness. Large Language Models (LLMs) are increasingly being deployed across diverse domains, with education emerging as an up-and-coming area. These models have the potential to support personalized learning, provide immediate feedback, and increase accessibility for a wide range of learners ( Xu et al. 2024 ; Wang et al. 2024 ; Kasneci et al. 2023 ) . A core requirement for effective education is personalization. Students vary in their prior knowledge, learning preferences, and cognitive abilities ( Xu et al. 2024 ) . From young children and university students to individuals with cognitive impairments, learners benefit from tailored content that matches their comprehension level. However, LLMs can produce false or misleading information ( Xu et al. 2024 ) . Given their often authoritative tone and rapid accessibility, users, especially those with lower domain knowledge, may uncritically accept incorrect outputs as fact ( Kasneci et al. 2023 ) . This is particularly concerning in educational contexts, where reliance on incorrect information can hinder learning and discourage critical thinking. To improve accessibility, for groups like non-native speakers or individuals with cognitive impairments, educational content is often adapted into simplified, easy-read language ( Freyer et al. 2024 ) . While this makes information more accessible, it introduces a trade-off: essential information may be lost or oversimplified ( Trienes et al. 2024 ) . One common use case for LLMs is providing instant definitions or explanations across languages. Users often use prompts like ‘‘Explain like I’m five’’ (ELI5) to obtain simplified outputs. However, for polysemous words, like homonyms 1 1 1 We use the term homonym broadly to include both polysemous words and homonyms in the strict linguistic sense (i.e., words with multiple related or unrelated meanings) , simplification can obscure ambiguity. For instance, Figure 1 shows a user requesting definitions for “bat” in standard and simplified styles from GPT-4o mini. The standard response lists multiple meanings (e.g., animal, sports tool), while the simplified response only mentions the animal. This simplification may mislead users into assuming a single meaning. This risk is amplified by users’ tendency to assume that LLM responses are both correct and complete. We argue that high-quality definitions should strive for completeness : either (i) enumerate all plausible senses of a homonym, or (ii) exhibit Helpful Sense Awareness . This means clearly stating that not all possible senses are listed, or that additional context is needed for disambiguation. Responses that provide only some senses without such awareness may reinforce misconceptions about the word’s meaning. In this paper, we investigate how well state-of-the-art LLMs handle homonym definition tasks across varying levels of language complexity: Normal, Simple, and ELI5. We assess whether simplification impairs the model’s ability to acknowledge ambiguity and provide complete information. Our contributions are as follows: • We propose Helpful Sense Awareness , a novel metric for assessing whether LLMs appropriately acknowledge multiple senses of homonyms during definition tasks. • We present two datasets for evaluating LLM performance on homonym definitions in both multilingual and English settings. • We fine-tune Llama 3.1 8B using Direct Preference Optimization (DPO), greatly improving response quality on homonym definitions. • We empirically demonstrate, using both LLM-as-a-Judge and human annotations, that stylistic constraints aimed at simplification drastically degrade homonym definition quality in models such as DeepSeek-v3, Llama 4 Maverick, Qwen3-30B A3B, GPT-4o mini, and Llama 3.1 8B. 2 Background and Related Work Definition Modeling Noraset et al. 2017 introduced the task of Definition Modeling. The goal is to generate a definition for a given word based on its embedding. Definitions fall into two categories: static and context-dependent. Static definitions are found in dictionaries and lexicons. They provide fixed meanings for words based on predefined word senses, treating each word as having a discrete set of definitions. A related task is Word Sense Disambiguation (WSD). This focuses on identifying the correct sense of a word in a given context by assigning a word sense label ( Navigli 2009 ) . However, Kilgarriff 1997 challenges the idea that word senses are fixed, arguing that meaning emerges from usage and context. This underscores the limitations underlying traditional lexicon-based approaches. Recent research has predominantly focused on generating context-sensitive definitions, leveraging contextual information to produce precise and relevant meanings ( Mickus et al. 2024 ; Periti et al. 2024 ; Huang et al. 2021 ; Bevilacqua et al. 2020 ; Ishiwatari et al. 2019 ; Gadetsky et al. 2018 ) . Kong et al. 2022 focus on generating context-sensitive definition generation in simple language. Proietti et al. 2024 focus on sense selection rather than definition generation. They group WordNet senses based on homonymy relations, mapping them to coarse-grained sense clusters. They then probe contextual representations from pretrained language models (e.g., BERT, DeBERTa) using distance-based metrics, showing that they can distinguish homonymous senses with 95% accuracy. In contrast to the focus on context-sensitive methods, users often query “What is [word]?” without additional context. Building on the insight that PLMs can handle lexical ambiguity inherently, we evaluate how LLMs define homonyms in such cases. This allows us to assess their understanding of lexical word senses, their management of ambiguity, and the usefulness of their responses absent contextual cues. Simple Language Simplified language enhances accessibility for diverse audiences, including non-native speakers, domain novices, children, and individuals with cognitive impairments. Standards like the Web Content Accessibility Guidelines (WCAG) advocate for its use to foster inclusive communication ( W3C 2025 ) . This approach employs straightforward vocabulary, minimal jargon, clear sentence structures, and avoids complex grammar ( Freyer et al. 2024 ) . It is widely applied in fields such as law, healthcare, and education ( Garimella et al. 2022 ; Deilen et al. 2024 ; Rets et al. 2022 ) . Prior studies highlight that simplification in LLM-generated text can introduce omissions or vagueness ( Trienes et al. 2024 ; Agrawal and Carpuat 2024 ; Devaraj et al. 2022 ) . A related approach, Explain Like I’m Five (ELI5), popularized through a dataset of 270,000