On the Semantics of Large Language Models
Martin Schüle · 2025
Read On the Semantics of Large Language Models by Martin Schüle (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05448.txt.
Introduction
Martin Schüle asks what it means to say a large language model understands words, in a 2025 paper. Systems such as ChatGPT can write and chat in ways that look human, which tempts people to credit them with real grasp of meaning. Critics reply that the systems only juggle patterns, with no true sense behind the words.
Schüle narrows the debate to meaning at the level of single words and full sentences. He looks inside the models at how they store and build their picture of language. He then sets that picture beside classic theories of meaning from Frege and Russell. The result is a more careful view: the models show some marks of meaning, yet fall short of full human understanding in clear ways.
Catalog record
| CREATOR | Martin Schüle |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-05448
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On the Semantics of Large Language Models Martin Schüle Abstract Large Language Models (LLMs) such as ChatGPT demonstrated the potential to replicate human language abilities through technology, ranging from text generation to engaging in conversations. However, it remains controversial to what extent these systems truly understand language. We examine this issue by narrowing the question down to the semantics of LLMs at the word and sentence level. By examining the inner workings of LLMs and their generated representation of language and by drawing on classical semantic theories by Frege and Russell, we get a more nuanced picture of the potential semantic capabilities of LLMs. Keywords Philosophy of AI \cdot Large Language Models (LLMs) \cdot Language Understanding \cdot Semantics and Theories of Meaning \cdot Reference and Meaning in LLMs 1 Introduction The release of ChatGPT has made the potential of technical systems to replicate human language abilities visible to a large public. Large language models (LLMs) like ChatGPT can generate text, answer questions, and engage in conversations, creating an impression of language understanding. However, debate continues over their true capabilities and comprehension. Do they understand language in any meaningful way, or are they merely “stochastic parrots” ( Bender et al. 2021 ) ? The field of AI and with it LLMs will continue to evolve and due to their potential economic, social, and political impact, as well as their inherent scientific and philosophical intrigue, one needs to get a better grasp on the critical question: do LLMs understand language and if so in what sense? This raises issues about their trustworthiness, ability to reference truth, and propensity to “hallucinate”; issues which have a certain urgency giving the growing usage of LLMs. Part of the endeavour is to understand how LLMs work and what their capabilities are. LLMs have been developed in the sub-field of natural language processing (NLP) and use deep learning (DL) techniques or models. DL models are in principle complicated neural networks (NN). 1 1 1 In this article, we will use the terms neural network (NN) and deep learning (DL) model interchangeably unless specified otherwise. Now, such models can be studied in two ways. The first approach treats the system as a kind of black box, which is studied through its input-output behaviour. There are numerous studies that follow this approach, subjecting the LLM to a battery of tests to evaluate its performance ( Bubeck et al. 2023 ; Chang et al. 2024 ) . Basically, the LLM is treated as a kind of an alien entity which is being interrogated. The prototypical example is the Turing Test ( Turing 1950 ) , a question-and-answer game designed to determine whether responses are generated by a human or a machine. The second approach tries to investigate the inner workings of a LLM, the underlying mechanisms, by “opening the box” to eventually draw conclusions about their capabilities. In this study we follow the second approach as we are specifically interested in the representations generated by LLMs and their possible interpretations. DL models have fundamentally straightforward mathematical descriptions. Additionally, the trained model and its parameters can, in principle, be examined, making the inner workings of LLMs accessible for study. However, due to the complexity and scale of the models, the vast and complex datasets they may be trained on, and their interactions with the world and users, this is not a straightforward endeavor. The sub-field of explainable AI aims to analyze DL models by developing specific techniques for explainability ( Hassija et al. 2024 ) . Yet, the concepts we are interested in such as “understanding” are seldom addressed in these technical studies. What we need, therefore, is an approach that develops conceptual interpretations of LLMs beyond mere technical descriptions. In AI, some conceptual vocabulary with terms like “intelligence” and “semantics” are also used, yet descriptions in these terms can be vague, potentially even misleading. How can we address the question “What do LLMs understand?” without considering the definition of understanding itself? Philosophical literature has grappled with these questions for centuries; ignoring them seems presumptuous. While philosophy may not offer definitive answers, it should help clarify and refine these questions. The challenge rather lies in the vast volume of the accumulated literature on the notion of “understanding” while at the same the technical development progresses rapidly. We need to find some middle ground to navigate this scenario effectively. We address this challenge with a two-fold approach. First, we aim to identify certain stable elements within LLMs’ approach to language and base our analysis on these elements. Second, we narrow the question of “understanding” to the semantic capabilities of LLMs at the word and sentence levels. By gaining a better understanding of how LLMs represent word and sentence meanings, and how we can interpret these representations, we also progress toward the broader question of “understanding”. Our analysis will be in terms of what is known as the “classical semantic theory” which goes back to Frege and Russell and we will later discuss why this is relevant, even though other theories might align more closely with how LLMs operate. Clearly, there is room for further investigation in this area. The article is structured as follows. First, we identify the essential elements and concepts involved in LLMs’ representation of language. Next, we examine the semantic theories of Russell and Frege, focusing on the components critical to our purposes. With this analysis and conceptual framework, we revisit the questions about LLM semantics, situating them within a relevant technical and philosophical context. 2 What are LLMs? We first need to look at the inner workings of LLMs. Without this, we cannot make a precise case regarding the semantic qualities of LLMs. Our explanations will be general and focus on aspects essential for further discussion. Readers familiar with these topics may skip to the summary. As mentioned, discussing LLMs involves navigating a rapidly evolving research field. What may be considered state-of-the-art today may soon become outdated. However, we believe that certain stable elements in the LLM approach to language can be identified: 1. The probabilistic approach to modeling language. 2. The distributed representation of language. 3. The use of connectionist architectures such as neural networks (NN). 4. The use of large-scale models. In LLMs, all these elements are present and interwoven; however, it is beneficial to consider them separately for the time being. Also note that historically these elements correspond to different eras of language modeling in NLP and AI. Other aspects like specific model architectures will likely change or are currently undergoing changes, so it is essential to be aware that things can evolve quickly. Nonetheless, it is at times unavoidable to explain certain things in more detail such as the exact nature of the training or some specific model architecture to gain an understanding of the inner workings of current LLMs even though these aspects may change. 2.1 Language Models Let’s discuss the probabilistic approach first, which is closely linked to the concept of a language model (LM). An LM is a probabilistic representation of language, which goes back to Shannon ( Shannon 1951 ) , and has been used in natural language processing (NLP) for decades ( Jurafsky and Martin 2024 ) . Before