Could the Road to Grounded, Neuro-symbolic AI be Paved with Words-as-Classifiers?

Casey Kennington, David Schlangen · 2025

Read Could the Road to Grounded, Neuro-symbolic AI be Paved with Words-as-Classifiers? by Casey Kennington, David Schlangen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06335.txt.

Introduction

Casey Kennington and David Schlangen argue for artificial intelligence that both understands language and connects it to the world. Models of meaning come in three broad kinds: formal systems built on logic, statistical systems learned from text, and grounded systems tied to perception. Each kind has strengths and gaps. Recent work adds visual knowledge to language models, and many researchers want to add symbolic methods, hoping to combine all three.

The authors champion one model, words-as-classifiers, in which each word is a small classifier trained to judge whether the word fits what is seen. That model is already built into formal and statistical systems and tested in live dialogue. They back it with findings from human thought research and report a small experiment of their own. The paper closes by sketching a unified account of meaning built on this word-level idea.

Catalog record

CREATORCasey Kennington, David Schlangen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-06335

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Could the Road to Grounded, Neuro-symbolic AI be Paved with Words-as-Classifiers? Casey Kennington, David Schlangen Abstract Formal, Distributional, and Grounded theories of computational semantics each have their uses and their drawbacks. There has been a shift to ground models of language by adding visual knowledge, and there has been a call to enrich models of language with symbolic methods to gain the benefits from formal, distributional, and grounded theories. In this paper, we attempt to make the case that one potential path forward in unifying all three semantic fields is paved with the words-as-classifier model, a model of word-level grounded semantics that has been incorporated into formalisms and distributional language models in the literature, and it has been well-tested within interactive dialogue settings. We review that literature, motivate the words-as-classifiers model with an appeal to recent work in cognitive science, and describe a small experiment. Finally, we sketch a model of semantics unified through words-as-classifiers. 1 Introduction In his well-known Chinese Room thought experiment, John Searle argued that the classical artificial intelligence (AI) methods of the day were not actually doing anything meaningful because they were working at the symbolic level, rather than having any connection with the real world Searle 1980 . 1 1 1 The thought experiment itself explains that a person who reads Chinese characters, looks up in a pre-defined book what the response character should be, and provides that response has no knowledge of the Chinese language and therefore isn’t doing anything that requires any degree of intelligence. This was extended a decade later by Stevan Harnad who, focusing on meanings of words, challenged the claim that meaning could be found in a formal, symbolic system because such a system is just an abstraction to the thing it is trying to model: “meaningless symbols" connecting to other meaningless symbols Harnad 1990 . What was lacking, was a kind of grounding , or direct reference to the real world—human cognition and therefore language is so tied to the physical world that computational models of semantics should be as well. More recently, a dramatic shift took place when classical, formal meaning representations were supplanted by distributional representations within the field of natural language processing and machine learning in general. The basic distributional theory is often attributed to JR Firth who observed that “you shall know a word by the company it keeps" Firth 1957 and indeed words keep company with other words within speech and text, so something about how words show up in text must have something to do with their meaning. Meanwhile, textual datasets increased in size and extended across domains, giving the distributional hypothesis something empirical to work with. Simple co-occurrence methods were replaced by more principled models, such as word2vec Mikolov et al. 2015 ; Mikolov et al. 2013 , where the ‘meaning’ of a word could be represented as computable vectors (i.e., points in n-dimensional space; see Figure 3 for an example), amenable to the popular, neuro-inspired machine learning models and hardware, and trainable with text data. This was seen as a vast improvement over formal representations as word meanings were no longer intrinsic on the symbolic system; rather, the vectors and their distances from each other could be regarded as a kind of meaning representation that was computable. Indeed, in many circles, the wholesale use of the word embeddings (i.e., the word vectors themselves derived from text data) became synonymous with meaning . More principled, though computationally expensive models such as Attention neural network layers and Transformer architectures (which form the model that upon which most Large Language Models are built) enabled vector representations that go beyond the word level into the sentence and discourse level Vaswani et al. 2017 , solidifying the supremacy of the distributional theory of semantics with empirical backing. Surely the shift from formal, symbolic meaning representations to distributional theories that underlie computational semantics was for the better because it was so data-driven, it could scale, and evidence was mounting that it was effective at many, many tasks and benchmarks that require a substantial degree of language understanding Rogers et al. 2020 . Some cried foul, however, pointing out that the data used to train the new models, while linguistic in nature, is not complete: by-and-large, transformer-based large language models (LLMs) are trained on text , a data source that is easy to come by, but in the end fall victim to the same issues raised by Searle and Harnad, namely, that even the vectors are to a degree meaningless because they only refer to each other (a “merry-go-round" of symbols pointing only to other symbols, ala Harnad), not to the physical world Lücking et al. 2019 ; Bender and Koller 2020 . 2 2 2 Though, see Gubelmann 2024 for an argument that language models don’t need symbol grounding. Where does that leave us? There have been efforts to tie the visual world to the computable world of text-derived vectors, with clear degrees of success (see Fields and Kennington 2023 for an overview of methods and early models), which is a step in the right direction. Another important trend is the argument that bringing formal semantics back into the neuro-inspired AI models (i.e., deep learning) is our only hope for proper intelligence that includes important abilities like inference and reasoning Valiant 2008 , even as the scale of datasets and size of models increases to absurd levels. Marcus 2020 , for example, argues that the path forward requires a “hybrid, knowledge-driven, reasoning-based approach, centered around cognitive models." Thus a push for neuro-symbolic AI is underway, a version of AI where the power of formal systems is integrated into LMs trained on data with an increasing number of papers claiming they are addressing the neuro-symbolic challenge. We are thus still left with two problems: the symbol grounding problem, and the neuro-symbolic problem. In this paper, we make the assertion that the path to neuro-symbolic AI must also be amenable to symbol grounding—solving both problems is crucial, and should be done within a dialogue setting. That means that a proper model of computational meaning should be formal (i.e., symbolic), distributional, and grounded in the physical world, learned through interactive dialogue. We limit our focus on word-level semantics. 3 3 3 We are agnostic to the machinery from formal or distributional models that take the semantics beyond the word level; both have merits and limitations. At the heart of our hypothesis is the that the words-as-classifiers (WAC) model can unify the three theories of computational semantics and lead to a neuro-symbolic model that grounds and benefits from distributional methods. We explain the WAC model in the following section and motivate it as the model of choice for unification, then explain how WAC has already been used to bridge grounded with formal, as well as grounded with distributional, including a small-scale experiment that shows how WAC is a promising model to be integrated more directly with LLMs. Finally, we sketch a model the unifies formal and distributional theories with WAC towards addressing the neuro-symbolic and symbol grounding problems. 2 The Words-as-Classifiers Model: Word-level Grounded Semantics Larsson 2013 explored how linguistic meaning is related to perception: the goal is for a computational

Read the complete text