LLMs and the ZPD

Peter · 2026

Read LLMs and the ZPD by Peter (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12016.txt.

Introduction

Peter Wallis's 2026 paper revisits Vygotsky's Zone of Proximal Development to reinterpret large language models. A century after Vygotsky's circle said children build scientific thinking by interacting with cultured adults, Wallis proposes a new view. Completion models do not think with distributed representations. They perform early thinking in terms of practices. From this view, models do not hallucinate but dream. What matters is interaction at the heart of talk, not an add-on to real sense.

Catalog record

CREATORPeter
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25713
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12016

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLMs and the ZPD Peter Abstract One hundred years ago Vygotsky and his circle were exploring the nature of consciousness and defining what would become psychology in the Soviet Union. They concluded that children develop “scientific thinking” through interacting with enculturated adults in Zones of Proximal Development or ZPDs. The proposal is that, contrary to the claims of some, the LLM mechanism is not doing thinking with “distributed representations,” but rather the completion model is doing “primitive thinking” in terms of practices . Viewed from this perspective, it would seem our large language models don’t hallucinate, but rather dream, and that what is needed is not “guard rails” but an investigation of the set of cognitive tools that enable us to do things that look like common-sense. The proposal here is that interaction is core to human communication rather than just an add-on to “real” understanding. Wallis keywords human-computer interaction, Theory of Mind † † address: 1 Centre for Policy Modelling, UK † † email: [email protected] 1 Introduction In an article in The New Yorker [ 1 ] Geoffrey Hinton is worried that Artificial Neural Networks, with the benefit of massive training data, have unleashed Artificial General Intelligence (AGI) on the world. His counter to the doubters is quoted at length as follows: People say, “It’s just glorified autocomplete,”… Now, let’s analyze that. Suppose you want to be really good at predicting the next word. If you want to be really good, you have to understand what’s being said. That’s the only way. So by training something to be really good at predicting the next word, you’re actually forcing it to understand. Yes, it’s ’autocomplete’ – but you didn’t think through what it means to have really good autocomplete. [The New Yorker, November 13, 2023] Hinton believes that large language models can comprehend the meaning of words and have ideas, but others obviously think the mechanism is more limited. Thinking about thinking is not new and one hundred years ago Vygotsky and his co-workers were tasked with educating the masses. In the process they shaped Soviet psychology and pointed out that: In ontogenesis one can discern a preintellectual stage in the development of speech, and a prelinguistic stage in the development of thought. Vygotsky goes on: At a certain moment these two developmental lines become intertwined, whereupon thought becomes verbal, and speech intellectual. This moment signifies a switch from a natural track of development to a cultural one. [Kozulin [ 2 ] ,p153] This switch in a child’s thinking happens over time, only once the child has the “cognitive tools” to progress, and only in interaction with adults. The child learns to think as an adult in Zones of Proximal Development or ZPDs. The proposal is that the completion model of Large Language Models is actually a good model of “primitive thinking” and that thinking with symbols and representation is something LLMs need to be taught. This may seem a strange claim given language is our archetype symbol system and “language” is in the name, but I will argue they are using language performatively rather than exploiting the ability of natural language to represent things. Using speech performatively – using vocalisations to cause others to do things – is a study of people. It is a study of the community of practice of the speech users. Figure 1 is of a device that interacts with people, but without words. It cannot use speech ”scientifically,” and Word Error Rate is simply not applicable. So how should we describe the observations we make? The next section looks at prelinguistic thought, and Section 3 at pre-intellectual speech. Section 4 combines the two and Section 5 outlines two approaches to studying vocal communication without words. Figure 1: A swanee whistle, bellows, and a microphone for an ethnographic study of Levinson’s ’interaction engine’ and pre-intellectual speech. 2 Natural Intelligence Hinton’s position is a common one based on a long history of thinking about thinking with symbols and representation. In classic AI this was explicit with symbols such as BRICK_3 representing an actual brick in the world, and when the bricks were on a table top, this type of reasoning worked even on the computers available in the 1970s. A symbol such as ON might represent a relationship between brick 3 and brick 2 and so the statement ON(BRICK_2,BRICK_3) could be tested for truth, and planning could be done in terms of axioms and rules. This model of thinking turns out to be fragile, and it seemed we’d need an awfully large amount of knowledge about the world in order to make machines with even an approximation of common-sense. By 1990 there was generally a consensus that something was wrong with the approach and Harnad wrote his famous paper “The Symbol Grounding Problem” [ 3 ] which concluded that (artificial) neural nets were the way forward because they use “distributed representations”. Others, famously Brooks in his paper “Intelligence without Representation” [ 4 ] , were taking a different approach and exploring “embodied intelligence”. Hinton, surfing in on a wave of interest in neural nets, is taking Harnad’s line and saying real thinking is done with symbols, but we just can’t point to where the symbols are. The argument here is in favour of the embodiment approach. Embodiment is often seen as involving a body (obviously) but embodiment is perhaps better seen as an issue of situated action . Meaning is grounded, not so much in the body [ 5 ] , but in the relationship between the agent and its operating environment [ 6 , 7 , 8 ] . In Section 3 we consider ChatGPT as an agent situated in a social world but first, what can be done with a glorified autocomplete mechanism? 2.1 Glorified Autocomplete – more useful than it looks Artificial Neural Networks are notoriously opaque and the relevant research community seem to have evolved their own way of talking about progress. There are plenty of “explainer” YouTube videos, and attention (a term with strong affiliation with consciousness) seems to have morphed into meaning bag-of-words on a span of input (context). The language is about the mechanism, not about what it does, although the allusions come thick and fast. There is a long history of having statistical models of a training set from a population of samples. The resultant model can then be used to produce original samples that have a fit with the population. Markov chains are a classic, and I believe there is something known as multi dimensional kernels that provide a suitably theoretical view of the autocomplete problem. For the rest of us, we tend to think LLMs are thinking much as we do in terms of things and their relationships. However consider an LLM playing chess [ 9 , 10 ] . Being good at chess is classic indicator of intelligence and was used in AI research from the start. As described in the Dynomight blog, LLMs are not consistently good at chess, nor indeed consistently not completely rubbish. When an LLM is successfully prompted to play chess (and the tokenisation is fine tuned) the LLM can be quite good. But is it building a cognitive model of

Read the complete text