Neither Stochastic Parroting nor AGI: LLMs Solve Tasks through Context-Directed Extrapolation from Training Data Priors
Harish Tayyar Madabushi, Melissa Torgbi, Claire Bonial · 2025
Read Neither Stochastic Parroting nor AGI: LLMs Solve Tasks through Context-Directed Extrapolation from Training Data Priors by Harish Tayyar Madabushi, Melissa Torgbi, Claire Bonial (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23323.txt.
Introduction
Madabushi, Torgbi, and Bonial argue that large language models solve tasks by extrapolating from patterns in their training data, steered by context. Debate often frames model behavior as either parroting or near human reasoning. Their 2025 position paper offers a middle account, called context-directed extrapolation.
Examples in a prompt steer base models toward the right stored patterns, which is how in-context learning works, they say. Instruction tuning lets a prompt do the same steering without examples. The authors supply an evaluation checklist and design patterns to separate memory, basic extrapolation, and true generalization in tests. Adopting this frame, they argue, would calibrate claims about reasoning and improve deployment decisions.
Catalog record
| CREATOR | Harish Tayyar Madabushi, Melissa Torgbi, Claire Bonial |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-23323
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neither Stochastic Parroting nor AGI: LLMs Solve Tasks through Context-Directed Extrapolation from Training Data Priors Harish Tayyar Madabushi, Melissa Torgbi, Claire Bonial Abstract In this position paper we raise critical awareness of a realistic view of LLM capabilities that eschews extreme alternative views that LLMs are either ‘stochastic parrots’ or in possession of ‘emergent’ advanced reasoning capabilities, which, due to their unpredictable emergence, constitute an existential threat. Our middle-ground view is that LLMs extrapolate from priors from their training data, and that a mechanism akin to in-context learning enables the targeting of the appropriate information from which to extrapolate. We call this ‘context-directed extrapolation.’ Under this view, substantiated though existing literature, while reasoning capabilities go well beyond stochastic parroting, such capabilities are predictable, controllable, not indicative of advanced reasoning akin to high-level cognitive capabilities in humans, and not infinitely scalable with additional training. As a result, fears of uncontrollable emergence of agency are allayed, while research advances are appropriately refocused on the processes of context-directed extrapolation and how this interacts with training data to produce valuable capabilities in LLMs. Future work can therefore explore alternative augmenting techniques that do not rely on inherent advanced reasoning in LLMs. 1 Introduction Large Language Models (LLMs), primarily trained on the cloze-inspired task of next-token prediction, have demonstrated the ability to solve a range of tasks, some of which typically require reasoning in humans [ 10 , 59 , 49 ] . Understanding the basis for how LLMs achieve this is central to several key considerations, including the continued development of these models, their safety and security implications, and the contexts in which they should or should not be used [ 23 ] . However, despite, or perhaps because of , its importance, there has been little consensus on how LLMs are able to solve complex tasks. Currently, two predominant viewpoints exist: the first (alternative view 1) is that LLMs are essentially ‘stochastic parrots,’ predicting statistically likely outputs in line with their training objectives [ 6 , 5 , 34 ] . The second viewpoint (alternative view 2) posits that as LLMs are scaled up, in terms of both parameters and training data, they develop ‘emergent reasoning’ capabilities [ 10 , 59 , 49 ] , which, in some cases, have been described as “sparks of AGI” (Artificial General Intelligence) [ 12 ] . Neither of these viewpoints, we will argue, sufficiently explain the capabilities and limitations of state-of-the-art LLMs. Specifically, LLMs trained only on next token prediction can solve a range of non-memorizable tasks that require more than generating the next most likely token (see Section 3 ). Nonetheless, these models fail on a range of tasks which humans are able to trivially solve (Section 4 ), indicating that they are not capable of certain types of human-like reasoning. Note that our discussion of reasoning focuses on capabilities that are either already at the level of, or indicative of the potential for, advanced general-purpose reasoning akin to high level human cognitive capabilities. For brevity we will call this ‘advanced reasoning’ and we define levels of reasoning in Section 2 . Despite the conflicting findings and viewpoints surrounding the explanation of LLM performance, there is one ability that LLMs possess indisputably: this is the ability of LLMs, trained solely on next-token prediction (referred to as Base LLMs), to solve a range of tasks when provided with a few examples in the input prompt—an ability known as in-context learning (ICL) or few-shot learning [ 11 , 37 ] . For example, an LLM provided with the input prompt “1 + 3 = 5; 7 + 12 = 20; 8 + 3 =” will respond with ‘12.’ Notice that this requires the model to identify this task to be a form of modified addition ( a+b+1 ) and perform the required modified calculation.We note that this alone serves as evidence against the stochastic parrot argument. However, the view that LLMs are stochastic parrots is not without some merit. LLMs, despite their self-supervised training objectives, are fundamentally machine learning systems. As such, it is reasonable to assume that they operate in the same way as other machine learning models: by solving tasks using priors extrapolated from their training data. Indeed, after the pre-training process, LLMs are fine-tuned with instructions [ 58 ] to enable them to follow directives and align with human preferences [ 39 ] . Thus, the responses LLMs generate result from the combination of priors extrapolated from all aspects of their training. Therefore, LLMs, like all machine learning systems, do generate output by relying on priors extracted from their training data, whether from pre-training, instruction tuning, or safety alignment. There is, however, one important caveat: unlike traditional machine learning systems, LLMs have in-context capabilities. Therefore, we propose that extrapolation and in-context learning together should serve as the criteria for explaining the performance of LLMs, unless evidence to the contrary emerges , which, as we will demonstrate, has not yet been presented. Importantly, since instruction-tuned LLMs can respond to prompts without explicit examples, we propose that the instruction-tuning process enables models to target relevant priors without the need for such examples. Indeed, some works call this ability of instruction-tuned models to leverage contextual information for task-solving ‘in-context learning’ [ 14 ] . We will argue that context-directed extrapolation from training data, exemplified by ICL in Base models, can give the impression of stochastic parroting when the target task closely resembles the training data, and that it can also give the impression of advanced reasoning when the target task is clearly extrapolable from training data. Context guided extrapolation from pre-training data can also explain other peculiar characteristics of LLMs, such as their tendency to generate fluent text that is not in line with reality, known as hallucinations. Specifically, when the extrapolation from pre-training data leads to an answer outside of the correct range, hallucinations are produced. Our position: As opposed to stochastic parroting, or advanced general-purpose reasoning akin to high-level human cognitive capabilities, we argue that context-directed extrapolation from training data priors offers a comprehensive framework to adequately explain the capabilities and limitations of LLMs. This context direction is achieved through examples in base models, leading to in-context learning, while instruction tuning allows LLMs to perform similarly based on prompts rather than explicit examples. Significance: The framework used to interpret the capabilities of LLMs directly influences the impact of this rapidly evolving field. Dismissing LLMs as stochastic parrots is just as counterproductive as attributing them with advanced reasoning akin to human-level cognitive capabilities. Specifically, dismissing their capabilities could slow the adoption of these models in applications where their use can enable more flexible natural-language interaction with computational systems. Equally, claiming that these models exhibit advanced reasoning or AGI-like abilities could undermine public trust. This rhetoric has already fueled discussions about the existential threats [ 2 ] posed by LLMs and their potential for deception [ 20 ] . Such discussions could stifle research in this area and, if human-level general reasoning is indeed the goal for some researchers, could hinder progress in that direction. Instead of relegating this discussion to the fringes, we believe that bringing it to the forefront of academic discourse is essential, especially