Language and Thought: The view from LLMs
Daniel Rothschild draft forthcoming in Lepore and Sosa (eds.) Oxford Studies in Philosophy Language · 2025
Read Language and Thought: The view from LLMs by Daniel Rothschild draft forthcoming in Lepore and Sosa (eds.) Oxford Studies in Philosophy Language (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13561.txt.
Introduction
Rothschild wrote an essay in two thousand twenty-five on what language models reveal about language and thought. Daniel Dennett once speculated that adding language to a mind changes it so deeply that mind with and without language may differ in kind. Modern AI, the essay argues, amounts to a test of that thesis.
Language models trained on text alone show real, if limited, skill at inference across many domains. Rothschild credits the abstract, compact way language encodes information, which makes inference cheap enough to run. In his slogan, language makes inference computationally tractable. He then asks what that implies for human minds.
Catalog record
| CREATOR | Daniel Rothschild draft forthcoming in Lepore and Sosa (eds.) Oxford Studies in Philosophy Language |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-13561
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Language and Thought: The view from LLMs Daniel Rothschild draft forthcoming in Lepore and Sosa (eds.) Oxford Studies in Philosophy Language Abstract † † I am extremely grateful to Nick Shea, Matthew Mandelkern, and Emmanuel Chemla for extensive comments on earlier drafts. Thanks also to William Ratoff for an important critical comment at a presentation of this paper. 1 The Cognitive Utility of Language: A Lesson from the Great AI Experiment Recent work in AI constitutes one of the most expensive and ambitious scientific experiments in human history. By designing and building massive artificial neural networks with a variety of different architectures and training protocols, the performance characteristics of this form of AI is finally emerging. The Great AI Experiment is happening now. In what sense is the development of AI a scientific experiment? In cheaper scientific ventures like the CERN particle collider (c. $4.75 billion) or the Hubble Space Telescope (c. $16 billion) it was relatively clear what the scientists aimed to test or discover. The nature of subatomic particles! The history of the universe! When engineers and scientists build and test and AI system though what are they aiming to find out? Why is AI development any more a scientific venture than the latest developments in electronic vehicles or heat pumps? Isn’t it all just engineering and technology? The Great AI Experiment is an experiment in cognitive science. By building machines capable of performing the kind of tasks routine for human minds (and sometimes animal ones), we are collecting indirect evidence about how biological minds work. Given how little we understand about biological minds, our own or other animal’s, even such indirect evidence is immensely valuable. Another reason it is hard to see the Great AI Experiment as a scientific endeavor is that the results coming out of it, are generally, in philosophical parlance, a priori . How a machine with a given structure will behave when trained in a certain way is not contingent the way the nature of sub-atomic particles is. Do enough calculations and you will discover what any particular AI system you can build will do. Nonetheless, practically speaking the only way to find out how today’s complex AI systems will work is to build them. 1 1 1 For example, high-performing Large Language Models (LLMs) today have billions of parameters and are trained on trillions of tokens ( Touvron et al., 2023 ) . Building a simulation of an AI system to find out how it will operate is no different than building the system itself. Like any good scientific experiment the results have been surprising. Perhaps none more so than the performance of Large Language Models (LLMs), from the early LLMs such as Google’s Bert ( Devlin et al., 2018 ) to more recent juggernauts like OpenAI’s GPT-4 ( Devlin et al., 2018 ) . The performance of LLMs is surprising in at least two respects. First, LLMs are a massive leap forward in text-based AI. LLMs write original verse, converse cogently on almost any topic, and are able to process and fairly intelligently summarize large complex texts. Few guessed in the mid-2010s this level of AI performance was on the horizon. Perhaps even more surprising is the basic computational mechanisms that leads to such successes. While the inner workings of commercial LLMs, like OpenAI’s GPT-4, are trade secrets, the core computational architecture and training regime behind them is in the public domain. At any LLM’s heart is a massive transformer network trained to perform next token prediction on texts ( Vaswani et al., 2017 ; Devlin et al., 2018 ) . That is, LLMs are trained, given a sequence of words as a prompt, such as “The quick brown fox jumped over the lazy ’’, to predict the missing word (‘‘dog’’?). LLMs generate text by predicting, word by word, how a text will continue. 2 2 2 Natural language words are broken into smaller parts, tokens , but the details of this are not relevant here. Under most tokenizations used today there are about 1-3 tokens per word, so the number of words is at the same order of magnitude as the number of tokens. Before the creation and deployment of LLMs it was hard to imagine a system performing next-token prediction that could write and reason as well as LLMs do. Of course, there was no doubt that a system trained to do next-token prediction would produce output. It might have been expected that the system, trained on enough data, would master some grammatical rules of English and be able to stay roughly on topic as it generated new texts to continue old ones. Connectionist networks have long been acknowledged to be very good at spotting and imitating patterns, and with enough computation power and training it is not surprising that they would capture many of the more basic patterns in large stores of texts. But that such systems---even augmented in various other ways---would have the power to make up jokes, to engage in complex reasoning, to mimic styles was a shock to those both in and out of AI. 3 3 3 A dramatic public display of surprise was Geoffrey Hinton’s when he quit Google in order to publicly voice his apocalyptic worries about progress in AI ( Heaven, May 2023 ) . This is an example where an outcome of the Great AI Experiment, like those of many great scientific experiments, was surprising and informative. My focus here is what the scientific takeaways so far are from the Great AI Experiment? The most obvious one is a demonstration of the power of the system of computational paradigm variously called artificial neural networks (ANNs), connectionism, parallel distributed processing (PDP) or, most recently, deep learning. 4 4 4 There are different shades of meaning for these terms. Networks in deep learning, for instance, for instance tends to have more hidden layers (often thousands rather than just a few) than traditional PDP networks ( LeCun et al., 2015 ) . Such systems have long been put forward by some cognitive scientists as a computational model for animal and human reasoning ( Rumelhart et al., 1986 ) . Connectionism is a self-styled subsymbolic approach to AI, providing an alternative to traditional AI where cognition is assumed to take place using a symbolic computational architecture analogous to that used in standard computers. The top performing AI at the turn of the century were mostly traditional symbolic AI. While connectionism had many significant accomplishments under their belt by this time---including in both visual recognition capacity and board game play---it was still possible (and indeed common) to dismiss it as an extremely limited computational paradigm. 5 5 5 Carruthers (2002) , for example, wrote, “ The successes of the distributed connectionist program have been limited …mostly being confined to various forms of pattern recognition; and there are principled reasons for thinking that such models cannot explain the kinds of structured thinking and one-shot learning of which humans and other animals are manifestly capable.” Samuels (2010) similarly wrote “…connectionist accounts of reasoning are extraordinarily thin on the ground; and at the time of writing, there are no remotely plausible connectionist accounts of human reasoning.” Connectionism can