A quantum semantic framework for natural language processing
Christopher Agostino, Quan Le Thien, Molly Apsel, Denizhan Pak, Elina Lesyk, Ashabari Majumdar, Spontaneity Collaboration · 2025
Read A quantum semantic framework for natural language processing by Christopher Agostino, Quan Le Thien, Molly Apsel, Denizhan Pak, Elina Lesyk, Ashabari Majumdar, Spontaneity Collaboration (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-10077.txt.
Introduction
Agostino and co-authors argue, in a paper published in 2025, that language itself imposes a ceiling on what language models can reliably understand. Beyond simple multiple meanings, they point to a combinatorial explosion of readings as sentences grow complex. Using a classic measure of information content, they argue the context needed to pin down one intended meaning explodes with complexity. If recovering a single meaning is computationally intractable in general, systems built inside language inherit the limit.
Their response is a quantum semantic framework, in which meanings are held in superposition rather than forced into one reading too early. The proposal is theoretical, aimed at natural language processing's foundations. It reframes ambiguity from a nuisance into the central design fact. Whether quantum machinery is the answer, the problem statement is the contribution.
Catalog record
| CREATOR | Christopher Agostino, Quan Le Thien, Molly Apsel, Denizhan Pak, Elina Lesyk, Ashabari Majumdar, Spontaneity Collaboration |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-10077
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A quantum semantic framework for natural language processing Preprint: APS/QNLP-BellTest-Draft Christopher Agostino, Quan Le Thien, Molly Apsel, Denizhan Pak, Elina Lesyk, Ashabari Majumdar, Spontaneity Collaboration Abstract Semantic degeneracy represents a fundamental property of natural language that extends beyond simple polysemy to encompass the combinatorial explosion of potential interpretations that emerges as semantic expressions increase in complexity. Large Language Models (LLMs) and other modern NLP systems face inherent limitations precisely because they operate within natural language itself, making them subject to the same interpretive constraints imposed by semantic degeneracy. In this work, we argue using Kolmogorov complexity that as an expression’s complexity grows, the likelihood of any interpreting agent (human or LLM-powered AI) recovering the single intended meaning vanishes. This computational intractability suggests the classical view that linguistic forms possess meaning in and of themselves is flawed. We alternatively posit that meaning is instead actualized through an observer-dependent interpretive act. To test this, we conducted a semantic Bell inequality test using diverse LLM agents as “computational cognitive systems” to interpret ambiguous word pairs under varied contextual settings. Across several independent experiments, we found average CHSH expectation values ranging from 1.2 to 2.8, with several runs yielding values (e.g., 2.3-2.4) that significantly violate the classical boundary ( | S | ≤ 2 |S|\leq 2 ). This demonstrates that linguistic interpretation under ambiguity can exhibit non-classical contextuality, consistent with results from human cognition experiments. These results inherently imply that classical frequentist-based analytical approaches for natural language are necessarily lossy. Instead, we propose that Bayesian-style repeated sampling approaches can provide more practically useful and appropriate characterizations of linguistic meaning in context. I Introduction Prior to the deep-learning revolution of the 2010s, there was a prolonged AI winter spanning from the mid-1980s to the early 2000s. During this period, most researchers in natural language processing and artificial intelligence contended—based on the promises of AI that were unmet in the 1960s and 1970s—that computers on their own would never be capable of producing any kind of general intelligence or simulating the phenomenon that is described as natural language. AI researchers that tried often found themselves drowning in heuristics that broke down with edge cases, usually abandoning the tasks for more readily-solvable problems. See Dreyfus’ What Computers Still Can’t Do ( Dreyfus 1992 ) to better understand the logical and semantic limitations of artificial reason perceived by researchers prior to the successes of tools making extensive use of large neural networks like Google Translate and others that followed (e.g., transformers, large language models). Such large neural networks that have now become commonplace for consumer products are often termed Distributional Semantic Models (DSMs) ( Harris 1954 ; Deerwester et al. 1990 ; Landauer and Dumais 1997 ; Griffiths et al. 2007 ; Mikolov et al. 2013 ) . DSMs, in effect, infer relevance and meaning from statistical co-occurrences, and they have enabled a variety of highly practical natural language processing (NLP) applications including topic models, sentiment classification, and large language models ( Devlin et al. 2018 ; Radford et al. 2019 ; Brown et al. 2020 ; Vaswani et al. 2017 ) . By construction, DSMs like BERT-style topic models presuppose that documents possess singular, intrinsic semantic compositions (e.g., early bag-of-words models; see Harris 1954 , for contrast with dynamic views) . Because of the practical successes of DSMs in many domains, some researchers have forgotten or not considered many of the initial criticisms of artificial reason that to this day remain sound, instead assuming that these limitations too will be solved by more compute or more data. However, consider the following salient problems in the current field of Natural Language Processing: 1. DSM-powered approaches still exhibit limitations particularly when dealing with complex, ambiguous, or context-rich texts ( Jones 2018 ; Hoffman et al. 2013 ) . 2. The apparent lack of much progress seen in the latest generation of frontier large language models (LLMs)—compared to the leaps seen in prior model releases—appears to have revealed a fundamental barrier in the reliability of semantic problem solving that more compute/data have not alleviated (e.g., GPT-4.5, Llama 4, Gemini 2.5, Claude 3.7 Sonnet). Likewise, many frontier researchers have shifted away from prioritizing progress in LLMs in favor of more dynamically capable models (e.g. JEPA ( Assran et al. 2023 ) , MAMBA ( Gu and Dao 2023 ) , CTM ( Darlow et al. 2025 ) , or modifications to LLMs that allow them to self-improve ( Sun et al. 2025 ; Simonds and Yoshiyama 2025 ) ). These issues and the evolving research landscape suggest that the challenges faced by DSM-based approaches may stem from a more fundamental issue in linguistics: the problem of semantic degeneracy. This concept, extending beyond simple polysemy, refers to the inherent multiplicity of potential interpretations that arise when processing complex linguistic expressions ( Tabossi et al. 1987 ; Binder and Rayner 1998 ; Rayner et al. 2006 ) . Indeed, the concept intuitively makes sense: empirical observation reveals to any observer that natural language meaning is not fixed or absolute ( Harris 1954 ; McDonald and Shillcock 2001 ) and interpretation itself is radically context-dependent ( Barsalou 2003 ; Yeh and Barsalou 2006 ; Higgins 1996 ) . Thus, any semantic meaning realized by an agent interpreting a natural language expression depends crucially on a combinatorially explosive set of potential factors. These factors include but are not limited to: • the surrounding sentential and discourse context ( Bicknell et al. 2010 ; Kintsch 2001 ) • the agent’s current attentional focus and task demands which can selectively highlight specific conceptual features, ( Lebois et al. 2015 ; Yee et al. 2012 ; Hoenig et al. 2008 ; Van Dantzig et al. 2008 ; Bermeitinger et al. 2011 ; Hsu et al. 2011 ) • the agent’s background knowledge, cultural milieu ( Athanasopoulos 2009 ; Thompson et al. 2020 ; Johns 2021 ) , • transient psychological states ( Cesario et al. 2010 ) 1 1 1 While many consider LLMs simply statistical machines that are completely disconnected from the material reality of the physical world, it is certainly possible that real world physical variations in the environment that they inhabit or other random phenomena like cosmic rays could induce transient states. Additionally, when a model like Claude from Anthropic possesses knowledge of the time of the year, its having a French name and the training and system prompting of Claude reinforce a French mindset onto the model to the point that its response patterns and willingness to put in effort vary depending on whether the time of year coincides with French holidays. • the specific language being used, as different languages carve up semantic space differently ( Marian and Kaushanskaya 2007 ) . This profound context dependence implies that meaning is not merely decoded from the specific words in and of themselves independently but that meaning is actively constructed or realized by an interpretive agent within a specific situation— ( Barsalou 2009 ; Pecher et al. 1998 ; Borghi et al. 2004 ) . The same expression presented to different agents—or to the same agent under different conditions—can yield different interpretations ( Connell and Lynott 2014 ; Musz and Thompson-Schill 2015 ) . Critically,