Ensemble Kalman filter for uncertainty in human language comprehension Note: The research has been funded by the Deutsche Forschungsgemeinschaft (DFG)- Project-ID 318763901 - SFB1294.
Diksha Bhandari, Alessandro Lopopolo, Milena Rabovsky, Sebastian Reich · 2025
Read Ensemble Kalman filter for uncertainty in human language comprehension Note: The research has been funded by the Deutsche Forschungsgemeinschaft (DFG)- Project-ID 318763901 - SFB1294. by Diksha Bhandari, Alessandro Lopopolo, Milena Rabovsky, Sebastian Reich (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-02590.txt.
Introduction
Diksha Bhandari and three co-authors presented in 2025 a new model of how people make sense of sentences. Standard neural models give one firm answer, but human readers hold doubt when a sentence is odd or roles flip in a surprising way. The team recast a classic sentence model as a guessing problem and added a filter method that tracks a spread of likely meanings.
Tests against a standard best-fit method show the new model keeps a richer sense of doubt. It handles flipped-role sentences, the kind that trip up firm models, in a more human-like way. The authors argue that models of reading should track doubt as a core part of understanding, not as an afterthought.
Catalog record
| CREATOR | Diksha Bhandari, Alessandro Lopopolo, Milena Rabovsky, Sebastian Reich |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-02590
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Ensemble Kalman filter for uncertainty in human language comprehension Note: The research has been funded by the Deutsche Forschungsgemeinschaft (DFG)- Project-ID 318763901 - SFB1294. Diksha Bhandari, Alessandro Lopopolo, Milena Rabovsky, Sebastian Reich Abstract Artificial neural networks (ANNs) are widely used in modeling sentence processing but often exhibit deterministic behavior, contrasting with human sentence comprehension, which manages uncertainty during ambiguous or unexpected inputs. This is exemplified by reversal anomalies—sentences with unexpected role reversals that challenge syntax and semantics—highlighting the limitations of traditional ANN models, such as the Sentence Gestalt (SG) Model. To address these limitations, we propose a Bayesian framework for sentence comprehension, applying an extention of the ensemble Kalman filter (EnKF) for Bayesian inference to quantify uncertainty. By framing language comprehension as a Bayesian inverse problem, this approach enhances the SG model’s ability to reflect human sentence processing with respect to the representation of uncertainty. Numerical experiments and comparisons with maximum likelihood estimation (MLE) demonstrate that Bayesian methods improve uncertainty representation, enabling the model to better approximate human cognitive processing when dealing with linguistic ambiguities. Journal: Journal of Mathematical Psychology 1 Introduction Artificial neural networks (ANNs) have become indispensable tools in modeling sentence processing within the field of natural language processing and cognitive science. These models are capable of handling complex linguistic structures, making accurate predictions, and resolving ambiguities with a notable degree of certainty, even when they are wrong Guo et al. (2017) ; Hein et al. (2019) . However, this behavior stands in contrast to human sentence comprehension, which often involves managing uncertainty, especially when faced with ambiguous or unexpected language inputs. Human cognition frequently engages in reanalysis, revisions, and flexible interpretations during sentence processing, highlighting a potential mismatch between the deterministic behavior of ANNs and the more adaptive nature of human understanding, which is - among other things - based on representing uncertainty in case of conflicting cues. This paper addresses the disparity between ANNs and human cognition in processing uncertainty during sentence comprehension, with a particular focus on reversal anomalies – sentences that disrupt expected meaning patterns. For instance, in a sentence such as “The dog was bitten by the man" (example 1; Ferreira (2003) ) or “Every morning at breakfast the eggs would eat…." (example 2; Kuperberg et al. (2003) ), typical agent and patient roles are reversed. Reversal anomalies present a significant challenge to both human and artificial systems by introducing conflicts between syntax and semantics that can lead to comprehension breakdowns or reinterpretations. While ANNs such as the Sentence Gestalt Model McClelland et al. (1989) ; St. John and McClelland (1990) ; Rabovsky et al. (2018) , can display a high level of certainty even during misinterpretations, human behavioral performance in sentence processing often displays higher levels of uncertainty Ferreira (2003) . To explore this disparity and work towards reducing it, we examine the performance of the Sentence Gestalt Model, an ANN-based model of sentence comprehension, when confronted with reversal anomalies, and compare its handling of uncertainty to a Bayesian approach that is meant to enhance the model’s ability to account for uncertainty, which is often overlooked in traditional deep learning models of language processing. In this work, we investigate a sampling method based on an extension of the ensemble Kalman filter (EnKF) for uncertainty quantification. By formulating the task of language comprehension as a Bayesian inverse problem, we aim to improve the model’s capacity to reflect the probabilistic nature of human sentence comprehension and resulting uncertainties. This approach is validated through numerical experiments and a comparison with traditional maximum likelihood estimation (MLE)-based methods. Our results demonstrate that incorporating Bayesian techniques can lead to an enhanced representation of uncertainty in the model when processing ambiguous or conflicting sentence structures, which comes somewhat closer to human cognitive processing of uncertainty. 1.1 Uncertainty in human language comprehension Humans, during sentence comprehension, often adopt heuristic strategies to cope with the complexity of language. These strategies enable individuals to generate a good enough interpretation of a sentence without engaging in a detailed syntactic analysis. Ferreira (2003) suggested that such heuristic approaches prioritize resource efficiency and speed over thoroughness, allowing for rapid comprehension at the expense of occasional misinterpretations, particularly in complex or non-canonical sentences. These heuristic strategies are reflected in increased behavioral uncertainty, which is measurable through higher error rates and longer reaction times when processing non-canonical sentences, such as reversal anomalies (RA). When confronted with such sentences that involve conflicts between syntactic structure (which would suggest that the man bites the dog in example 1, above) and plausibility (which would suggest that it should be rather the dog who bites the man), participants are more prone to errors, suggesting that their reliance on heuristic processing is insufficient for correctly interpreting the sentence structure. Specifically, Ferreira (2003) reported that about 25 percent of college students misinterpreted simple passive sentences such as example 1 above as indicating that the dog was biting the man, which is incompatible with the sentence’s syntax. RA sentences can be interpreted by relying on either syntactic cues or semantic cues. While syntactic analysis would correctly assign the roles based on sentence structure, semantic cues, such as world knowledge or expectations about event probabilities, often guide interpretation. In RA sentences, humans frequently default to semantic cues, leading to misinterpretations where the brain gravitates toward a more plausible event scenario rather than adhering strictly to syntactic rules as explained for the example above. This tendency can lead to so called good-enough processing and misinterpretations Ferreira (2003) and can create what is known in event related potential (ERP) research as a semantic illusion, where the sentence initially seems to make sense based on real-world knowledge (leading to small amplitudes of the N400 ERP component, which is usually large for semantic anomalies, Kutas and Federmeier (2011) ), but later requires reanalysis due to its syntactic inconsistency (reflected in large amplitudes of the subsequent P600 component), Kuperberg et al. (2003) . While humans display a high level of uncertainty when interpreting RA sentences due to the conflicting cues, computational models of language processing, such as the SG model originally proposed by St. John and McClelland (1990) and extended by Rabovsky et al. (2018) to account for N400 amplitudes, can exhibit high confidence in their interpretation by consistently favoring semantic cue-based processing of reversal anomalies. In the SG model, the word “eggs” in example 2, above, was consistently and confidently interpreted as the patient rather than the agent, reflecting a plausibility-based interpretation that aligns with expected event structures. This confident misinterpretation was likely due to the fact that the SG model had never experienced the eggs as the agents of an eating action during training. Nonetheless, the mismatch with the syntactic structure of the sentence could have been expected to introduce some hints of doubt within the system. The SG model’s strong and confident reliance on event probabilities despite conflicting cues underscores how computational systems can be highly confident even when they are wrong, while in human processing conflicting cues often lead not only to higher error rates but at the same time to greater uncertainty. 1.2 Uncertainty quantification in artificial neural networks Most ANNs and models in deep learning can be viewed as deterministic functions, providing point estimates