Bridging Expectation Signals: LLM-Based Experiments and a Behavioral Kalman Filter Framework
Yu Wang, Xiangchen Liu · 2026
Read Bridging Expectation Signals: LLM-Based Experiments and a Behavioral Kalman Filter Framework by Yu Wang, Xiangchen Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17527.txt.
Introduction
Yu Wang and Xiangchen Liu study how language model agents update beliefs. Models now act as economic agents in tests and tools. They read mixed signals, some personal and some aggregate. How they weigh those signals was opaque. The authors run experiments with models cast as households and firm heads. They build a Behavioral Kalman Filter frame to score the updates.
A Kalman filter is a classic tool for belief updates under noise. The behavioral form adds human-like bias. Scores show if models overreact or lag. That matters as models take real economic roles. Forecast and policy tests need agents whose belief rules are known. This work makes those rules visible.
Catalog record
| CREATOR | Yu Wang, Xiangchen Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-17527
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bridging Expectation Signals: LLM-Based Experiments and a Behavioral Kalman Filter Framework Yu Wang, Xiangchen Liu Abstract As LLMs increasingly function as economic agents, the specific mechanisms LLMs use to update their belief with heterogeneous signals remain opaque. We design experiments and develop a Behavioral Kalman Filter framework to quantify how LLM-based agents update expectations, acting as households or firm CEOs, update expectations when presented with individual and aggregate signals. The results from experiments and model estimation reveal four consistent patterns: (1) agents’ weighting of priors and signals deviates from unity; (2) both household and firm CEO agents place substantially larger weights on individual signals compared to aggregate signals; (3) we identify a significant and negative interaction between concurrent signals, implying that the presence of multiple information sources diminishes the marginal weight assigned to each individual signal; and (4) expectation formation patterns differ significantly between household and firm CEO agents. Finally, we demonstrate that LoRA fine-tuning mitigates, but does not fully eliminate, behavioral biases in LLM expectation formation. 1 Introduction As Large Language Models (LLMs) are increasingly deployed as autonomous agents for economic forecasting and policy simulation [ 20 , 11 , 14 , 16 , 26 ] , understanding their internal expectation formation mechanisms becomes critical. Despite their predictive prowess, the “black box” nature of how these agents integrate conflicting information streams remains poorly understood [ 15 , 3 ] . On the economic front, while information economists have studied expectation formation for decades, empirical evidence on how heterogeneous shocks interact remains surprisingly scarce [ 19 , 7 ] . Despite documentation that various expectations are likely formed jointly ( [ 4 , 5 ] ), the specific mechanisms between concurrent signals have not been formally quantified. This paper bridges these gaps by quantifying LLM-based expectation formation through a combined theoretical and empirical framework. We design a large-scale controlled experiment (720 trials) to isolate the influence of dual heterogeneous signals on future expectations. By estimating these dynamics through a reduced-form Behavioral Kalman Filter, we formally document the weighting mechanisms and cognitive biases inherent in model-generated forecasts. We evaluate LLM expectation formation within a controlled framework where agents integrate dual information signals under two distinct personas: Household and Firm CEO. These personas are selected because households and firms constitute the fundamental decision-making units in economic theory, making their belief-updating mechanisms a critical first step for agent-based simulation [ 1 ] . Furthermore, economic literature suggests significant heterogeneity in expectation patterns between these groups [ 6 ] , allowing us to test how identity priming modulates the model’s perceived signal-to-noise ratio. The core experimental task requires LLMs to generate future growth expectations—specifically, household income growth for the Household persona and real profit growth for the CEO persona. Each agent is presented with two exogenous signals: a micro-level shock (reflecting idiosyncratic personal income or firm performance) and a macro-level shock (reflecting aggregate national GDP growth). This dual-signal structure is designed to evaluate how models reconcile specific, localized information with broader economic indicators during the belief-updating process [ 18 ] . We evaluate our framework through a large-scale controlled simulation across three state-of-the-art LLMs (GPT-4o, Gemini 1.5, and DeepSeek-V3). By systematic variation of micro-level and macro-level shocks under Household and CEO personas, we construct a dataset of 720 unique experimental trials. The experimental results yield three pivotal findings. First, when forecasting future profitability, both household and CEO personas prioritize micro-level signals. Second, the CEO persona assigns significantly greater weight to macro signals than the household persona. Third, while specific mean and variance estimates vary across different LLMs, the underlying behavioral patterns remain remarkably consistent. Motivated by these patterns, we extend the traditional Kalman Filter [ 13 ] into a Behavioral Kalman Filter (BKF) framework by incorporating two key mechanisms: a prior discounting factor applied to the previous state, and a subjective covariance term between signals. While standard information and macroeconomics typically assume a zero-covariance Kalman Filter, our extensions are designed to capture (1) the cognitive interactions between concurrent signals, and (2) the heterogeneity of signal processing in expectation formation. Estimating a full structural model can be complex; therefore, we employ a Bayesian linear regression to estimate our BKF, which is better suited for our small sample size [ 2 ] . Specifically, we regress current expectations on the prior expectation, both signals, and their interaction term. Our results show that the sum of the estimated coefficient for the prior and signals is significantly different from one, confirming that all models exhibit irational when new information arrives. Consistent with our experimental findings, both the household and CEO personas assign a higher weight to micro signals than to macro signals. Furthermore, the negative coefficient of the interaction term provides empirical evidence for the “cognitive discount” effect: the presence of concurrent signals creates interference that weakens the model’s trust in each individual source. Finally, across personas, we confirm a “professional sensitivity premium,” as the CEO persona places significantly more weight on macro signals than households do. Finally, we examine whether fine-tuning LLMs can eliminate the behavioral component in our BKF framework. We apply Low-Rank Adaptation (LoRA) to Qwen2.5-7B-Instruct and compare responses from the fine-tuned and base models [ 12 ] . A rational Kalman Filter is defined by two conditions: (1) the weights on all components sum to one, and (2) the interaction term equals zero [ 8 , 17 , 10 ] . Our results show that fine-tuning reduces the volatility of model responses. For the household scenario, the interaction term becomes statistically insignificant, while for the CEO scenario it remains significantly different from zero. Moreover, the estimated coefficients do not sum to one. These findings suggest that LoRA fine-tuning mitigates but does not fully eliminate the irrational component in LLM expectation formation. 2 Theoretical Framework: Behavioral Kalman Filter We start by laying out the theoretical framework of the standard Kalman Filter, then introduce the behavioral extension of it. By focusing on how multiple information signals interact, we challenge the rational expectation formation assumptions prevalent in the Economics literature, specifically the principle of additive independence between orthogonal shocks. 2.1 Standard Kalman Filter Baseline To motivate the Behavioral Kalman Filter, we begin with the classical Kalman filtering framework in information economics [ 21 ] . Let x_{t} denote the latent economic state (e.g., future income growth or profitability). Instead of treating signals in isolation, we define the observation as a vector \mathbf{s}_{t}=[s_{t}^{mic},s_{t}^{mac}]^{\top} that provides a noisy measurement of the latent state: \mathbf{s}_{t}=\mathbf{H}x_{t}+\boldsymbol{\varepsilon}_{t},\qquad\boldsymbol{\varepsilon}_{t}\sim\mathcal{N}(\mathbf{0},\mathbf{\Sigma}), (1) where \mathbf{H}=[1,1]^{\top} is the observation matrix and \mathbf{\Sigma}=\text{diag}(\sigma_{mic}^{2},\sigma_{mac}^{2}) is the noise covariance matrix. Given a prior estimate x_{t|t-1} , the classical Kalman filter updates beliefs according to: x_{t|t}=x_{t|t-1}+\mathbf{K}_{t}^{\top}\left(\mathbf{s}_{t}-\mathbf{H}x_{t|t-1}\right), (2) where \mathbf{K}_{t}=[K_{t,mic},K_{t,mac}]^{\top} is the Kalman gain vector. In the standard formulation, the gains are determined by the relative precision of the signals: \mathbf{K}_{t}^{\top}=P_{t|t-1}\mathbf{H}^{\top}\left(\mathbf{H}P_{t|t-1}\mathbf{H}^{\top}+\mathbf{\Sigma}\right)^{-1}. (3) in which P_{t|t-1} denotes the prior estimation error covariance, representing the agent’s uncertainty before observing the current signals. This vector structure imposes two strong restrictions: (i) signals are weighted symmetrically based solely on the statistical noise covariance \mathbf{R} , and (ii) the update rule is strictly linear, assuming no interaction between the elements of \mathbf{s}_{t} beyond their shared mapping to x_{t} . 2.2 Behavioral Kalman Filter: Model Definition To quantify cognitive