Seeing Isn’t Believing: Mitigating Belief Inertia via Active Intervention in Embodied Agents
Hanlin Wang, Chak Tou Leong, Jian Wang, Wenjie Li · 2026
Read Seeing Isn’t Believing: Mitigating Belief Inertia via Active Intervention in Embodied Agents by Hanlin Wang, Chak Tou Leong, Jian Wang, Wenjie Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17252.txt.
Introduction
Wang and three colleagues define belief inertia in robot agents: agents firmly keep prior beliefs despite what they see, making poor choices and weak actions. They urge active belief fixing over passive insight, adding Estimate-Verify-Update, which lets agents predict results, verify them against what they see through thought, and update beliefs from checks. EVU makes textual belief states and fits both prompting and training methods. Across three robot benchmarks, EVU often raises task success rates, and further studies confirm it eases belief inertia.
Catalog record
| CREATOR | Hanlin Wang, Chak Tou Leong, Jian Wang, Wenjie Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62073 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17252
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Seeing Isn’t Believing: Mitigating Belief Inertia via Active Intervention in Embodied Agents Hanlin Wang, Chak Tou Leong, Jian Wang, Wenjie Li Abstract Recent advancements in large language models (LLMs) have enabled agents to tackle complex embodied tasks through environmental interaction. However, these agents still make suboptimal decisions and perform ineffective actions, as they often overlook critical environmental feedback that differs from their internal beliefs. Through a formal probing analysis, we characterize this as belief inertia , a phenomenon where agents stubbornly adhere to prior beliefs despite explicit observations. To address this, we advocate active belief intervention, moving from passive understanding to active management. We introduce the Estimate-Verify-Update ( EVU ) mechanism, which empowers agents to predict expected outcomes, verify them against observations through explicit reasoning, and actively update prior beliefs based on the verification evidence. EVU is designed as a unified intervention mechanism that generates textual belief states explicitly, and can be integrated into both prompting-based and training-based agent reasoning methods. Extensive experiments across three embodied benchmarks demonstrate that EVU consistently yields substantial gains in task success rates. Further analyses validate that our approach effectively mitigates belief inertia, advancing the development of more robust embodied agents. Our code is available at https://github.com/WangHanLinHenry/EVU . 1 1 footnotetext: Corresponding author. This work was mainly conducted at PolyU, while the author is now at Sichuan University. 1 Introduction Large language models (LLMs) have revolutionized embodied AI, enabling agents to solve increasingly complex, long-horizon tasks ( 6 ; 25 ; 10 ) . Effective task-solving requires not only sophisticated reasoning, but also continuous interaction with the embodied environment. To this end, prior work has explored a variety of techniques, including inference-time iteration ( 36 ; 22 ) , imitation learning ( 1 ) , and reinforcement learning ( 32 ) . The key to these methods is a tight feedback loop, in which the agent perceives the environment, interprets observations to internal states, reasons, and executes actions accordingly. Since an agent’s entire decision-making process critically depends on environmental feedback, integrating the observed information into its reasoning is crucial for task success ( 26 ; 5 ) . Figure 1: Illustrative example of observational neglect in embodied agents. While the agent observes a knife on the target table, its subsequent internal belief (“I still need to find a knife”) fails to integrate the observed information, leading to an unnecessary search action. Figure 2: Statistical results of observational neglect on the ALFWorld benchmark. However, we observe a significant gap between receiving observations and effectively utilizing them. As illustrated in Figure 1 , an agent may observe a knife on a countertop, yet its subsequent reasoning behaves as if the knife were still missing, initiating a redundant search action. We refer to this behavior as “observational neglect”, where the agent observes but fails to integrate observed information into its internal reasoning process. Our statistical analysis (see Figure 2 ) on the ALFWorld 23 benchmark reveals that such neglect is not a marginal error but a predominant failure mode in unsuccessful trajectories. Moreover, this behavior is widespread across various learning paradigms, from vanilla prompting to RL-tuned models, indicating a critical bottleneck in how embodied agents transform observations into their own beliefs, i.e., the internal understandings of the environment states. To uncover the root cause of observational neglect, we conduct probing experiments to analyze the agent’s belief dynamics (see Section 3 ). Our analysis identifies a critical cognitive bias which we term belief inertia , a phenomenon that agents tend to stubbornly adhere to their prior expectations of action outcomes, even when faced with contradictory evidence. This inertia results in a belief-observation misalignment, where the agent’s internal belief remains unchanged despite observing a changing environment. While recent studies have explored belief modeling 37 ; 13 , they largely rely on implicit belief dynamics, where beliefs are updated passively and latently. Without an effective intervention when necessary, such strategies leave the agent’s reasoning prone to being “blinded” by biased priors that overshadow its observations. To address this, we advocate active belief intervention , shifting the paradigm from passive update to active cognitive management (see Section 4 ). We introduce the E stimate- V erify- U pdate ( EVU ), a simple yet effective mechanism for belief intervention. Unlike previous works, EVU decouples belief management from action generation by producing explicit belief states in a textual form. With EVU , the agent first estimates an expected outcome, verifies it against actual observations through LLM-based reasoning, and finally updates its prior belief to a grounded posterior. Crucially, we integrate EVU seamlessly into both prompting- and training-based agent learning methods. Extensive experiments across diverse embodied benchmarks demonstrate that EVU consistently yields substantial gains. Further in-depth analysis confirms that our EVU mitigates belief inertia effectively. In summary, our contributions are as follows: • We identify and formalize belief inertia, a critical phenomenon in embodied agents where internal beliefs overshadow actual observations, leading to widespread observational neglect. • We propose active belief intervention, implemented via the Estimate-Verify-Update ( EVU ) mechanism. It provides a unified way to actively manage belief states and can be seamlessly integrated with various agent learning methods. • We demonstrate the superiority and generalizability of EVU through extensive experiments across multiple embodied benchmarks. Further analysis validates that EVU significantly mitigates belief inertia, providing valuable insights into developing robust embodied agents. 2 Preliminary Problem Formulation. The reasoning process of embodied agents is often formulated as a Partially Observable Markov Decision Process (POMDP), denoted as (\mathcal{U},\mathcal{S},\mathcal{A},\mathcal{O},\mathcal{T},\mathcal{Z},\mathcal{R}) , where \mathcal{U} is the instruction space, \mathcal{S} the hidden state space, \mathcal{A} the action space, \mathcal{O} the observation space, \mathcal{T} the transition function, \mathcal{Z} the observation function, and \mathcal{R} the reward function. To isolate the cognitive aspects of agent–environment interaction from low-level perception, we focus on text-only settings where \mathcal{U} , \mathcal{A} , and \mathcal{O} are all expressed in natural language. Accordingly, we model an embodied agent as an LLM policy \pi_{\theta} that generates textual actions. Figure 3: POMDP formulation in embodied agents. Agent Beliefs. In a POMDP, the true environment state s_{t} is never observed directly, so the agent must maintain an internal belief state b_{t} that summarizes its estimate of s_{t} and serves as the basis for decision making. As shown in Figure 3 , at each step the agent integrates new observation o_{t} with its prior belief b_{t-1} to obtain an updated belief b_{t} , and then reasons the next action conditioned on b_{t} , which in turn shapes future observations and rewards. In many LLM-based agents, such belief dynamics are handled implicitly. A common practice, i.e., ReAct-style 36 agent, appends all past actions and observations into an interaction history h_{t}=(u,o_{1},a_{1},o_{2},\ldots,o_{t}) and relies on LLMs to latently infer b_{t} when reasoning the next action, without explicitly representing the belief state. 3 Belief Inertia in Embodied Agents In this section, we investigate why ReAct-style embodied agents exhibit observational neglect . Since this phenomenon manifests as a misalignment between the agent’s implicit beliefs and the external environment, we employ a probing-based method to explicitly elicit and track these beliefs. 3.1 Probing Agent Beliefs To probe an agent’s beliefs, we append probing questions to the interaction history and utilize the agent’s responses to decode its internal