Epistemic Context Learning: Building Trust the Right Way in LLM-Based Multi-Agent Systems

Ruiwen Zhou, Maojia Song, Xiaobao Wu, Sitao Cheng, Xunjian Yin, Yuxi Xie, Zhuoqun Hao, Wenyue Hua, Liangming Pan, Soujanya Poria, Min-Yen Kan · 2026

Read Epistemic Context Learning: Building Trust the Right Way in LLM-Based Multi-Agent Systems by Ruiwen Zhou, Maojia Song, Xiaobao Wu, Sitao Cheng, Xunjian Yin, Yuxi Xie, Zhuoqun Hao, Wenyue Hua, Liangming Pan, Soujanya Poria, Min-Yen Kan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21742.txt.

Introduction

Ruiwen Zhou and ten co-authors build justified trust in groups of language model agents. Single agents are fragile: they often conform to misleading peers without checking them. The authors show the weakness mixes flattery-like agreement with a poor sense of which peers are reliable.

Their epistemic context learning teaches agents to weigh peer claims by track record and evidence. Trust then grows for the right reasons, not from pressure to agree. Multi-agent systems are being handed real work in research and business. Agents that can doubt each other politely, and update that doubt, are a basic safety need.

Catalog record

CREATORRuiwen Zhou, Maojia Song, Xiaobao Wu, Sitao Cheng, Xunjian Yin, Yuxi Xie, Zhuoqun Hao, Wenyue Hua, Liangming Pan, Soujanya Poria, Min-Yen Kan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE86 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21742

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Epistemic Context Learning: Building Trust the Right Way in LLM-Based Multi-Agent Systems Ruiwen Zhou, Maojia Song, Xiaobao Wu, Sitao Cheng, Xunjian Yin, Yuxi Xie, Zhuoqun Hao, Wenyue Hua, Liangming Pan, Soujanya Poria, Min-Yen Kan Abstract Individual agents in multi-agent (MA) systems often lack robustness, tending to blindly conform to misleading peers. We show this weakness stems from both sycophancy and inadequate ability to evaluate peer reliability. To address this, we first formalize the learning problem of history-aware reference , introducing the historical interactions of peers as additional input, so that agents can estimate peer reliability and learn from trustworthy peers when uncertain. This shifts the task from evaluating peer reasoning quality to estimating peer reliability based on interaction history. We then develop Epistemic Context Learning (ECL): a reasoning framework that conditions predictions on explicitly-built peer profiles from history. We further optimize ECL by reinforcement learning using auxiliary rewards. Our experiments reveal that our ECL enables small models like Qwen 3-4B to outperform a history-agnostic baseline 8x its size (Qwen 3-30B) by accurately identifying reliable peers. ECL also boosts frontier models to near-perfect (100%) performance. We show that ECL generalizes well to various MA configurations and we find that trust is modeled well by LLMs, revealing a strong correlation in trust modeling accuracy and final answer quality. Our codes and data are available at this repository . † † affiliationnotice: Equal contribution Figure 1 : Evolution of decision-making in multi-agent systems. (Left) LLMs generates answers independently without external input; (Middle) LLMs refer to peer outputs without knowledge of peer reliability; (Right) LLMs refer to peer outputs adaptively based on historical peer performance. 1 Introduction Large Language Models (LLMs) have achieved significant success in complex reasoning ( 35 ; 40 ) and agentic automation ( 41 ; 50 ) , facilitating the deployment of collaborative multi-agent systems across various real-world applications ( 10 ; 21 ) . However, a critical challenge persists: individual agents often fail to maintain epistemic autonomy when interacting with potentially unreliable peers. Recent studies demonstrate that LLMs are prone to blind conformity to majority opinions ( 52 ; 4 ) and are vulnerable to plausible yet misleading information ( 25 ; 37 ) . These vulnerabilities underscore the limitation of existing LLMs in effectively filtering noise and aggregating accurate information within complex multi-agent environments. At the core of this failure is a mismatch between the difficulty of the inference task and the LLM’s available capabilities. In many cases, agents are implicitly required to judge the correctness of peer reasoning based solely on the content of a single response, even when their own internal knowledge is insufficient to verify the claim. Existing approaches, including generative reward models and answer aggregation methods ( 15 ; 47 ) , largely adopt this assumption: responses are evaluated in a history-agnostic manner, without regard to the reliability of their sources. Under such conditions, a confident but hallucinated explanation can dominate a concise yet correct answer, as surface-level plausibility becomes the primary signal. Rather than directly reducing sycophancy or endowing agents with substantially stronger domain knowledge, both of which require modifying the underlying model heavily, we consider an alternative system-level perspective. When correctness cannot be established from the current interaction alone, the problem naturally shifts from evaluating what is said to evaluating who is speaking. Historical reliability provides an epistemic prior that is often easier to infer than the validity of a single reasoning trace. For an agent facing uncertainty, distinguishing peers based on past performance is a more tractable and robust decision criterion than attempting to independently re-derive the correct answer. Figure 1 illustrates this shift. Isolated LLMs (left) rely entirely on their parametric knowledge, while standard multi-agent methods (middle) improve by consulting multiple peers but treat them symmetrically, conditioning only on the current interaction. Such approaches fail when agents lack confidence in their own judgments. Our proposed paradigm (right) introduces history-aware reference , explicitly modeling interaction histories across multiple tasks to estimate peer trustworthiness. By conditioning reference behavior on accumulated evidence of reliability, agents can alternatively rely on trustworthy peers in the absence of strong domain knowledge for the current query. This capability is particularly valuable in settings involving complex scientific and domain-specific reasoning ( 33 ; 34 ; 22 ; 48 ) . We first identify that standard models struggle to utilize historical information when the current context is prominent. Driven by this observation, we then develop Epistemic Context Learning (ECL) , a two-stage structured reasoning framework that explicitly decouples reliability estimation from the final reasoning process. By doing so, we ensure that the model derives its trust estimation from historical evidence rather than superficial cues in the current round. We further optimize this framework using reinforcement learning (RL) with auxiliary rewards to encourage the autonomous identification of reliable peers. Our main contributions are summarized as follows: • We introduce history-aware reference , a paradigm that incorporates interaction history as a new dimension for multi-agent reasoning. We formulate trust establishment as a process of estimating prior beliefs from history, which helps to resist potentially unreliable peers. • We propose ECL, a two-stage structured reasoning framework combined with auxiliary RL supervision. This design explicitly decouples the analysis of history from the final reasoning step, effectively preventing the model from overlooking historical evidence in favor of shortcuts in the current context. • We evaluate and analyze our approach on a variety of challenging reasoning tasks. Extensive experiments across diverse LLMs and multi-agent configurations shows the superior performances of ECL over history-agnostic baselines. Additional analysis reveals how trust provides its positive influence in final reasoning and validates the generalization of ECL to different hyper-parameters. 2 Related Work LLM-based multi-agent systems. LLM-based multi-agent systems (MAS) have succeeded on a variety of scenarios ( 38 ; 10 ; 21 ; 6 ; 13 ) . However, they also introduce vulnerabilities: 1 and 26 demonstrated that persuasive yet deceptive agents can easily mislead a group. This motivates our research into enabling agents to selectively incorporate constructive insights while filtering adversarial noise. Conformity and Social Pressure. LLMs often show sycophancy, aligning with incorrect user beliefs rather than truthfulness ( 24 ) . In MAS, this manifests as conformity and herd behavior, where agents abandon correct judgments to follow the majority or confident peers ( 52 ; 4 ) . Benchmarks like BENCHFORM ( 36 ) and KAIROS ( 26 ) highlight that LLMs struggle with psychological pressure and social adversity. Our work addresses this lack of robustness by establishing trust-aware decision-making. RL for LLM-base MAS. Recently RL has been applied to multi-LLM co-training ( 20 ; 14 ) . However, these methods typically assume fully collaborative environments. In contrast, we utilize RL to enable agents to discern reliable peers and extract useful information in uncertain or adversarial multi-agent settings. 3 History-Aware Reference Definitions. We consider an LLM-based MAS involving N agents, denoted as \mathcal{A}\equiv\{A_{1},\dots,A_{N}\} . Each A_{i} can generate a natural language response r given a prompt x , i.e., r=A_{i}(x) . Within this system, we focus on a specific agent, A_{\rm curr}\in\mathcal{A} , which we refer to as the current agent . All other agents, \mathcal{P}\equiv\mathcal{A}\setminus\{A_{\rm curr}\} , are designated as peer agents . The task of

Read the complete text