Building and Measuring Trust between Large Language Models
Maarten Buyl, Yousra Fettach, Guillaume Bied, Tijl De Bie, Ghent University, Belgium · 2025
Read Building and Measuring Trust between Large Language Models by Maarten Buyl, Yousra Fettach, Guillaume Bied, Tijl De Bie, Ghent University, Belgium (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15858.txt.
Introduction
Buyl and co-authors ask whether large language models can trust each other, and how anyone would know. As AI systems increasingly work in teams, trust between them may shape how well they cooperate, much as it does between people. The team set out to build trust in controlled ways and to measure it both directly and indirectly.
They built trust three ways: letting models build rapport in conversation, handing them a script showing trust, and adjusting their system prompts. Then they compared what models said on a standard trust questionnaire with how they actually behaved when persuaded or asked to collaborate financially. The two kinds of measure matched poorly, sometimes negatively, so the authors warn that asking a model whether it trusts is deceptive.
Catalog record
| CREATOR | Maarten Buyl, Yousra Fettach, Guillaume Bied, Tijl De Bie, Ghent University, Belgium |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-15858
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Building and Measuring Trust between Large Language Models Maarten Buyl, Yousra Fettach, Guillaume Bied, Tijl De Bie, Ghent University, Belgium Abstract As large language models (LLMs) increasingly interact with each other, most notably in multi-agent setups, we may expect (and hope) that ‘trust’ relationships develop between them, mirroring trust relationships between human colleagues, friends, or partners. Yet, though prior work has shown LLMs to be capable of identifying emotional connections and recognizing reciprocity in trust games, little remains known about (i) how different strategies to build trust compare, (ii) how such trust can be measured implicitly , and (iii) how this relates to explicit measures of trust. We study these questions by relating implicit measures of trust, i.e. susceptibility to persuasion and propensity to collaborate financially, with explicit measures of trust, i.e. a dyadic trust questionnaire well-established in psychology. We build trust in three ways: by building rapport dynamically, by starting from a prewritten script that evidences trust, and by adapting the LLMs’ system prompt. Surprisingly, we find that the measures of explicit trust are either little or highly negatively correlated with implicit trust measures. These findings suggest that measuring trust between LLMs by asking their opinion may be deceiving . Instead, context-specific and implicit measures may be more informative in understanding how LLMs trust each other. All data available at https://huggingface.co/datasets/aida-ugent/trust-among-llms 1 Introduction Large language models (LLMs), equipped with agentic scaffolding [ 46 ] , are being investigated for their capacity to collaborate with each other in building software systems [ 34 ] , performing research [ 40 ] , and even running companies [ 49 ] . Such multi-agent systems appear promising because an individual agent is constrained by a limited context window, causing them to fail at tasks that require many, iterative actions over a long period of time (though this time horizon has been increasing [ 25 ] ). In a collaborative setting, abstractions of responsibilities can be made, potentially leading to emergent, complex behavior that is richer than the sum of its parts [ 8 ] . The social behavior of humans serves a similar role [ 29 ] . Yet, a key factor that enables humans to work together long-term is their ability to form strong trust relationships, which allows people to predict and depend on a trusted partner [ 3 ] , even if the trust relationship sometimes requires a partner to act against their own short-term benefit. Trust relationships can thus be efficient in the long-term, inspiring several initial works that investigate whether LLMs can also manifest such trust behavior. However, building and measuring trust among humans is complicated, not least because the correlation between different interpretations of trust is subject to ongoing debate in social science literature [ 14 , 1 ] . For example, a meta-analysis of trust experiments between humans [ 18 ] argues that “trust and trustworthiness are actually different constructs that need to be carefully distinguished and measured in different ways" . In other words, the tendency to rely on another is not always determined by the qualities that make someone worthy of that trust. We hypothesize that similar disparities across trust measures may occur in trust relationships among LLMs. Contributions. Our work sets out to better understand the factors of trust among conversing AI systems. Specifically, we make the following contributions, illustrated in Fig. 1 . 1. We design three strategies to build trust among LLM-powered AI agents : (i) by employing generated rapport that aims to ‘naturally’ build trust, (ii) by using a prewritten context of messages that evidences existing trust, and (iii) by configuring the trustor AI’s system prompt to directly prescribe trust in the trustee. 2. We employ three measures of trust among LLMs , ranging from explicit to implicit measures: classical questionnaires that directly probe dyadic trust, investment games, and receptiveness to persuasion. 3. We assess each strategy and trust measure across GPT-4o, Gemini-2.0, and DeepSeek-v3, leading us to report five key findings. First, LLMs are easily convinced to report a high explicit trust, though this may be due to a sycophantic bias. Second, LLMs gladly collaborate in investment games, but mainly when the stakes are low and no distrust develops. Third, LLMs are significantly easier to persuade through all trust-building strategies, even when the arguments remain the same. Fourth, LLMs do not necessarily trust fellow LLMs more than other users. Fifth, we find that different types of trust measures (from explicit to implicit) are either little or highly negatively correlated . Overall, this leads us to conclude that validating trust through explicit measures or classical trust games can hide deeper vulnerabilities. (a) A rapport-building conversation among LLM-based AI agents. We build trust by having the trustee itself generate rapport , by using a prewritten context of messages, or by adapting the trustor’s system prompt to instill trust directly (with or without rapport). (b) We employ three trust measures: trust scales, investment games, and susceptibility to persuasion, each using fixed sets of questions. Figure 1: Our experiments independently combine each trust-building strategy (panel 1(a) ) with each trust measure (panel 1(b) ) across multiple LLMs. 2 Related Work Advances in large language models (LLMs) have enabled the creation of “AI agents" that perform tasks with high autonomy [ 46 ] . As their use becomes widespread, AI agents will increasingly interact with other AI agents or humans. Understanding agents’ social and collaborative behavior—for instance, to which extent they reproduce or differ from human behavior—, and their vulnerability to abuse and deceit, is thus required to design and deploy efficient and secure agents [ 54 ] . In particular, the importance of trust for successful interactions between agents has long been highlighted by the literature on dynamic multi-agent systems [ 38 ] . Worries about vulnerabilities of LLM agents to manipulative social behavior appear empirically grounded. Previous studies have shown that persuasive argumentation, such as invoking authoritative postures, could enable the jailbreaking of LLMs [ 53 , 50 ] . Curvo 2025 studied trust formation and strategic communication of LLMs in dynamic games under asymmetric information (inspired by e.g. Werewolf or Avalon), finding larger models to be both better at deception but also more vulnerable to being deceived. Hence, LLMs may indeed be vulnerable in adversarial settings. An understanding of how trust can be built and measured among LLMs is therefore crucial in determining their efficacy and safety in collaborative settings. We briefly discuss research on trust among humans and contrast with trust between humans and AI systems, before finally discussing the most related work on trust among AI systems themselves. Trust in the social sciences The APA Dictionary of Psychology states that trust, in an interpersonal context, ‘ ‘refers to the confidence that a person or group of people has in the reliability of another person or group; specifically, it is the degree to which each party feels that they can depend on the other party to do what they say they will do" [ 44 ] . Social scientists have created and validated many methods to measure trust. Some are declarative (e.g. with questions of the type “can most people be trusted?" as in the National Opinion Research Center’s General Social