Evaluating LLM Alignment With Human Trust Models
Anushka Debnath 1 , Stephen Cranefield 1 , Bastin Tony Roy Savarimuthu 1 , Emiliano Lorini 2 1 School of Computing, University of Otago, New Zealand 2 IRIT, CNRS, Toulouse University, France [email protected], [email protected], [email protected], [email protected] · 2026
Read Evaluating LLM Alignment With Human Trust Models by Anushka Debnath 1 , Stephen Cranefield 1 , Bastin Tony Roy Savarimuthu 1 , Emiliano Lorini 2 1 School of Computing, University of Otago, New Zealand 2 IRIT, CNRS, Toulouse University, France [email protected], [email protected], [email protected], [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05839.txt.
Introduction
Debnath and team analyze how a large language model shows trust inside. Trust lets teamwork and guides decisions, yet models' grasp of it remains little known. Using paired prompting, the authors make firing-space vectors for two-way trust and related traits. They find trust concepts from five human trust models, then set a threshold from likeness across 60 feeling concepts. The model's trust picture aligns most closely with the Castelfranchi model, followed by the Marsh Model. The findings suggest models encode social-mind ideas supporting matching and teamwork design.
Catalog record
| CREATOR | Anushka Debnath 1 , Stephen Cranefield 1 , Bastin Tony Roy Savarimuthu 1 , Emiliano Lorini 2 1 School of Computing, University of Otago, New Zealand 2 IRIT, CNRS, Toulouse University, France [email protected], [email protected], [email protected], [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33722 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.05839
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating LLM Alignment With Human Trust Models Anushka Debnath 1 , Stephen Cranefield 1 , Bastin Tony Roy Savarimuthu 1 , Emiliano Lorini 2 1 School of Computing, University of Otago, New Zealand 2 IRIT, CNRS, Toulouse University, France [email protected], [email protected], [email protected], [email protected] Abstract Trust plays a pivotal role in enabling effective cooperation, reducing uncertainty, and guiding decision-making in both human interactions and multi-agent systems. Although it is significant, there is limited understanding of how large language models (LLMs) internally conceptualize and reason about trust. This work presents a white-box analysis of trust representation in EleutherAI/gpt-j-6B, using contrastive prompting to generate embedding vectors within the activation space of the LLM for diadic trust and related interpersonal relationship attributes. We first identified trust-related concepts from five established human trust models. We then determined a threshold for significant conceptual alignment by computing pairwise cosine similarities across 60 general emotional concepts. Then we measured the cosine similarities between the LLM’s internal representation of trust and the derived trust-related concepts. Our results show that the internal trust representation of EleutherAI/gpt-j-6B aligns most closely with the Castelfranchi socio-cognitive model, followed by the Marsh Model. These findings indicate that LLMs encode socio-cognitive constructs in their activation space in ways that support meaningful comparative analyses, inform theories of social cognition, and support the design of human–AI collaborative systems 1 INTRODUCTION 1 1 1 This paper appears in the proceedings of ICAART 2026. Trust is fundamental to enabling effective cooperation and reducing uncertainty in interactions between individuals, organisations, and intelligent systems. Although widely analysed across disciplines such as psychology, sociology, economics, and cognitive science [ 3 , 8 , 9 , 16 , 13 , 19 ] , there remains no universal agreement on how trust should be defined or operationalised. At a high level, trust can be understood as an expectation held by a trustor that a trustee will perform specific actions reliably, competently, and in alignment with the trustor’s beliefs for the successful fulfillment of a shared goal. As digital ecosystems continue to expand and autonomous systems become more integrated into daily life, the ability to establish, assess, and manage trust is increasingly vital—particularly in the context of human-AI collaboration and agent-agent interactions. Within the multi-agent systems (MAS) community, two dominant perspectives have shaped approaches to modelling trust: computational models [ 12 ] and socio-cognitive models [ 7 ] . Computational models typically derive trust values from past behaviours, performance metrics, or reputation signals, and are well suited to structured or predictable environments. However, they provide limited support for capturing the role of context, intention, and adaptation that characterise trust in dynamic scenarios. In contrast, socio-cognitive models [ 7 , 3 ] , conceptualise trust as a mental attitude grounded in beliefs, goals, and assumptions about the trustee’s capabilities and intentions. While theoretically more expressive, these models are difficult to operationalise at scale, because implementing such complex mental states computationally brings forward significant challenges. Recent work shows that large language models (LLMs) exhibit emergent, human-like reasoning capabilities, including their ability to represent and operate over high-level social constructs such as trust, emotion, and norms [ 5 , 10 ] . A growing body of evidence shows that LLMs not only encode diverse patterns of human behaviour from their training data, but can also participate in interactions that reflect broader societal norms and structures [ 17 , 22 ] . Prior work in this space has highlighted how LLM-based agents exhibit personality-driven and affective behaviours, collaborate within team settings, and even develop spontaneous social dynamics during multi-agent interactions. Building on this foundation, trust research has recently begun to leverage LLMs as both analytical and generative tools, marking a promising new direction for the study of socio-cognitive phenomena. Existing work on studying trust reasoning largely adopts a black-box perspective, focusing on the inputs and outputs of LLMs without probing their internal reasoning processes. Under this paradigm, LLMs have demonstrated notable capability in analysing interpersonal conversations to infer trust dynamics, and in generating strategic action plans to foster trust when role-playing as one party in a relationship [ 5 ] . Despite these advancements, little is known about how LLMs internally represent and reason about trust. To date, no study has taken a white-box approach to examining the internal activation patterns, that underpin trust-related cognition within LLMs. Addressing this gap is essential for understanding not only whether LLMs can reason about trust, but how such reasoning emerges within their underlying computational architecture. Our work bridges this gap by introducing an evaluation framework that examines how large language models conceptualise trust in their internal embeddings. Specifically, we analyse the extent to which trust-related constructs—grounded in established theoretical models—are represented and aligned within these latent representations. To operationalise this, we divide our work into two parts. In the first stage of our study, we analysed the metric properties of a chosen LLM’s activation space with respect to our focus on concepts related to interpersonal relationships. In the first phase of our study, we curated a set of positive and negative emotions as mention in Table 4 that an individual may express towards another. For each emotion, we generated corresponding embedding vectors from the activation space of the LLM, EleutherAI/gpt-j-6B. 3 3 3 https://huggingface.co/EleutherAI/gpt-j-6b We use this model because it is fully open-source and provides unrestricted access to layer-wise activations, making it well suited for white-box representational analysis. We then compute pairwise cosine similarities between all these vectors and plot their distribution as a histogram to estimate a cosine similarity threshold that differentiates significantly similar concepts from less similar ones. In the second phase, we compiled a collection of concepts associated with trust (e.g., competence), as identified across multiple established trust models. Embedding vectors were generated for trust and for each of these related concepts, and we then computed cosine similarities between the trust vector and every concept vector. Using the similarity threshold derived from the first phase, along with average cosine similarity within each trust model, we quantified the extent to which the LLM’s internal representations of trust aligned with the conceptual structures proposed by different theoretical frameworks. This allows us to identify which trust models are most prominently reflected in the LLM’s internal trust representation. 2 MODELS OF TRUST Trust models provide theoretical and conceptual foundations for understanding how trust is formed, evaluated, and maintained between individuals, groups, or systems. They identify the psychological, social, or cognitive mechanisms that drive trust-building and outline the factors that influence trust-related decisions. In our work, we consider five models of trust. The Marsh Model [ 12 ] formalizes trust as a computational concept, defining it as a probability that a trustee will act in a beneficial or at least non-harmful manner. He introduces distinctions such as basic trust (a general propensity to trust), general trust (trust in a class of trustees), and situational trust (trust in a specific context), and proposes mechanisms for updating trust based on interactions and experience. Marsh’s framework provides a rigorous mathematical foundation for modeling trust in artificial agents, enabling the simulation of trust dynamics in multi-agent systems and automated decision-making environments. The Mayer Model [ 13 ] presents an integrative model of organisational trust, which conceptualizes trust as