Exploratory Models of Human-AI Teams: Leveraging Human Digital Twins to Investigate Trust Development

Daniel Nguyen, Myke C. Cohen, Hsien-Te Kao, Grant Engberson, Louis Penafiel, Spencer Lynch, Svitlana Volkova · 2024

Read Exploratory Models of Human-AI Teams: Leveraging Human Digital Twins to Investigate Trust Development by Daniel Nguyen, Myke C. Cohen, Hsien-Te Kao, Grant Engberson, Louis Penafiel, Spencer Lynch, Svitlana Volkova (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-01049.txt.

Description

Abstract As human-agent teaming (HAT) research continues to grow, computational methods for modeling HAT behaviors and measuring HAT effectiveness also continue to develop. One rising method involves the use of human digital twins (HDT) to approximate human behaviors and socio-emotional-cognitive reactions to AI-driven agent team members (Barricelli & Fogli, 2024).

Catalog record

CREATORDaniel Nguyen, Myke C. Cohen, Hsien-Te Kao, Grant Engberson, Louis Penafiel, Spencer Lynch, Svitlana Volkova
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-01049

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploratory Models of Human-AI Teams: Leveraging Human Digital Twins to Investigate Trust Development Daniel Nguyen, Myke C. Cohen, Hsien-Te Kao, Grant Engberson, Louis Penafiel, Spencer Lynch, Svitlana Volkova Abstract As human-agent teaming (HAT) research continues to grow, computational methods for modeling HAT behaviors and measuring HAT effectiveness also continue to develop. One rising method involves the use of human digital twins (HDT) to approximate human behaviors and socio-emotional-cognitive reactions to AI-driven agent team members (Barricelli & Fogli, 2024). In this paper, we address three research questions relating to the use of digital twins for modeling trust in HATs. First, to address the question of how we can appropriately model and operationalize HAT trust through HDT HAT experiments, we conducted causal analytics of team communication data to understand the impact of empathy, socio-cognitive, and emotional constructs on trust formation. Additionally, we reflect on the current state of the HAT trust science to discuss characteristics of HAT trust that must be replicable by a HDT such as individual differences in trust tendencies (e.g., propensity to trust, Jessup et al., 2019), emergent trust patterns (e.g., trust violation and repair, Wildman et al., 2024), and appropriate measurement of these characteristics (e.g., growth modeling, Abramov et al., 2020). Second, to address the question of how valid measures of HDT trust are for approximating human trust in HATs, we discuss the properties of HDT trust: self-report measures, interaction-based measures, and compliance type behavioral measures. Additionally, we share results of preliminary simulations comparing different LLM models for generating HDT communications and analyze their ability to replicate human-like trust dynamics. Third, to address how HAT experimental manipulations will extend to human digital twin studies, we share experimental design focusing on propensity to trust for HDTs vs. transparency and competency-based trust for AI agents. Keywords: Human-AI Teaming, Trust, Human Digital Twins 1 Introduction The integration of artificial intelligence (AI) into operational environments has become increasingly vital across diverse domains, fundamentally transforming how humans and machines collaborate to achieve shared objectives. Over the past decade, Human-AI Teaming (HAT) research has emerged as a critical field, with scholars applying cognitive science principles to understand the complexities of these novel partnerships. This growing body of research reflects the urgency of understanding how humans and AI can work together effectively, safely, and productively. As the HAT literature expands and AI capabilities advance, innovative methodologies for studying these interactions have emerged. One promising approach involves the use of human digital twins (HDTs) - computational models designed to replicate human responses and behaviors within HAT contexts. These HDTs can be configured to simulate both state-based responses (such as transient cognitive and affective reactions) and trait-based characteristics (including dispositional individual differences), offering a versatile alternative to traditional human-subjects research [ 1 , 2 ] . The advantages of HDTs in HAT research are significant. Beyond addressing the practical constraints of human-subjects studies, such as cost and recruitment challenges, HDTs provide unprecedented control over experimental variables and the ability to rapidly test multiple scenarios. This capability is particularly valuable for investigating complex team phenomena, with trust emerging as a critical area of focus. Trust - the willingness to be vulnerable to another agent’s actions - serves as a fundamental determinant of HAT effectiveness and success. However, the validity of using HDTs to study trust dynamics in HATs requires careful examination. This paper addresses three crucial questions regarding the implementation of HDTs in trust research: (1) How can we effectively model and measure HAT trust using HDT-based approaches? (2) What are the essential characteristics of HAT trust that must be operationalized in HDT trust models? (3) How do experimental manipulations from traditional HAT studies translate to HDT-based research? By examining these questions, we aim to establish a framework for validating and implementing HDTs in HAT trust research, ultimately advancing our understanding of human-AI collaboration and trust development. 2 Research Question 1: How can we model and measure HAT trust dynamics in HDTs? 2.1 Theoretical Considerations for Modeling HAT Trust in HDTATs 2.1.1 Evolution of Trust Definitions in Human-AI Contexts Trust has emerged as a multifaceted construct whose definition has evolved alongside technological advancement. In organizational contexts where HATs operate, Mayer et al. [ 3 ] established a foundational definition of trust as an individual’s willingness to be vulnerable to another agent’s actions during goal-oriented, risky situations. This conceptualization gained particular relevance in AI-driven systems, where users must navigate the inherent risks of relying on imperfect automation [ 4 ] . Building on this foundation, Lee and See [ 5 ] specifically addressed trust in automation, defining it as an attitude regarding an automated agent’s reliability in risk-characterized situations. While this definition remains influential in HAT research, it primarily reflects traditional human-automation relationships characterized by clear supervisory hierarchies [ 6 ] . Modern AI systems, however, engage in more sophisticated interactions that mirror human teamwork dynamics, suggesting trust should be reconceptualized as a dynamic, relational construct [ 7 ] . 2.1.2 Trust Formation and Reliance in Human-AI Teams Lee and See’s [ 5 ] theoretical model suggests that trust in automation develops through people’s understanding of three key elements: the system’s intended functions, expected performance levels, and underlying processes. This framework suggests that optimal trust—and consequently, appropriate reliance—emerges when users’ perceptions align with the AI’s actual capabilities [ 4 , 8 ] . This alignment becomes particularly crucial in safety-critical domains like search and rescue operations or disaster response, where HAT failures can have severe consequences [ 9 ] . The wealth of empirical literature on trust in AI makes it an ideal construct for exploring the utility of HDTAT experimental paradigms. However, recent meta-analyses challenge the assumed relationship between trust attitudes and behavioral reliance [ 10 , 11 , 12 ] . Users may maintain general trust in an AI system while choosing not to rely on it in specific instances, highlighting the distinction between attitudinal and behavioral trust. This observation aligns with the argument that trust in automation is indisputable only when actual reliance is observed [ 13 ] . Consequently, HDTAT experiments must model both perceptual trust, which encompasses attitudes and perceptions about an AI teammate’s trustworthiness, and behavioral trust, which manifests through observable decisions reflecting trust through actions. 2.1.3 Beyond Capability-Based Trust Contemporary research reveals that trust in HATs extends beyond perceptions of AI capabilities. Jessup et al. [ 14 ] emphasize the role of automation trust propensity—an individual’s baseline tendency to trust automated systems. Hoff and Bashir [ 15 ] characterize this as dispositional trust, shaped by demographic and personality factors including age, gender, culture, and individual traits. While these variables prove difficult to control in traditional laboratory studies, HDTATs offer unique opportunities to explore their effects systematically, particularly regarding emotional and moral dimensions of trust that remain understudied [ 16 ] . 2.1.4 Trust as a Dynamic Social Construct The validation of HDTAT trust models must acknowledge trust’s dynamic and social nature. Research has identified temporal patterns in human-automation trust, including the “perfect automation schema” where users initially overestimate unfamiliar automation capabilities [ 17 ] , and a tendency to undervalue AI reliability following errors [ 18 ] . These patterns align with Lee and See’s [ 5 ] model stating that people

Read the complete text