Perception of an AI Teammate in an Embodied Control Task Affects Team Performance, Reflected in Human Teammates’ Behaviors and Physiological Responses
Yinuo Qin, Richard T Lee, Paul Sajda · 2025
Read Perception of an AI Teammate in an Embodied Control Task Affects Team Performance, Reflected in Human Teammates’ Behaviors and Physiological Responses by Yinuo Qin, Richard T Lee, Paul Sajda (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15332.txt.
Introduction
Yinuo Qin, Richard Lee, and Paul Sajda report that adding an AI teammate made human teams worse at a shared control task, in a 2025 paper. The teams worked in virtual reality on a sensorimotor task, guiding a system together. With an active, human-like AI member, performance dropped, and the drop grew as the task hardened. Sensors on the humans told the same story from another angle.
Arousal rose, engagement fell, and the humans talked to each other less intensely. These shifts persisted even as the humans' opinion of the AI teammate warmed over time. The authors warn that dropping AI into teams is not a free upgrade: design must protect the human dynamics that make teams work. The study is small and lab-bound, but its measures, behavior plus physiology, make the warning hard to wave away.
Catalog record
| CREATOR | Yinuo Qin, Richard T Lee, Paul Sajda |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-15332
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Perception of an AI Teammate in an Embodied Control Task Affects Team Performance, Reflected in Human Teammates’ Behaviors and Physiological Responses Yinuo Qin, Richard T Lee, Paul Sajda Abstract The integration of artificial intelligence (AI) into human teams is widely expected to enhance performance and collaboration. However, our study reveals a striking and counterintuitive result: human-AI teams performed worse than human-only teams, especially when task difficulty increased. Using a virtual reality-based sensorimotor task, we observed that the inclusion of an active human-like AI teammate disrupted team dynamics, leading to elevated arousal, reduced engagement, and diminished communication intensity among human participants. These effects persisted even as the human teammates’ perception of the AI teammate improved over time. These findings challenge prevailing assumptions about the benefits of AI in team settings and highlight the critical need for human-centered AI design to mitigate adverse physiological and behavioral impacts, ensuring more effective human-AI collaboration. 1 Introduction The rapid progress in artificial intelligence (AI) has revolutionized various facets of human society, enabling a wide range of applications that were once confined to science fiction. From autonomous systems in transportation to decision-support tools in healthcare and finance, AI has seamlessly integrated into our daily lives, reshaping how we work, interact, and make decisions Silver et al (2018) ; Berner et al (2019) ; Topol (2019) ; McKinney et al (2020) ; Ouyang et al (2020) . This growing ubiquity highlights the urgent need to study how human behaviors and interactions are influenced by the integration of AI into collaborative and decision-making processes. A long-standing hypothesis within the AI community is that effective AI partners in human teams should possess two critical attributes: human-like behavior and super-human intelligence Weber et al (2011) ; Korteling et al (2021) ; † et al(2022)(FAIR)†, Bakhtin, Brown, Dinan, Farina, Flaherty, Fried, Goff, Gray, Hu et al (FAIR) ; Duéñez-Guzmán et al (2023) . AI agents with these qualities are believed to foster trust and improve team performance, as they align closely with human expectations of collaboration. Past research has supported this notion by demonstrating that AI systems equipped with advanced capabilities – such as theory of mind and natural communication – can significantly enhance human trust and performance in human-AI partnerships Wang et al (2021) ; Williams et al (2022) ; Westby and Riedl (2023) . This has led to the widely accepted perception that AI agents serve as a “second brain” to augment human cognitive abilities and strengthen human-AI collaborations. Empirical evidence has shown that human-AI teams often outperform teams composed solely of humans or AI agents, particularly in tasks that require complementary strengths Bansal et al (2019) ; Passalacqua et al (2024) . However, these studies predominantly focus on dyadic interactions, where a single human collaborates with a single AI agent acting as an assistant to be queried or consulted Lee et al (2022) ; Wu et al (2022) ; Sharma et al (2023) ; Glickman and Sharot (2024) ; Vaccaro et al (2024) . As AI technology advances, a foreseeable future involves AI agents becoming active teammates within larger human teams, playing more participatory and collaborative roles. Despite this, significant gaps remain in understanding how the inclusion of AI as an active team member impacts team dynamics, individual behaviors, and physiological responses Zhang et al (2021) ; Reverberi et al (2022) ; Lematta et al (2022) ; Schelble et al (2024) . Moreover, while prior research has explored human-AI interactions in domains like text-based communication and decision-making Lee et al (2022) ; Wu et al (2022) ; Sharma et al (2023) ; Vaccaro et al (2024) , there is a conspicuous lack of studies examining embodied collaborative tasks. Embodied AI, which interacts physically and cognitively with humans in shared environments, represents a frontier application of AI in critical areas such as autonomous driving, manufacturing, and healthcare. These contexts demand nuanced collaboration and high-stakes decision-making, raising questions about how AI agents affect human teams operating in such environments. In this study, we address these gaps by conducting the first investigation of embodied collaborative control tasks to examine how human-like AI teammates influence team performance, cognitive dynamics, behavior, and physiological responses. Our experimental design leverages the Apollo Distributed Control Task (ADCT), a complex sensorimotor task performed in a virtual reality (VR) environment. Participants collaborated in triads, comprising either all-human teams or teams with a Wizard of Oz (WOz) AI agent – an expert human-controlled system presented as an advanced AI partner Maulsby et al (1993) . We collected and analyzed multi-modal data, including team performance metrics, motor actions, verbal communication, physiological signals (i.e., pupil size, blink rate, and electroencephalography (EEG)), and self-reported evaluations of team dynamics. Surprisingly, our findings challenge prevailing assumptions about the benefits of human-AI collaboration. Contrary to expectations, teams involving a WOz AI agent exhibited significantly lower performance compared to all-human teams. This decline was accompanied by pronounced changes in human behavior and physiology. Participants working with the AI agent experienced heightened arousal, as indicated by increased pupil dilation and blink rates, alongside reduced engagement and communication intensity. These physiological and behavioral changes disrupted team dynamics, making effective collaboration more challenging. Furthermore, while participants’ perceptions of the AI agent improved over time in terms of leadership, helpfulness, and trust, team performance remained suboptimal. Our results underscore the complex interplay between human subjective perception, behavior, and performance. These results highlight a critical, yet often overlooked, consideration in the design of AI agents for collaborative tasks: the impact of AI presence on human cognition and physiology. Our study highlights the importance of minimizing negative effects on human teammates, both to enhance performance and to promote sustainable and effective collaboration. We argue that the next generation of AI agents must not only optimize their individual capabilities but also account for the cognitive and physiological states of their human partners. By prioritizing these considerations, AI systems can better support human teams in achieving their collective goals. Figure 1: Apollo Distributed Control Task (ADCT) overview and performance analysis. a , Experiment setup for human-only and human-AI teams. The left panel shows the different team configurations and participant roles. In human-AI teams, the AI agent always acts as the ThrustPilot. The middle panel illustrates the virtual environment where participants collaborate to control a spacecraft, navigating through red rings and returning to Earth. The right panel depicts the relative positioning and partial views for each role. b , Multi-modal data collection for each role. Behavioral data were recorded for the ThrustPilot, while both physiological and behavioral data were recorded for the YawPilot and PitchPilot in both human-only and human-AI teams. c , Three task conditions in this experiment. From top to bottom, our experiment includes three difficulty levels (Easy, Intermediate, Hard), three experimental sessions (Session 1, 2, 3), and three communication protocols (Incommunicado, Command Word, Free Speech) d-g , Team performance under different task conditions, measured by the number of rings passed. Bars represent performance as mean ± s.e.m. Individual dots represent the number of rings passed by each team (human-only: n=10 teams; human-AI: n=12 teams). d , Team performance across all task conditions. e , Team performance within each task difficulty level. The color key for the team is used for f and