Developing an AI-driven multimodal approach to visualising resilient team performance: joint attentional engagement with gaze and speech in simulated emergency scenarios

Atsushi Miyazaki, Frank Coffey, Hitoshi Sato, Andrew K Mackenzie, Kyota Nakamura, Kazuya Bise, Takeshi Saitoh, Takeru Abe, Miharu Fuyuno, Stephen Timmons, Keiko Tsuchiya · 2025

Read Developing an AI-driven multimodal approach to visualising resilient team performance: joint attentional engagement with gaze and speech in simulated emergency scenarios by Atsushi Miyazaki, Frank Coffey, Hitoshi Sato, Andrew K Mackenzie, Kyota Nakamura, Kazuya Bise, Takeshi Saitoh, Takeru Abe, Miharu Fuyuno, Stephen Timmons, Keiko Tsuchiya (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12742140.txt.

Description

Atsushi Miyazaki and colleagues aim cameras and eye-trackers at emergency teams to make their coordination visible, in this study from twenty twenty-five. Four simulation sessions, in Japan and the United Kingdom, paired clinician and nurse, one experienced pair and one novice pair per country. An AI program annotated where each gaze fell, while speech was timed and aligned.

Experienced pairs shared visual attention more often and longer, and spoke more. The styles diverged charmingly by country. The Japanese experts' gaze-sharing rose and fell with their speech, coordinating out loud. The British experts showed the opposite pattern, watching each other's hands while talking to the patient's family instead. Novice pairs showed neither pattern strongly. The authors admit the auto-annotation is only forty to sixty percent accurate, but offer the visualization as a first lens on resilient teamwork.

Catalog record

CREATORAtsushi Miyazaki, Frank Coffey, Hitoshi Sato, Andrew K Mackenzie, Kyota Nakamura, Kazuya Bise, Takeshi Saitoh, Takeru Abe, Miharu Fuyuno, Stephen Timmons, Keiko Tsuchiya
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC12742140

Browse the full library · About the Tower of Babel