Developing an AI-driven multimodal approach to visualising resilient team performance: joint attentional engagement with gaze and speech in simulated emergency scenarios
Atsushi Miyazaki, Frank Coffey, Hitoshi Sato, Andrew K Mackenzie, Kyota Nakamura, Kazuya Bise, Takeshi Saitoh, Takeru Abe, Miharu Fuyuno, Stephen Timmons, Keiko Tsuchiya · 2025
Read Developing an AI-driven multimodal approach to visualising resilient team performance: joint attentional engagement with gaze and speech in simulated emergency scenarios by Atsushi Miyazaki, Frank Coffey, Hitoshi Sato, Andrew K Mackenzie, Kyota Nakamura, Kazuya Bise, Takeshi Saitoh, Takeru Abe, Miharu Fuyuno, Stephen Timmons, Keiko Tsuchiya (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-12742140.txt.
Description
Atsushi Miyazaki and colleagues aim cameras and eye-trackers at emergency teams to make their coordination visible, in this study from twenty twenty-five. Four simulation sessions, in Japan and the United Kingdom, paired clinician and nurse, one experienced pair and one novice pair per country. An AI program annotated where each gaze fell, while speech was timed and aligned.
Experienced pairs shared visual attention more often and longer, and spoke more. The styles diverged charmingly by country. The Japanese experts' gaze-sharing rose and fell with their speech, coordinating out loud. The British experts showed the opposite pattern, watching each other's hands while talking to the patient's family instead. Novice pairs showed neither pattern strongly. The authors admit the auto-annotation is only forty to sixty percent accurate, but offer the visualization as a first lens on resilient teamwork.
Catalog record
| CREATOR | Atsushi Miyazaki, Frank Coffey, Hitoshi Sato, Andrew K Mackenzie, Kyota Nakamura, Kazuya Bise, Takeshi Saitoh, Takeru Abe, Miharu Fuyuno, Stephen Timmons, Keiko Tsuchiya |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |