What Are You Really Asking For? A Comparative 5W1H Analysis of Learner Questioning in CPR Training with IVAs in Screen-based and Augmented Reality Environments Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3791977 ISBN: 979-8-4007-2278-3/2026/04 1614 CCS: Human-centered computing Empirical studies in HCI CCS: Human-centered computing Mixed / augmented reality CCS: Human-centered computing Natural language interfaces

Hyerim Park, Jinseok Hong, Heejeong Ko, Woontack Woo · 2026

Read What Are You Really Asking For? A Comparative 5W1H Analysis of Learner Questioning in CPR Training with IVAs in Screen-based and Augmented Reality Environments Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3791977 ISBN: 979-8-4007-2278-3/2026/04 1614 CCS: Human-centered computing Empirical studies in HCI CCS: Human-centered computing Mixed / augmented reality CCS: Human-centered computing Natural language interfaces by Hyerim Park, Jinseok Hong, Heejeong Ko, Woontack Woo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14299.txt.

Introduction

Park and co-authors compare how learners ask questions during CPR training with virtual agents in two media. One agent appears in augmented reality in the room, and the other on a screen. Their 5W1H framework sorts questions by who, what, when, where, why, and how. The AR agent drew more and longer questions aimed at clarification, with higher felt presence. The screen agent drew more questions about refining procedure. Presence shaped when and what learners asked, filtered by their learning habits.

Catalog record

CREATORHyerim Park, Jinseok Hong, Heejeong Ko, Woontack Woo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE113862
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.14299

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

What Are You Really Asking For? A Comparative 5W1H Analysis of Learner Questioning in CPR Training with IVAs in Screen-based and Augmented Reality Environments Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3791977 ISBN: 979-8-4007-2278-3/2026/04 1614 CCS: Human-centered computing Empirical studies in HCI CCS: Human-centered computing Mixed / augmented reality CCS: Human-centered computing Natural language interfaces Hyerim Park, Jinseok Hong, Heejeong Ko, Woontack Woo Abstract . Question-asking is one of the key indicators of cognitive engagement. However, understanding how the distinct psychological affordances of presentation media shape learners’ spoken inquiries with embodied Intelligent Virtual Agents (IVAs) remains limited. To systematically examine this process, we propose a 5W1H-based framework for analyzing learner questions. Using this framework, we conducted a user study comparing an Augmented Reality-based IVA (AR-IVA) deployed in the physical environment with a screen-based IVA (Video-IVA) during cardiopulmonary resuscitation (CPR) instruction. Results showed that the AR-IVA elicited higher spatial and social presence and promoted more frequent and longer questions focused on clarification and understanding. In contrast, the Video-IVA encouraged questions regarding procedural refinement. Presence acted as a selective filter, shaping the timing and topic of questions rather than as a universal mediator. These effects were significantly moderated by learners’ motivational and strategic characteristics toward learning. Based on these findings, we propose design implications for IVA-supported learning systems. Figure 1 . Comparison of learner questioning behavior with Intelligent Virtual Agents (IVAs) presented in two modalities: (a) augmented reality (AR) environment, where learners experienced higher spatial and social presence and asked conceptual-deepening questions; (b) screen-based (Video) environment, where learners engaged with the same IVA on a flat display and generated procedural-refinement questions. Figure (a) shows a conceptual illustration of the AR-IVA environment, where a learner (represented by the silhouette wearing an HMD) interacts with a 3D virtual instructor performing CPR on a virtual mannequin. In this condition, the phrase "Why should the nose be pinched shut?" is displayed as a sample inquiry, reflecting the learners' tendency to pursue conceptual deepening by probing underlying principles. Figure (b) represents the Video-based IVA modality, where the learner interacts with the virtual instructor through a 2D screen interface. In this setting, the text "How many chest compressions should be given?" is presented as a sample inquiry, illustrating the learners' focus on procedural refinement to verify the accuracy and steps of the protocol. † † cc-license: by 1. Introduction Question-asking serves as a key indicator of learners’ cognitive engagement, directly reflecting how they interpret, explore, and construct knowledge from instructional content ( 43 ; 27 ; 13 ) . With the widespread adoption of Large Language Model (LLM)–based conversational services, such as ChatGPT and Gemini, research has extensively investigated how learners interact with AI partners to facilitate learning ( 41 ; 55 ) . Prior studies have examined learners’ prompt patterns and dialogue logs to uncover information-seeking strategies ( 42 ; 70 ) , metacognitive regulation ( 18 ; 28 ) , and conceptual understanding processes ( 2 ; 12 ) . However, these analytical insights remain largely restricted to text-based chat interfaces, limiting our understanding of how questioning unfolds in more naturalistic, embodied contexts. LLMs have recently been extended into avatar-based Intelligent Virtual Agents (IVAs), enabling learners to interact with agents through natural, spoken dialogue ( 79 ; 87 ; 67 ) . These embodied IVAs provide high visual fidelity and heightened social presence, offering interaction experiences akin to human tutoring. Despite these technological advancements, research has largely concentrated on system-level performance ( 8 ; 54 ) and user-experience outcomes, such as presence, usability, and learning performance ( 84 ; 32 ; 56 ) . Little attention has been paid to the process of how learners construct and adapt their spoken inquiries during interaction. In particular, systematic comparative research is lacking on how the psychological affordances of educational media ( 53 ) and learner characteristics jointly shape learners’ questioning behavior. Therefore, we propose a 5W1H-based framework to systematically analyze learners’ questioning behavior with avatar-based IVAs. The framework captures who asks, what is asked, when , where and why questions arise, and how they are expressed. We implemented a real-time question-and-answer (Q&A) IVA system delivering Cardiopulmonary Resuscitation (CPR) instruction. In the user study, the identical IVA was presented in two presentation modes: an Augmented Reality-based (AR-IVA) and a screen-based (Video-IVA) mode. Forty participants were assigned to one of these conditions and encouraged to ask questions freely during and after instruction. All spoken inquiries were automatically transcribed and logged. Using this data, we examined the direct effects of presentation modality on psychological affordances (specifically spatial and social presence), questioning behavior, and learning outcomes. Subsequently, we analyzed the mediating role of spatial and social presence and the moderating role of learners’ motivation and strategies in the influence of presentation modality on questioning behavior. Our results show that learning with AR-IVA increased spatial and social presence, improved learning performance, and significantly altered questioning behavior compared to Video-IVA. Specifically, the AR-IVA promoted more frequent and longer questions oriented toward conceptual deepening, whereas the Video-IVA encouraged procedural refinement. However, these behavioral changes were not directly mediated by the presence. Instead, heightened presence acted as a selective filter, minimizing disruptive questioning during the demonstration stage and focusing attention on the conceptual core. We also found that variations in questioning timing and content—such as topic, type, and form—were driven primarily by learners’ motivation and strategies rather than by the medium itself. These results suggest that learner questioning behavior with avatar-based IVAs is not determined solely by the technological medium but emerges through complex interactions with individual learner characteristics. Our study contributes to the understanding of avatar-based IVA interaction in three key ways. • First, we propose a 5W1H-based framework to systematically analyze learners’ questioning behavior during interactions with avatar-based IVAs. • Second, we empirically demonstrate how questioning behavior is shaped by the interplay between the psychological affordances of the presentation modality and learner traits. • Finally, we derive design implications for avatar-based IVA systems to enhance learning by integrating presentation modalities with learners’ traits. 2. Related Work 2.1. LLM-Driven Virtual Agents: From Generation to Experience Research integrating LLMs into AR and VR (virtual reality) environments has primarily centered on enhancing systems’ generative capabilities, particularly the quality of agent outputs ( 68 ) . In educational contexts, technical efforts have focused on developing virtual agents that generate context-aware dialogue using LLMs. For instance, virtual agents combining GPT-4 with augmented context retrieval have been developed to serve as laboratory assistants in VR environments ( 4 ) . Additionally, AR language tutors integrating computer vision with LLMs have been proposed to provide context-aware dialogue and real-time feedback ( 45 ) . Furthermore, integrating LLMs into virtual robots has enabled natural social interactions within educational game scenarios ( 7 ) . Beyond education, research has also integrated spatial computing or AR interfaces with LLMs to develop agents that provide targeted guidance across diverse contexts ( 34 ; 66 ) . Collectively, these studies have focused on advancing and evaluating the expressive and communicative capabilities of LLM-driven virtual agents.

Read the complete text