Exploring Needs and Design Opportunities for Proactive Information Support in In-Person Small-Group Conversations Conference: Proceedings of the Posters of the CHI Conference on Human Factors in Computing Systems; April 13 - 17, 2026; Barcelona, Spain Proceedings of the Posters of the CHI Conference
Shaoze Zhou, Diana Nelly Rivera Rodriguez, Pedro Remior, Joaquin Frangi, Lingyao Li, Renkai Ma, Janet G. Johnson, Christine Lisetti, Chen Chen · 2026
Read Exploring Needs and Design Opportunities for Proactive Information Support in In-Person Small-Group Conversations Conference: Proceedings of the Posters of the CHI Conference on Human Factors in Computing Systems; April 13 - 17, 2026; Barcelona, Spain Proceedings of the Posters of the CHI Conference by Shaoze Zhou, Diana Nelly Rivera Rodriguez, Pedro Remior, Joaquin Frangi, Lingyao Li, Renkai Ma, Janet G. Johnson, Christine Lisetti, Chen Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17240.txt.
Introduction
Shaoze Zhou and seven co-authors study how to help small groups talk face to face. Group talk is live and fast. People must give it full focus. They cannot pause to fix what they said. They must also read tone, face, and gesture cues. The team looks at mixed reality tools that offer help in the moment.
The study asks what kind of proactive support people need. It also asks what design choices could meet those needs. Help could mean facts, prompts, or cues shown at the right time. Done well, such tools could help each person join in more. The work speaks to designers of smart glasses and group aids.
Catalog record
| CREATOR | Shaoze Zhou, Diana Nelly Rivera Rodriguez, Pedro Remior, Joaquin Frangi, Lingyao Li, Renkai Ma, Janet G. Johnson, Christine Lisetti, Chen Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-17240
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exploring Needs and Design Opportunities for Proactive Information Support in In-Person Small-Group Conversations Conference: Proceedings of the Posters of the CHI Conference on Human Factors in Computing Systems; April 13 - 17, 2026; Barcelona, Spain Proceedings of the Posters of the CHI Conference on Human Factors in Computing Systems (CHI Poster ’26), April 13 - 17, 2026, Barcelona, Spain DOI: 123456 ISBN: 123456 Shaoze Zhou, Diana Nelly Rivera Rodriguez, Pedro Remior, Joaquin Frangi, Lingyao Li, Renkai Ma, Janet G. Johnson, Christine Lisetti, Chen Chen Abstract . In-person small-group conversations play a crucial role in everyday life; however, facilitating effective group interaction can be challenging, as the real-time nature demands full attention, offers no opportunity for revision, and requires interpreting non-verbal cues. Using Mixed Reality to provide proactive information support shows promise in helping individuals engage in and contribute to group conversations. We present a preliminary participatory design and qualitative study ( N = 10 N=10 ) using focus groups and two technology probes to explore the opportunities of designing proactive information support in in-person small-group conversations. We reveal key design opportunities concerning how to maximize the benefits of proactive information support and how to effectively design such supporting information. Our study is crucial for paving the way toward designing future proactive AI agents to enable the paradigm of augmented in-person small-group conversation experience . Figure 1 . In-person small-group conversation experiences enabled by prototyped technology probes; (a) a third-person view showing one conversation participant wearing the MR headset; (b) a first-person view through the MR headset showing the supporting information overlay; (c) the MR supporting information showing the summary of prior conversation context. 1. Introduction In-person small-group conversations in everyday and professional settings are critical to share information, spark new ideas, build interpersonal relationships, and promote health and well-being. However, achieving effective in-person group conversations can be challenging and cognitively demanding, as the real-time nature requires full attention, provides no editing time, and involves understanding of non-verbal cues ( 30 ; 8 ; 11 ) . As a result, conversation participants need to understand complex interaction dynamics, adhere to social norms, manage multiple speakers, and tailor spoken messages for a broader audience ( 27 ) . Recent M ixed R eality (MR) headsets show promise as conversational supporting systems by presenting relevant information through MR overlays. In dyadic conversation scenarios, prior research has examined how critical supporting information ( e.g., keywords extracted from spoken speech ( 10 ; 18 ) , relevant background context ( 18 ) , and guidance for subsequent utterances ( 31 ; 29 ) ) can be used to facilitate in-person conversational experiences. However, it remains unclear how a similar conversational supporting information can be designed or delivered for an in-person group conversational experience. In particular, generalizing the design and findings of MR-based conversational support systems from dyadic to group conversations is challenging due to the increased complexity of group interactions: compared to dyadic conversations, in-person group conversations involve more complex dynamics due to the well-known ‘many-minds problem,’ in which communication and interaction challenges increase as more participants join, making turn-taking, listening, and disclosure more difficult ( 8 ; 28 ) . Designing proactive support for a variety of conversational experiences has also shown promise in enhancing synchronous online ( 22 ; 14 ; 21 ) and in-person ( 29 ) dyadic and group interactions. Proactive AI , rooted in the framework of mixed-initiative interaction ( 1 ; 13 ) , envisions an AI agent that can autonomously determine when and how to act without requiring explicit user requests. While prior work, e.g., SocialMind ( 29 ) , has demonstrated the effectiveness of proactive conversational assistant systems for dyadic interactions — where in-situ assistive MR overlays are delivered via heads-up displays on AI glasses — it remains unclear how such proactive support can be generalized to group conversations. We present a preliminary study ( N=10 , two small groups with three conversation participants each and one larger group with four participants) using focus groups and technology probe ( 15 ) to explore design opportunities for MR-based proactive information support in in-person small-group conversations. Although no existing MR tool provides proactive support for in-person group conversations, we develop two experimental testbeds using Meta Quest 3S ( 16 ) , as the technology probes, to investigate the affordances of proactive information support and the types of information users may seek when interacting with multiple conversation participants. These two testbeds serve as inspiration for ideas generated during the participatory design process. Our first testbed renders and simulates proactive information support through a Wizard-of-Oz (WoZ) study ( 9 ) , whereas another allows users to reactively seek information support by typing during the conversation. Figure 1 shows the experience enabled by our technology probes. We identify key design opportunities concerning how to maximize the benefits of proactive information support and how to effectively design supporting information. Our findings are crucial for paving ways toward designing future proactive AI agents to enable the paradigm of augmented in-person small-group conversation experience . 2. Methods Grounded in user-centered design ( 26 ) , we aim to explore the needs and design opportunities for proactive information support in in-person group conversation experiences. Although our participatory design ( 24 ; 6 ) used the Meta Quest 3S ( 16 ) , the findings are expected to generalize to other headsets, AR glasses, and AI glasses with heads-up displays. Our study has been approved by the Institutional Review Board. We aim to address two R esearch Q uestions (RQs): how should proactive supporting information be designed, and in what ways can it facilitate in-person group conversation experiences? ( RQ1 ); what types of information are required to support in-person group conversation experiences? ( RQ2 ). Figure 2 . Participants’ demographics. We used & and # as superscripts in participant ID to denote MR users in Phases 3 and 4 . Responses of AI Experience and Blind Typing reflect participants’ agreement with the given statement, ‘I am experienced in using AI tools’ and ‘I am experienced in typing without looking at the keyboard’ with 5 indicating strongly agree and 1 indicating strongly disagree . Each Interpersonal Communication Skill Inventory ( 17 ; 3 ; 4 ) score ranges from 0 to 30 , with higher scores indicating areas of strength. Participants and Procedures. We recruited 10 participants and formed two small groups with three participants each and one larger group with four participants (Figure 2 ). Participants were first introduced to the project and instructed to sign the informed consent. Each group was then instructed to complete four phases. In Phases 3 and 4, the participant group was instructed to discuss open-ended topics. The topics included where to take a Christmas trip in California and how AI may reshape the future of work . To prevent carry-over effects, the topics assigned to Phase 3 and 4 were different, with counterbalancing applied across participant groups. Figure 1 shows an example experience enabled by technology probes prototyped in Phase 3 and 4. All study procedures, including the MR users’ first-person view, were audio- and video-recorded. Each study session lasted approximately 90 minutes. \bullet Phase 1: Pre-study Questionnaires. Participants were