Design Guidance Towards Addressing Over-Reliance on AI in Sensemaking Conference: Sensemaking @ CHI’26; 2026; Barcelona, Spain CCS: Human-centered computing Human computer interaction (HCI) CCS: Computing methodologies Artificial intelligence
Yihang Zhao, Wenxin Zhang, Amy Rechkemmer, Albert Meroño Peñuela, Elena Simperl · 2026
Read Design Guidance Towards Addressing Over-Reliance on AI in Sensemaking Conference: Sensemaking @ CHI’26; 2026; Barcelona, Spain CCS: Human-centered computing Human computer interaction (HCI) CCS: Computing methodologies Artificial intelligence by Yihang Zhao, Wenxin Zhang, Amy Rechkemmer, Albert Meroño Peñuela, Elena Simperl (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08903.txt.
Introduction
Yihang Zhao and colleagues offer design guidance against over-trust on AI in group sense-making. Poorly designed GenAI tools hand groups plain orders to follow without thinking, eroding self-run sense-making. Group awareness tools instead show group data, surface member gaps to spark useful friction, and trigger self-driven discussion, and the paper presents early rules for GenAI-aided versions.
Catalog record
| CREATOR | Yihang Zhao, Wenxin Zhang, Amy Rechkemmer, Albert Meroño Peñuela, Elena Simperl |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 9983 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.08903
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Design Guidance Towards Addressing Over-Reliance on AI in Sensemaking Conference: Sensemaking @ CHI’26; 2026; Barcelona, Spain CCS: Human-centered computing Human computer interaction (HCI) CCS: Computing methodologies Artificial intelligence Yihang Zhao, Wenxin Zhang, Amy Rechkemmer, Albert Meroño Peñuela, Elena Simperl Abstract . Sensemaking in collaborative work and learning is increasingly supported by GenAI systems, however, emerging evidence suggests that poorly designed GenAI systems tend to provide explicit instruction that groups passively follow, fostering over-reliance and eroding autonomous sensemaking. Group awareness tools (GATs) address this challenge through implicit guidance: rather than instructing groups on what to do, GATs externalize observable collaboration data through visualizations that reveal differences between group members to create cognitive conflict, which triggers autonomous elaboration and discussion, thereby implicitly guiding autonomous sensemaking emergence. Drawing on an initial literature search of existing GAT systems, this paper explores the design of GenAI-augmented GATs to support autonomous sensemaking in collaborative work and learning, presenting preliminary design principles for discussion. Author’s Accepted Manuscript (AAM). This is the Author’s Accepted Manuscript version of the article: Zhao, Y., Zhang, W., Rechkemmer, A., Meroño-Peñuela, A., & Simperl, E. (2026). Design Guidance Towards Addressing Over-Reliance on AI in Sensemaking. Accepted for publication in Sensemaking @ CHI 2026 . 1. Extended Abstract Sensemaking in collaborative work and learning is increasingly supported by GenAI systems, yet emerging evidence suggests that poorly designed GenAI systems tend to provide explicit instruction that groups passively follow, fostering over-reliance and eroding autonomous sensemaking ( 1 ; 17 ; 14 ; 25 ) . Explicit instruction refers to a highly structured approach that breaks down learning and working into manageable, step-by-step components, leaving little room for groups to develop their own interpretations and strategies. Group awareness tools (GATs) address this challenge through implicit guidance: rather than instructing groups on what to do, GATs externalize observable collaboration data through visualizations that reveal differences between group members to create cognitive conflict, which triggers autonomous elaboration and discussion, thereby implicitly guiding autonomous sensemaking emergence ( 15 ; 19 ; 21 ; 9 ; 20 ) . The design question this paper addresses is whether GenAI can be integrated into GATs in a way that provides implicit guidance for supporting autonomous sensemaking in collaborative work and learning. To illustrate the distinction between explicit instruction and implicit guidance, consider a student group working on a collaborative project. A poorly designed GenAI system might tell the group step by step what they need to improve, what each member should do next, and how they should restructure their discussion. A GAT, by contrast, might display a radar chart showing each member’s self-reported knowledge levels across different topics, making differences between members visible without comment. The group sees the variation themselves, discusses what it means, and decides how to respond. The same awareness information produces very different sensemaking outcomes depending on whether it is delivered as instruction or revealed as a pattern for the group to interpret. Traditional GATs are constrained by their reliance on structured, quantitative collaboration data, limiting the kinds of awareness information they can surface ( 26 ; 3 ) . GenAI can analyze unstructured collaboration artifacts such as discussion transcripts and document revisions, potentially surfacing awareness information about aspects of group sensemaking that resist quantification, such as whether members build on each other’s ideas or where shared understanding is weaker than groups believe ( 2 ; 24 ; 6 ; 5 ) . GenAI-augmented GATs therefore represent a promising direction for enriching sensemaking support, provided that integration preserves implicit guidance rather than introduces explicit instruction. Drawing on an initial literature search of existing GAT systems across ACM Digital Library, IEEE Xplore, and Scopus, complemented by backward snowballing, we analyzed how GATs generate, present, and support exploration of group awareness information, asking what design considerations arise when GenAI is integrated. Three considerations emerged consistently. The first concerns where GenAI should and should not be deployed. For awareness information derivable from structured data, such as contribution counts and participation patterns, rule-based approaches remain more appropriate ( 26 ; 3 ) . GenAI’s value lies in qualitative interpretation of unstructured content: assessing whether explanations demonstrate understanding, whether members build on versus talk past each other, or whether emerging tensions reflect substantive disagreement ( 24 ; 2 ) . Hybrid architectures combining rule-based processing for quantitative signals with GenAI for qualitative interpretation may therefore be more appropriate than end-to-end AI pipelines. The second consideration concerns how GenAI-generated awareness information is presented. GATs reveal differences between group members to create cognitive conflict that triggers autonomous elaboration and discussion. GenAI-generated awareness information should serve this same purpose: surfacing differences that groups would otherwise be unable to see, particularly those requiring semantic understanding of unstructured content. Presenting GenAI interpretations as secondary visual encodings that augment rather than replace quantitative representations may enrich the differences revealed, creating richer cognitive conflict that triggers deeper autonomous sensemaking ( 13 ; 8 ; 37 ) . Figure 1 illustrates this approach. The left chart shows a traditional radar chart of group self-reported knowledge levels. The right chart preserves this as the primary representation while encoding GenAI’s independent analysis of actual discussions as background colour intensities on axis segments: darker backgrounds indicate alignment between what groups reported and what their discussions demonstrated, lighter backgrounds reveal differences. The group sees the discrepancy without being told what it means, creating cognitive conflict that may trigger autonomous elaboration and discussion. (a) Without GenAI integration (reproduced from ( 36 ) , translated into English with minor visual revisions). (b) With GenAI integration. Figure 1 . Comparison of radar and spider chart UIs without and with GenAI integration. Figure shows two radar charts side by side. The left chart displays a traditional radar chart with a polygon shape representing group self-reported knowledge levels across multiple knowledge domains. The right chart shows a GenAI-augmented version where the same polygon is preserved but axis segments have varying background colour intensities, with darker backgrounds indicating alignment between self-reported and demonstrated understanding, and lighter backgrounds indicating differences. The third consideration concerns interaction techniques that enable groups to investigate GenAI-generated awareness information rather than passively receive it. Even when GenAI assessments are presented as secondary encodings, groups need affordances to examine the evidence underlying them in order to engage in autonomous elaboration and discussion rather than simply accepting the differences revealed. Figure 2 shows a hover-for-details interaction: hovering over a lightly shaded axis reveals GenAI’s assessed understanding level, a confidence score, and example discussion quotes that served as evidence ( 7 ; 11 ; 4 ; 10 ) . A group observing a discrepancy can read the excerpts, judge whether they agree with the interpretation, and decide whether it warrants further discussion. This positions GenAI outputs as starting points for autonomous elaboration and discussion, supporting the implicit guidance mechanism that GATs are designed to trigger. Figure 2 . Hover-for-details interaction with radar charts. A GenAI-augmented radar chart with background colour intensities on axis segments. A pop-up window appears when hovering over an axis, displaying GenAI's assessed understanding level, confidence score, and example discussion quotes as evidence. These three considerations suggest that integrating GenAI into GATs in a way that provides implicit guidance requires attending not only to what awareness information