Rethinking Health Agents: From Siloed AI to Collaborative Decision Mediators Conference: CHI ’26 Workshop on Human-Agent Collaboration; April 2026; Barcelona, Spain CHI ’26 Workshop on Human-Agent Collaboration, April, 2026, Barcelona, Spain CCS: Computing methodologies Artificial intelligence CCS: Human-centered computing Human computer interaction (HCI)
Ray-Yuan Chung, Xuhai “Orson” Xu, Ari Pollack · 2026
Read Rethinking Health Agents: From Siloed AI to Collaborative Decision Mediators Conference: CHI ’26 Workshop on Human-Agent Collaboration; April 2026; Barcelona, Spain CHI ’26 Workshop on Human-Agent Collaboration, April, 2026, Barcelona, Spain CCS: Computing methodologies Artificial intelligence CCS: Human-centered computing Human computer interaction (HCI) by Ray-Yuan Chung, Xuhai “Orson” Xu, Ari Pollack (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24986.txt.
Introduction
Chung, Xu, and Pollack argue that health AI should help a whole care team, not one user alone. Most tools serve a patient, a caregiver, or a clinician in isolation. That split view can hide facts and pull goals apart. The authors use a made-up but expert-checked case of a child with kidney disease. In it, missed doses trace back to poor shared awareness, not missing facts. They sketch design rules for AI that shares context and aligns goals while people keep final say.
Catalog record
| CREATOR | Ray-Yuan Chung, Xuhai “Orson” Xu, Ari Pollack |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14533 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.24986
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Rethinking Health Agents: From Siloed AI to Collaborative Decision Mediators Conference: CHI ’26 Workshop on Human-Agent Collaboration; April 2026; Barcelona, Spain CHI ’26 Workshop on Human-Agent Collaboration, April, 2026, Barcelona, Spain CCS: Computing methodologies Artificial intelligence CCS: Human-centered computing Human computer interaction (HCI) Ray-Yuan Chung, Xuhai “Orson” Xu, Ari Pollack Abstract . Large language model (LLM)–based health agents are increasingly used by health consumers and clinicians to interpret health information and guide health decisions. However, most AI systems in healthcare operate in siloed configurations, supporting individual users rather than the multi-stakeholder relationships central to healthcare. Such use can fragment understanding and exacerbate misalignment among patients, caregivers, and clinicians. We reframe AI not as a standalone assistant, but as a collaborator embedded within multi-party care interactions. Through a clinically validated fictional pediatric chronic kidney disease case study, we show that breakdowns in adherence stem from fragmented situational awareness and misaligned goals, and that siloed use of general-purpose AI tools does little to address these collaboration gaps. We propose a conceptual framework for designing AI collaborators that surface contextual information, reconcile mental models, and scaffold shared understanding while preserving human decision authority. 1. Introduction The rapid development of artificial intelligence (AI) has transformed how health consumers and clinicians access and interpret health information. Large language model (LLM)–based systems are increasingly used by consumers to seek medical advice and interpret symptoms ( 20 ; 13 ) , while generative AI tools such as OpenEvidence support clinicians in summarizing literature and assisting with diagnostic reasoning ( 9 ) . As we move toward the era of personal health agents ( 7 ) , AI is becoming embedded in everyday health decision-making. Despite advances in AI capabilities, current systems are largely designed for individual use and are not structured to support the multi-stakeholder interactions that characterize most clinical care. This parallel, siloed adoption raises important concerns: over-reliance on conversational agents may reduce critical evaluation of health information, particularly when responses are presented with high confidence, and clinicians have expressed concerns about accuracy, provenance, and accountability when such tools are used to search for or validate health-related information ( 1 ) . Although prior work has explored AI systems that support multiple users ( 16 ; 19 ) in healthcare, these systems primarily facilitate information exchange rather than collaborative decision-making. For example, Talk2Care collects health information from older adults at home and transmits it to healthcare providers for clinical decision-making ( 19 ) . Similarly, the ARCH chatbot gathers information from children and shares it with parents and providers ( 16 ) . In these systems, AI primarily functions as an information conduit—collecting data from one party and passing it to another—without mediating perspectives, clarifying misunderstandings, or scaffolding shared reasoning across decision-makers. As a result, decision-making may still suffer from fragmented understanding, misaligned expectations, or invisible tensions among stakeholders. To address these limitations, we propose an AI collaborator framework designed to participate in and support multi-party healthcare decision-making, rather than serving a single end user (Figure 1 ). Building on prior multi-user systems, we move beyond information transmission toward supporting collaborative decision-making. In our conceptualization, the AI collaborator is embedded within triadic (or multi-party) care interactions and is designed to: • Surface and contextualize relevant information among stakeholders, highlighting critical discrepancies, and information gaps. • Identify and reconcile differing mental models, assumptions, or priorities among decision-makers. • Scaffold shared understanding and coordinated reasoning processes to anticipate potential outcomes and implications of different decisions, while preserving human decision authority. This shift in the role of AI raises critical design questions: What level of autonomy should such an AI possess? How should responsibility and accountability be distributed across stakeholders? And how can AI systems strengthen—rather than erode—professional judgment and patient autonomy? To illustrate both the limitations of current healthcare interactions and the opportunities for AI-mediated collaboration, we present a fictional pediatric case study. This case highlights common barriers in today’s care models, including fragmented communication, mismatched expectations, incomplete contextual knowledge, and asymmetries in expertise. We then demonstrate how a deliberately designed AI collaborator could intervene—not as a decision-maker, but as a mediator that aligns stakeholders, clarifies trade-offs, and supports shared understanding. Through this conceptual and design exploration, we articulate principles for building AI collaborators as a carefully bounded participant in collaborative care. Figure 1 . Proposed diagram comparing siloed AI use with an embedded AI collaborator in multi-stakeholder care. A side-by-side conceptual diagram of AI-agent collaboration. The left panel shows siloed use of AI chatbots by health consumers outside the clinic, highlighting issues such as over-reliance, distrust, and misaligned understanding between patients and clinicians. The right panel shows an AI collaborator positioned between health consumers and clinicians, with arrows indicating bidirectional communication and support for continuous care outside the clinic and improved collaboration during clinical visits. 2. Design Scenario: A Pediatric Chronic Kidney Disease Case Study 2.1. Case Description Here, we present a fictional chronic kidney disease case study, validated by a pediatric nephrologist and a registered dietitian to ensure clinical relevance and ecological validity: Alex, a 16-year-old high school student, was diagnosed with chronic kidney disease. During a clinic visit, the healthcare team explains that although Alex feels well, his blood pressure is elevated and dietary sodium intake must be reduced to protect kidney function. A strict low-sodium diet, daily medication, and regular monitoring are recommended. The teenager and his parent agree without raising concerns, trusting the clinician’s expertise and assuming that strict adherence is the only responsible course of action. In the following weeks, dietary changes become the primary source of strain. At home, meals are carefully prepared to reduce sodium, but at school Alex struggles to avoid cafeteria food and snacks shared with friends. Reading nutrition labels feels tedious, and declining food in social settings feels isolating. In an effort to help, the parent turns to a general-purpose AI chatbot for low-sodium meal plans. While the system generates structured recommendations, the suggestions are generic and insufficiently tailored to the family’s cultural food preferences, budget constraints, and school schedule. As a result, many proposed meals feel impractical or unfamiliar. Small exceptions begin to accumulate—chips after practice, fast food with classmates—while these lapses are minimized at home. Tension grows as the parent reinforces the diet, and Alex becomes increasingly frustrated. By the next clinic visit, adherence has been inconsistent. 2.2. Collaborative Decision-making Needs Healthcare decision-making has shifted from a clinician-driven model toward a collaborative approach that encourages greater patient participation ( 4 ) . In pediatric chronic care, collaboration is critical because youth patients, caregivers, and clinicians must jointly navigate ongoing treatment decisions, yet such collaboration is often difficult due to their divergent goals, roles, and constraints ( 11 ) . In the chronic kidney disease case, the clinician prioritizes long-term risk reduction, the parent emphasizes compliance and safety, and the teenager values normalcy and autonomy. These differing priorities remain implicit during the visit and later surface as non-adherence to clinician recommendations and tension. Although the treatment plan is clinically appropriate, the breakdown still occurs due to misaligned goals and the absence of shared understanding of trade-offs and contextual constraints. To conceptualize this challenge, we draw on Endsley’s team situational awareness (SA) framework ( 5 ) .