Towards Personalized Explanations for Health Simulations: A Mixed-Methods Framework for Stakeholder-Centric Summarization
Philippe J. Giabbanelli, Ameeta Agrawal · 2025
Read Towards Personalized Explanations for Health Simulations: A Mixed-Methods Framework for Stakeholder-Centric Summarization by Philippe J. Giabbanelli, Ameeta Agrawal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-04646.txt.
Introduction
Health simulations can inform policy, yet their complexity often shuts out the people they should help. Philippe J. Giabbanelli and one co-author address that gap in a 2025 mixed-methods paper on personalised explanations. Stakeholders include clinicians, policymakers, patients, caregivers, and health advocates, each with different needs.
The authors present a step-by-step framework to identify what each group needs from an explanation. The framework then guides large language models in producing tailored summaries of simulation outputs and model design. Their aim is to replace one-size-fits-all summaries with explanations matched to audience and purpose.
Catalog record
| CREATOR | Philippe J. Giabbanelli, Ameeta Agrawal |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-04646
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Personalized Explanations for Health Simulations: A Mixed-Methods Framework for Stakeholder-Centric Summarization Philippe J. Giabbanelli, Ameeta Agrawal Abstract Modeling & Simulation (M&S) approaches such as agent-based models hold significant potential to support decision-making activities in health, with recent examples including the adoption of vaccines, and a vast literature on healthy eating behaviors and physical activity behaviors. These models are potentially usable by different stakeholder groups, as they support policy-makers to estimate the consequences of potential interventions and they can guide individuals in making healthy choices in complex environments. However, this potential may not be fully realized because of the models’ complexity, which makes them inaccessible to the stakeholders who could benefit the most. While Large Language Models (LLMs) can translate simulation outputs and the design of models into text, current approaches typically rely on one-size-fits-all summaries that fail to reflect the varied informational needs and stylistic preferences of clinicians, policymakers, patients, caregivers, and health advocates. This limitation stems from a fundamental gap: we lack a systematic understanding of what these stakeholders need from explanations and how to tailor them accordingly. To address this gap, we present a step-by-step framework to identify stakeholder needs and guide LLMs in generating tailored explanations of health simulations. Our procedure uses a mixed-methods design by first eliciting the explanation needs and stylistic preferences of diverse health stakeholders, then optimizing the ability of LLMs to generate tailored outputs (e.g., via controllable attribute tuning), and then evaluating through a comprehensive range of metrics to further improve the tailored generation of summaries. Introduction Simulation models have been developed for many health application scenarios, such as finding the right treatment for depression given a patient ’s characteristics ( Wittenborn and Hosseinichimeh 2022 ) , supporting policymakers in identifying efficient campaigns to promote healthy eating and reduce hypertension ( Khademi et al. 2018 ) , or optimizing the layout of a hospital ( Dos Santos et al. 2025 ) . These models can be complex: for example, the hypertension model accounts for the structure of social networks and the diffusion of social norms, as well as individual taste preferences and the eventual impact of food consumption patterns onto health outcomes. This complexity may create barriers to participation in the modeling process for non-modelers, particularly compounded with recurring issues related to model communication and low levels of traceability ( Belfrage et al. 2024 ) . These challenges may partly explain recent evidence from the literature on human-centered computing in which participants were primarily engaged in the early stage of model building but insufficiently as development progressed ( Manellanga and David 2024 ) . We consider that such lack of participation is a missed opportunity for validation (e.g., community members could compare the simulated journeys of agents to their own experiences) and can reduce buy-in. Ahrweiler et al. 2019 emphasized the importance of trust for buy-in: “the first and most important is that the clients want to understand the model[:] to trust results means to trust the process that produced them.” Given (i) the significant efforts devoted to building models and their demonstrated relevance for decision-making in the context of health and (ii) the challenges of engaging participants into the process to ensure the accuracy of findings and their translation into practices, many studies have proposed and evaluated means of engaging participants into the modeling process. Methods can vary based on criteria such as the targeted degree of participation, which ranges from providing information to co-deciding ( Ferrand, Hassenforder, and Girard 2024 ) . We focus on the dissemination of results , which is located as a low degree of participation. Figure 1: A model consists of elements and interrelationships from the problem domain, exemplified here as suicide prevention. The model can be programmed and then used for computational experiments, leading into simulation outcomes that can be differentiated by target populations. Our focus is on explaining models and simulations in a tailored manner (here for a lay audience) instead of the dominant and generic model-to-text translation via LLMs. This is more scalable than human facilitation. As empirical studies on information dissemination and simulations have demonstrated, participants did not “want to look at a multitude of tables and scan through simulation results for interesting parameters; nor did they expect to watch the running model producing its results” ( Ahrweiler et al. 2019 ) (Fig. 1 ). Researchers have co-developed interactive visualization environments with practitioners to explore models ( Kammler et al. 2023 ) , as exemplified by our work on policy-making and obesity in which policymakers could find key constructs and interrelationships in the model ( Giabbanelli and Baniukiewicz 2018 ) . However, ensuing usability studies showed that such platforms had a problematic learning curve or took too long to perform simple tasks ( Giabbanelli and Vesuvala 2023 ) . As a result, computational solutions to promote engagement with simulation models (particularly to explain a system) belong to two broad categories. First, there are platforms that are intended to facilitate engagement, typically within a workshop setting with a trained facilitator. Fora.ai allows participants to express the outcomes that they wish to see from the simulations (i.e., their ‘concerns’) and the results are primarily communicated on a map, given the platform’s emphasis on environmental problems such as flooding ( Zellner et al. 2025 ) . MentalModeler supports participants in externalizing their mental models as Fuzzy Cognitive Map (visualized as node-and-link diagrams) and to see simulation outcomes in easily interpretable visuals showing which factors would increase or decrease ( Gray et al. 2013 ) . This tool has been used for over a decade, and the participatory technique of Fuzzy Cognitive Mapping has been abundantly used in health ( Sarmiento et al. 2024 ) and medicine ( Apostolopoulos et al. 2024 ) . However, trained facilitators are not always available, so this approach is more appropriate for workshop settings where a small number of participants can be guided to learn new approaches than for large-scale deployment in which participants should independently access information. This scaling limitation echoes concerns on technology exclusion about who will be granted the benefits of new platforms for decision-making ( Ahrweiler et al. 2025 ) . In contrast, the second approach uses technology to explain simulation results in familiar formats that people can interpret independently , which is the focus of this paper. This approach does not have facilitators and does not currently solicit feedback, unlike the platforms mentioned above. Rather, the focus is solely on information dissemination. Large Language Models (LLMs) are prominent in this space, as they can transform data into textual summaries (Fig. 1 , grey boxes). LLMs and their uses have evolved rapidly to explain health simulations, starting the first work in 2022 that explained obesity and suicide models via GPT-3 ( Shrestha et al. 2022 ) . The focus was on decomposing large models so they could be ‘fed’ to GPT one piece at a time, leading to a focus on sentence-level generation. This early prototype suffered from both the fluency issues of GPT-3 (e.g., typos, grammatical mistakes) and the limitations of lossy decomposition algorithms, which removed some of the model’s aspect. Progress on LLMs resulted in high fluency, coverage, and faithfulness scores, while advances in