Enhancing XAI Interpretation through a Reverse Mapping from Insights to Visualizations

Aniket Nuthalapati University of Minnesota, Nicholas Hinds University of Minnesota, Brian Y. Lim National University of Singapore, Qianwen Wang University of Minnesota · 2025

Read Enhancing XAI Interpretation through a Reverse Mapping from Insights to Visualizations by Aniket Nuthalapati University of Minnesota, Nicholas Hinds University of Minnesota, Brian Y. Lim National University of Singapore, Qianwen Wang University of Minnesota (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-18640.txt.

Introduction

Aniket Nuthalapati, Nicholas Hinds, Brian Y Lim, and Qianwen Wang add a reverse step to how users read AI explanations. Their paper is from two thousand twenty-five. In high-stakes work, users must grasp why a model acts as it does. Explanations are given, but users often fail to reason well with them, so they can neither check nor learn from the model.

Their plan takes a user's own free-word read of a chart and turns it back into marks on that chart. A large model pulls set claims from the words, and linked views place them in view. The loop is meant to slow users down and make them weigh the proof. A test build and user views show the route.

Catalog record

CREATORAniket Nuthalapati University of Minnesota, Nicholas Hinds University of Minnesota, Brian Y. Lim National University of Singapore, Qianwen Wang University of Minnesota
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-18640

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing XAI Interpretation through a Reverse Mapping from Insights to Visualizations Aniket Nuthalapati University of Minnesota, Nicholas Hinds University of Minnesota, Brian Y. Lim National University of Singapore, Qianwen Wang University of Minnesota Abstract As AI systems become increasingly integrated into high-stakes domains, enabling users to accurately interpret model behavior is critical. While AI explanations can be provided, users often struggle to reason effectively with these explanations, limiting their ability to validate or learn from AI decisions. To address this gap, we introduce Reverse Mapping , a novel approach that enhances visual explanations by incorporating user-derived insights back into the explanation workflow. Our system extracts structured insights from free-form user interpretations using a large language model and maps them back onto visual explanations through interactive annotations and coordinated multi-view visualizations. Inspired by the verification loop in the visualization knowledge generation model, this design aims to foster more deliberate, reflective interaction with AI explanations. We demonstrate our approach in a prototype system with two use cases and qualitative user feedback. \onlineid 1124 \vgtccategory Research \vgtcinsertpkg \teaser Reverse Mapping to enhance the interpretation of AI explanations. (A) Traditional XAI workflows rely on users to interpret visual explanations and derive insights, often leading to misinterpretation or over-trust. We propose a Reverse Mapping paradigm that closes the loop by integrating user-generated insights back into the visual explanation process. (B1) Original XAI visualizations show feature attributions but may not support nuanced interpretation. (B2) Users express free-form insights which are automatically parsed into structured representations. (B3) These structured insights are used to enhance the original visualizations with interaction annotations and additional visualizations. keywords XAI Visualization, reverse mapping, insight verification, explainable AI. 1 Introduction As AI becomes ubiquitous across domains, understanding AI is crucial for establishing appropriate trust, especially in high-stakes areas like healthcare [ 23 ] . Beyond this, given the vast knowledge encoded within AI models, interpreting these systems holds the promise of uncovering insights beyond current human understanding. The field of Explainable AI (XAI) has expanded rapidly in response to growing demands for AI transparency. Prior research has demonstrated the potential benefits of XAI, such as identifying subpopulations with shared mortality risks despite divergent feature values [ 12 ] and uncovering novel features associated with early stages of disease not previously noted by human clinicians [ 20 ] . However, numerous user studies reveal that AI explanations often fall short, failing in tasks such as debugging AI models [ 1 ] and improving human decision-making [ 2 ] . XAI’s failure to achieve its intended purposes has been attributed largely to users’ inability to properly interpret AI explanations [ 10 , 5 ] . Users often blindly trust AI explanations, failing to critically reason with the provided explanations. Several studies have promoted more deliberate reasoning through interventions like cognitive forcing functions [ 5 ] , incremental information disclosure [ 3 ] , and gamification [ 28 ] . Comparatively little attention has been given to visualizations’ role in facilitating AI understanding, despite studies showing that users perceive, interpret, and act upon AI-generated insights differently from the visual representations of explanations [ 23 , 26 ] . \textcolor black To enable accurate XAI interpretation, this study proposes to adaptively enhance the XAI visualizations directly based on user-derived insights. This reverse mapping ( i.e. , from insights to visualizations) inverts the typical flow, where users extract insights from visualizations ( \cref fig:teaserA). Specifically, the proposed method converts free-form, unstructured text into structured insights, which are then mapped to the visual explanation, including enhancements such as interactive annotations and coordinated multi-view visualizations. \textcolor black These enhancements help users better understand XAI and verify specific insight, echoing how the knowledge validation occurs through revisiting visualizations in the visualization knowledge generation model [ 18 ] . Main contributions of this paper are: • The Reverse Mapping paradigm, which enhances users’ interpretation of AI explanations by mapping user-derived insights back onto visual explanations. • A prototype tool implementing the Reverse Mapping paradigm through LLM-powered structured insight extraction, interactive annotations, and coordinated multi-view visualizations. • Initial evidence that demonstrates the usability and effectiveness of Reverse Mapping via use cases and qualitative user feedback. 2 Related Studies Visualizations have been widely established as an effective medium for communicating AI explanations [ 9 , 29 ] due to their capacity to represent complex information in accessible formats. Popular XAI libraries such as SHAP [ 12 ] and DICE [ 15 ] have all incorporated visualization support as core components, enabling AI researchers and practitioners to generate static visual representations of computational explanations. \textcolor blackSuch tools have been incorporated into many interactive systems that help users understand AI explanations. These visualization systems have demonstrated effectiveness across diverse tasks, including data augmentation and cleaning [ 8 , 27 ] , model debugging [ 7 ] , and model comparison and selection [ 24 , 25 ] . The interactive nature of these tools enhances users’ abilities to explore and understand AI systems beyond the limitations of static visualizations. As technical advances in XAI visualization have progressed, researchers have increasingly adopted user-centered perspectives, recognizing that technical sophistication alone is insufficient for effective explanations. Studies reveal concerning patterns where XAI visualizations can inadvertently encourage blind trust rather than critical analytical reasoning [ 10 , 2 ] . This insight has prompted researchers to incorporate user needs and tasks into XAI visualization tool development [ 14 , 23 ] . These studies contribute novel visualization designs and coordinated views to help domain users understand complicated data and generate meaningful insights. For example, Wang et al. [ 23 ] found that visualizing paths for explaining AI explanations on drug repurposing significantly improved users’ decision-making performance compared with other explanation visualizations. However, these approaches have predominantly focused on designing optimized visualizations for predefined analytical tasks rather than using visualizations as dynamic mechanisms to actively mitigate incorrect interpretations of XAI outputs. To address concerns about improper usage of explanation visualizations, researchers have proposed various intervention methods [ 5 , 3 , 6 ] . For example, Buccinca et al. [ 6 ] demonstrated that constrasting AI recommendations with predicted human choices significantly enhanced independent decision-making compared to unilateral explanations. While these interventions show promise, existing research has overlooked the potential for direct and dynamic modification of explanation visualizations to address misinterpretation. This gap represents our primary focus: exploring how adaptive visualization techniques can actively mitigate misunderstandings in explanations. 3 The Gaps between Explanation Visualizations and Insights The transition from visual representation to meaningful insight presents significant challenges in AI explanation interpretation, with three critical gaps. First, low visualization literacy \textcolor black(Gap1) creates fundamental barriers when users fail to correctly identify and decode visual elements [ 10 ] . This manifests when users misattribute meaning to incorrect visual channels, e.g. , attempting to extract feature values from axis position when this information is encoded through color. Such misinterpretations lead to fundamentally flawed conclusions about the underlying AI behavior. Second, ineffective visualization \textcolor black(Gap2) selection often occurs when the chosen visual representation is not suited for extracting specific types of insights. Even with accurate interpretation of visual elements, the visualization format itself may make certain insights difficult or impossible to discern. Third, ambiguous,

Read the complete text