Interactivity x Explainability: Toward Understanding How Interactivity Can Improve Computer Vision Explanations
Indu Panigrahi, Sunnie S. Y. Kim, Amna Liaqat, Rohan Jinturkar, Olga Russakovsky, Ruth Fong, Parastoo Abtahi · 2025
Read Interactivity x Explainability: Toward Understanding How Interactivity Can Improve Computer Vision Explanations by Indu Panigrahi, Sunnie S. Y. Kim, Amna Liaqat, Rohan Jinturkar, Olga Russakovsky, Ruth Fong, Parastoo Abtahi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10745.txt.
Introduction
Indu Panigrahi and six co-authors study how letting users play with the notes that explain a vision model's choice can help them grasp that choice. Their paper is from two thousand twenty-five.
Such notes are most often shown in fixed form. Fixed notes can swamp users, mix word sense with pixel facts, and give no room to roam. The team tested three note types: heat maps, trait-based notes, and case-based notes. Twenty-four people did a bird-naming task, with varied skill in tech and in birds. Hands-on notes gave users more grip, sped the path to the key facts, and let them grow their grasp. But they also brought new costs.
Catalog record
| CREATOR | Indu Panigrahi, Sunnie S. Y. Kim, Amna Liaqat, Rohan Jinturkar, Olga Russakovsky, Ruth Fong, Parastoo Abtahi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-10745
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Interactivity x Explainability: Toward Understanding How Interactivity Can Improve Computer Vision Explanations Indu Panigrahi, Sunnie S. Y. Kim, Amna Liaqat, Rohan Jinturkar, Olga Russakovsky, Ruth Fong, Parastoo Abtahi Abstract . Explanations for computer vision models are important tools for interpreting how the underlying models work. However, they are often presented in static formats, which pose challenges for users, including information overload, a gap between semantic and pixel-level information, and limited opportunities for exploration. We investigate interactivity as a mechanism for tackling these issues in three common explanation types: heatmap-based, concept-based, and prototype-based explanations. We conducted a study (N=24), using a bird identification task, involving participants with diverse technical and domain expertise. We found that while interactivity enhances user control, facilitates rapid convergence to relevant information, and allows users to expand their understanding of the model and explanation, it also introduces new challenges. To address these, we provide design recommendations for interactive computer vision explanations, including carefully selected default views, independent input controls, and constrained output spaces. Conference: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA ’25), April 26-May 1, 2025, Yokohama, Japan DOI: 10.1145/3706599.3719730 ISBN: 979-8-4007-1395-8/2025/04 CCS: Human-centered computing Empirical studies in HCI CCS: Computing methodologies Computer vision 1. Introduction AI explanations help users understand and diagnose complex AI models, such as modern computer vision (CV) models processing thousands of pixels ( Adadi and Berrada, 2018 ; Barredo Arrieta et al., 2020 ) . While the explainable AI (XAI) community has developed many explanation methods, they often present information in a static form which can be challenging for users to interpret ( Kriglstein et al., 2014 ; Xia and Wilson, 2018 ; Blignaut, 2010 ; Kim et al., 2023a ; Ramaswamy et al., 2023 ; Kim et al., 2016 ) . Moreover, a single static explanation cannot meet the diverse needs of users with varying expertise ( Liao et al., 2020 ) . Most XAI methods produce static CV explanations ( Selvaraju et al., 2017 ; Ribeiro et al., 2016 ; Petsiuk et al., 2018 ; Fong and Vedaldi, 2017 ; Brendel and Bethge, 2019 ; Simonyan et al., 2014 ; Shitole et al., 2021 ; Zeiler and Fergus, 2014 ; Zhou et al., 2016 ; Koh et al., 2020 ; Ramaswamy et al., 2022 ; Shukla et al., 2023 ; Zhou et al., 2018 ; Chen et al., 2019 ) . However, recent studies have identified several challenges with static explanations ( Kim et al., 2023a ; Kriglstein et al., 2014 ; Xia and Wilson, 2018 ; Blignaut, 2010 ; Ramaswamy et al., 2023 ; Kim et al., 2016 ) which we categorize into three groups: (1) Information overload : Users feel that there is too much information to process at once ( Kriglstein et al., 2014 ; Xia and Wilson, 2018 ; Blignaut, 2010 ; Kim et al., 2023a ; Ramaswamy et al., 2023 ; Kim et al., 2016 ) . (2) Semantic-pixel gap : Users find it difficult to connect image pixels to objects, attributes, and abstract concepts ( Ramaswamy et al., 2023 ; Kim et al., 2023a ; Blignaut, 2010 ) . (3) Limited exploration : Users lack the necessary tools to probe the explanation to deepen their understanding ( Kim et al., 2023a ) . Prior work in Information Visualization has shown that interacting with data helps with interpretation ( Keim, 2002 ; Kim et al., 2017 ; Yi et al., 2007 ; Hohman et al., 2019 ) , and consequently, several works have called for interactivity in XAI applications ( Kulesza et al., 2015 ; Sundar et al., 2012 ; Sundar et al., 2010 ; Nguyen et al., 2024 ; Slack et al., 2023 ; Hohman et al., 2019 ) . However, interactivity has mostly been explored at the dataset level ( Yi et al., 2007 ; Boggust et al., 2022 ; Hohman et al., 2019 ; Fogarty et al., 2008 ; Bäuerle et al., 2022 ; Wang et al., 2023 ; Dudley and Kristensson, 2018 ) , for visualizing model weights ( Wang et al., 2021 ; Chang et al., 2016 ; Kapoor et al., 2010 ; Hohman et al., 2020 ; Dudley and Kristensson, 2018 ) , and for non-visual data ( Liu et al., 2021 ; Slack et al., 2023 ; Bhattacharya et al., 2023 ; Bhattacharya et al., 2024 ) . In this work, we explore interactivity at the explanation level for images. Specifically, we investigate two research questions: RQ1 : How do end-users leverage interactivity to help understand information conveyed by CV explanations? RQ2 : How do end-users perceive interactive CV explanations ? To answer these questions, we conducted a within-subjects study using explanations for a bird identification model ( Wah et al., 2011 ) . We selected bird identification over common object or scene classification use cases ( Zhou et al., 2017 ; Deng et al., 2009 ) to examine the effects of domain knowledge. We focused on three widely used explanation types (heatmap-based, concept-based, and prototype-based explanations) and investigated three interactive mechanisms: Filtering to control the amount of information, Overlays to connect pixel-level landmarks to semantic labels, and Counterfactuals to allow users to edit images and observe a change in the explanation. We recruited 24 participants with varying levels of machine learning (ML) and birding expertise for an \sim 90 -minute study. Each participant completed a set of tasks, alongside a questionnaire and interview. We found that interactivity addresses some limitations of static CV explanations by providing users with tools to bridge the semantic-pixel gap, rapidly pinpoint the information they seek, explore the CV model beyond the immediate task, and gain clarity around the presentation of the static explanation. However, some interactive mechanisms were at times overwhelming for users and introduced new challenges, which informed the design recommendations we present in this paper. Our exploration and study findings contribute to our understanding of interactive mechanisms for XAI and bring us closer to the design of effective interactive CV explanations. 2. Related Work Given the increasing ubiquity of AI ( Singhal et al., 2023 ; Ma et al., 2024 ; Huang et al., 2023 ; Janai et al., 2020 ; Michielssen et al., 2024 ) , there exists a growing need for end-users to understand a model’s behavior so they can appropriately trust and use the model. To address this need, many XAI methods have been developed over the past decade across various subfields of AI, including CV and robotics ( Lundberg and Lee, 2017 ; Danilevsky et al., 2020 ; Ribeiro et al., 2016 ; Milani et al., 2024 ; Qian et al., 2021 ) , and across different domains, such as healthcare and climate science ( DeGrave et al., 2023 ; Antoniadi et al., 2021 ; Lötsch et al., 2022 ; Singh et al., 2020 ; Smith, 2021 ; Atakishiyev et al., 2021 ; Meteier et al., 2019 ; Machlev et al., 2022 ; Mamalakis et al., 2022 ) . Historically, much work has focused on developing methods to explain a model’s outputs (i.e., generating an answer for “why did the model