HistoLens: An Interactive XAI Toolkit for Verifying and Mitigating Flaws in Vision-Language Models for Histopathology DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; Dec 17–20, 2025; Pune, India Proceedings of the 12th ACM IKDD Co

Vissapragada Sandeep, Vikrant Sahu, Dr. Gagan Raj Gupta, Dr. Vandita Singh · 2025

Read HistoLens: An Interactive XAI Toolkit for Verifying and Mitigating Flaws in Vision-Language Models for Histopathology DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; Dec 17–20, 2025; Pune, India Proceedings of the 12th ACM IKDD Co by Vissapragada Sandeep, Vikrant Sahu, Dr. Gagan Raj Gupta, Dr. Vandita Singh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24115.txt.

Introduction

Sandeep Vissapragada and three co-authors built HistoLens, an interactive tool to help doctors check vision language models on tissue slides. For doctors to trust such a model, they need to see why it gave an answer, much like asking a trainee to explain. A black box answer is not enough in pathology, where errors carry real risk.

With HistoLens, a pathologist asks a question in plain English and gets a structured report back. The doctor can then ask why, and the tool shows a heat map over the exact cells and regions the model used. The system is also taught to ignore background and focus only on the patient's tissue, as a trained pathologist would.

Catalog record

CREATORVissapragada Sandeep, Vikrant Sahu, Dr. Gagan Raj Gupta, Dr. Vandita Singh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-24115

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HistoLens: An Interactive XAI Toolkit for Verifying and Mitigating Flaws in Vision-Language Models for Histopathology DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; Dec 17–20, 2025; Pune, India Proceedings of the 12th ACM IKDD Conference on Data Science ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Health care information systems CCS: Human-centered computing Human computer interaction Vissapragada Sandeep, Vikrant Sahu, Dr. Gagan Raj Gupta, Dr. Vandita Singh Abstract . For doctors to truly trust artificial intelligence, it can’t be a black box. They need to understand its reasoning, almost as if they were consulting a colleague. We created HistoLens 1 1 1 The source code for HistoLens is available at: https://github.com/Sandeep-4469/HistoLens to be that transparent, collaborative partner. It allows a pathologist to simply ask a question in plain English about a tissue slide—just as they would ask a trainee. Our system intelligently translates this question into a precise query for its AI engine, which then provides a clear, structured report. But it doesn’t stop there. If a doctor ever asks, “Why?”, HistoLens can instantly provide a ‘visual proof’ for any finding—a heatmap that points to the exact cells and regions the AI used for its analysis. We’ve also ensured the AI focuses only on the patient’s tissue, just like a trained pathologist would, by teaching it to ignore distracting background noise. The result is a workflow where the pathologist remains the expert in charge, using a trustworthy AI assistant to verify their insights and make faster, more confident diagnoses. 1. Introduction The growing adoption of Vision-Language Models (VLMs) in clinical workflows promises to revolutionize histopathology by automating complex diagnostic tasks ( Hartsock and Rasool 2024 ; Lu et al. 2024 ) . However, this powerful technology faces two critical barriers that prevent its widespread adoption. The first is a profound **trust gap**: most VLMs operate as “black-box” systems, delivering a final report with little insight into their reasoning. This opacity is clinically untenable, as a pathologist cannot be expected to take professional responsibility for a diagnostic score without understanding the underlying visual evidence. The second is a **prompting gap**: these advanced models often require precisely formatted prompts, a technical hurdle that distances the clinical expert from the AI tool and hinders seamless integration into the diagnostic workflow. The severity of this trust gap becomes clear when considering high-stakes clinical applications. In modern oncology, the quantitative analysis of immunohistochemical (IHC) markers is essential for patient care. For instance, the Ki-67 labeling index, a measure of cellular proliferation, is critical for tumor grading and prognosis. Similarly, scoring the expression of PD-L1, an immune checkpoint protein, is vital for guiding life-saving immunotherapy decisions ( Binder et al. 2024 ) . An opaque AI providing a score for these markers without justification is clinically unacceptable, as even small variations in quantification can significantly alter a patient’s treatment pathway. The need for a verifiable, trustworthy, and usable AI is therefore not just a technical challenge, but a clinical necessity. To address this critical need, we present HistoLens, an intelligent framework designed to transform VLMs from opaque analytical engines into transparent, interactive partners. We bridge the trust and prompting gaps with a multi-faceted approach. The primary contributions of this work are as follows: (1) A Multi-Modal XAI Toolkit: An interactive suite that allows clinicians to visually probe any VLM finding, providing a spectrum of explainability from high-level regional "hotspots" down to the fine-grained cellular features that influenced the model’s decision. (2) A Novel Method for Mitigating Shortcut Learning: We demonstrate how the XAI toolkit can be used to diagnose critical "shortcut learning" flaws ( Geirhos et al. 2020 ) in the VLM, transforming it from a passive viewer into an active tool for AI model auditing and debugging. We introduce Region-of-Interest (ROI) In-painting as a robust technique to correct these flaws. (3) A Semantic Prompt Synthesizer: A module powered by a local Llama 3 model that translates a clinician’s natural-language query (e.g., "What is the Ki-67 index?") into the perfectly structured prompt required by the VLM, creating an intuitive conversational interface. Unlike prior XAI frameworks, HistoLens unifies prompt synthesis, shortcut mitigation, and visual explainability into a single interactive clinical workflow — enabling both transparency and control for end users. HistoLens is not merely a viewer but an essential diagnostic suite for the AI model itself, fostering the trust and collaboration necessary for the responsible integration of AI into real-world clinical practice. 2. Related Work HistoLens lies at the intersection of Vision-Language Models for medicine, Explainable AI (XAI), diagnosing model flaws like shortcut learning, and emerging approaches to Human-AI collaboration. 2.1. Vision-Language Models in Medicine Foundation models promise “generalist medical AI” ( Moor et al. 2023 ) . Vision-Language Models (VLMs), which jointly learn from images and text, are central to this effort. Architectures like LLaVA ( Liu et al. 2023 ) , combining a vision encoder with a large language model, have shown success in medical VQA and image summarization ( Hartsock and Rasool 2024 ) . In pathology, systems like PathAlign ( Ahmed et al. 2024 ) and CONCH ( Lu et al. 2024 ) demonstrate VLMs’ utility on whole slide images. MedGemma ( Google Research and Google DeepMind 2025 ) , used in our work, exemplifies this trend with strong zero-shot reasoning on medical imagery. However, most VLM research emphasizes performance while overlooking transparency and verifiability in clinical practice ( nauman2025pathvlm ) . HistoLens directly addresses this gap by making reasoning interpretable and auditable. 2.2. Explainable AI for Medical Vision The opacity of deep learning has driven extensive work in XAI. Heatmap-based methods like CAM ( Zhou et al. 2016 ) and Grad-CAM ( Selvaraju et al. 2017 ) remain standard. Extensions such as Grad-CAM++ ( Chattopadhyay et al. 2018 ) and HiResCAM ( Draelos and Carin 2020 ) improve localization and resolution, while pixel-level methods like Guided Backpropagation ( Springenberg et al. 2014 ) capture fine-grained cues. Rather than treating these approaches as interchangeable, HistoLens integrates them into a multi-modal toolkit, enabling users to move from regional to pixel-level explanations in one interactive workflow. 2.3. Diagnosing and Mitigating Model Flaws AI models often exploit spurious correlations—shortcut learning—rather than true medical concepts ( Geirhos et al. 2020 ; Ye et al. 2024 ) . This poses critical risks when models rely on artifacts like slide borders or scanner text ( Boland et al. 2024 ; MacDonald et al. 2024 ) . While prior work documents these flaws, few tools let clinicians uncover and correct them in practice ( Dhahri et al. 2024 ) . HistoLens introduces ROI In-painting, a domain-specific intervention that replaces distracting background with a neutral fill, reducing shortcut signals. Related to masking and inpainting approaches in medical imaging ( Jin et al. 2024 ; Wang et al. 2024 ; Silva et al. 2020 ) , our method is explicitly designed for interactive, expert-driven debugging. 3. Approach HistoLens system is architected as a modular, multi-stage pipeline designed to create a seamless workflow from a clinician’s initial query to a fully verifiable, AI-generated analysis. The framework integrates three core pillars: a Semantic Prompt Synthesizer, a VLM Analysis Core, and a Multi-Modal XAI Engine, as depicted in Figure 1

Read the complete text