MisVisFix: An Interactive Dashboard for Detecting, Explaining, and Correcting Misleading Visualizations using Large Language Models
\authororcid Amit Kumar Das0000-0002-2600-8321, \authororcid Klaus Mueller0000-0002-0996-8590 · 2025
Read MisVisFix: An Interactive Dashboard for Detecting, Explaining, and Correcting Misleading Visualizations using Large Language Models by \authororcid Amit Kumar Das0000-0002-2600-8321, \authororcid Klaus Mueller0000-0002-0996-8590 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04679.txt.
Introduction
Amit Kumar Das and Klaus Mueller present MisVisFix, a dashboard that finds and fixes misleading charts with help from large language models, in a 2025 paper. Bad charts can bend what readers take from data, and most earlier tools only flag the problem.
The dashboard checks a chart, explains each fault in plain words, and draws a corrected version. It sorts faults as major, minor, or possible concerns, and it caught 96 percent of chart faults in the team's tests, covering all 74 known types of chart trickery. A chat box lets users ask about a chart or ask for changes. Tests with chart experts and fact-checking tool builders found the flags accurate and the advice useful.
Catalog record
| CREATOR | \authororcid Amit Kumar Das0000-0002-2600-8321, \authororcid Klaus Mueller0000-0002-0996-8590 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-04679
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MisVisFix: An Interactive Dashboard for Detecting, Explaining, and Correcting Misleading Visualizations using Large Language Models \authororcid Amit Kumar Das0000-0002-2600-8321, \authororcid Klaus Mueller0000-0002-0996-8590 Abstract Misleading visualizations pose a significant challenge to accurate data interpretation. While recent research has explored the use of Large Language Models (LLMs) for detecting such misinformation, practical tools that also support explanation and correction remain limited. We present MisVisFix, an interactive dashboard that leverages both Claude and GPT models to support the full workflow of detecting, explaining, and correcting misleading visualizations. MisVisFix correctly identifies 96% of visualization issues and addresses all 74 known visualization misinformation types, classifying them as major, minor, or potential concerns. It provides detailed explanations, actionable suggestions, and automatically generates corrected charts. An interactive chat interface allows users to ask about specific chart elements or request modifications. The dashboard adapts to newly emerging misinformation strategies through targeted user interactions. User studies with visualization experts and developers of fact-checking tools show that MisVisFix accurately identifies issues and offers useful suggestions for improvement. By transforming LLM-based detection into an accessible, interactive platform, MisVisFix advances visualization literacy and supports more trustworthy data communication. \onlineid 0 \vgtccategory Research \vgtcpapertype please specify \authorfooter Amit Kumar Das and Klaus Mueller are with the Computer Science Department, Stony Brook University, USA (E-mails: [email protected], [email protected]). \teaser MisVisFix dashboard. Panel A displays the original misleading visualization with interactive issue localization, where hovering over identified issues highlights the corresponding problematic regions directly on the chart. Panels B and C show corrected versions generated by Claude and GPT, enabling side-by-side comparison. Panel D allows users to upload the original dataset to improve accuracy when data extraction fails. Panels E and F list detected issues from GPT and Claude, categorized by severity. Panel G contains the interactive chat, where users can request modifications and view updated visualizations. keywords Misinformation, Large Language Models, Data Extraction 1 Introduction Data visualizations are powerful tools for communicating complex information clearly and efficiently, enabling users to comprehend patterns, trends, and relationships within datasets [ 7 , 42 ] . However, misleading visualizations, whether created intentionally to deceive or inadvertently through poor design choices, can significantly distort a viewer’s perception of the underlying data [ 34 , 11 , 4 ] . These misleading representations span various techniques, from obvious manipulations like truncated axes to subtle distortions such as inappropriate encoding choices or unjustified data filtering [ 21 , 26 , 36 , 46 ] . As visualizations play an increasingly central role in data-driven decision-making, identifying and correcting misleading visualizations has become increasingly critical [ 22 , 28 , 14 , 43 ] . Recent taxonomic work by Lo et al. [ 29 ] systematically categorized 74 misleading issues that can arise in visualizations. This comprehensive framework has established a foundation for understanding how visualizations can mislead viewers. However, detecting these issues requires substantial expertise in visualization design principles and critical data thinking skills, which many consumers of data visualizations may lack [ 10 , 6 ] . This expertise gap creates a pressing need for automated systems that can assist in identifying and correcting potentially misleading visualizations. The emergence of multimodal Large Language Models (LLMs) with advanced vision capabilities presents new opportunities for addressing this challenge [ 33 , 40 ] . Recent research has shown that models like GPT-4V and Claude 3 can interpret complex visual information and reason about visualization design issues [ 12 , 44 ] . In particular, Alexander et al. [ 1 ] explored the potential of GPT-4 in detecting misleading visualizations, concluding that these models can identify misleading elements with moderate accuracy when provided with appropriate guidance. Similarly, Lo et al. [ 30 ] evaluated multiple LLMs for detecting misleading visualizations, finding significant potential but noting challenges in scaling detection capabilities across diverse issue types. While existing research demonstrates the potential of LLMs for visualization analysis, several key limitations remain [ 25 , 8 , 47 ] . First, most current approaches focus exclusively on detection without addressing the correction of problematic visualizations [ 41 , 39 , 2 ] . Second, many systems target only a subset of misleading techniques rather than comprehensively addressing the complete taxonomy of potential issues [ 38 , 15 ] . Third, limited work has been conducted on creating interactive, user-facing systems that effectively communicate identified issues and recommend improvements [ 13 , 16 ] . These limitations present critical research opportunities for developing integrated systems that leverage the capabilities of LLMs across the complete pipeline of misleading visualization analysis. Building on these identified gaps, we aim to address the following two key questions: • RQ1: How can multimodal LLMs be effectively leveraged to detect and explain the full spectrum of misleading visualization techniques identified in existing taxonomies? • RQ2: To what extent can an interactive system facilitate both identification and correction of misleading visualizations, bridging the gap from detection and visualization best practices? To address these research questions, we present MisVisFix, an interactive dashboard for detecting, explaining, and correcting misleading visualizations. Our work makes five primary contributions: • We developed and implemented MisVisFix, an end-to-end interactive dashboard that integrates LLM capabilities to detect, explain, and generate corrections for misleading visualizations. • We conducted a comprehensive evaluation of multimodal LLM performance across all 74 categories of visualization misinformation, demonstrating that our approach achieves an F1 score of 0.96 in issue detection. • We created novel techniques for visually annotating misleading elements directly on visualizations with precise x-y positioning, enabling an intuitive understanding of problematic areas. • We designed and implemented an interactive learning mechanism that continuously improves the system based on user feedback, allowing MisVisFix to adapt. • We validated the system’s effectiveness through rigorous user evaluation with visualization experts and developers of fact-checking tools, confirming MisVisFix’s accuracy, usefulness, and applicability in both professional and educational contexts. Our paper is organized as follows. Section 2 presents related work. Section 3 describe the system design. Section 4 offers a system evaluation. Sections 5 and 6 end the paper with a discussion and conclusions. 2 Related Work Our research intersects several fields, including misleading visualization detection, visualization linters, chart analysis, and applications of large language models (LLMs) in visualization understanding. We review key developments in these areas to position our contributions within the broader research landscape 2.1 Misleading Visualizations The study of misleading visualizations dates back decades, with foundational work by Huff [ 18 ] and Tufte [ 42 ] establishing core principles of graphical integrity. Huff’s seminal text "How to Lie with Statistics" first exposed common deceptive practices in data representation, while Tufte introduced the concepts of "chartjunk" and "lie factor" to quantify visualization distortion. These early frameworks laid the groundwork for understanding how visual representations can manipulate viewer perception. Recent empirical studies have advanced our understanding of how specific design choices impact interpretation. Pandey et al. [ 34 ] systematically evaluated how visualization manipulations affect a viewer’s perceptions, demonstrating that even subtle design choices like truncated axes significantly alter data interpretation. Correll et al. [ 11 ] examined y-axis truncation, revealing that this common practice systematically distorts the perception of data magnitudes. Additional research by Lee et al. [ 22 ] and Lisnic et al. [ 28 ]