ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation

Jesus-German Ortiz-Barajas, Jonathan Tonglet, Vivek Gupta, Iryna Gurevych · 2026

Read ChartAttack: Testing the Vulnerability of LLMs to Malicious Prompting in Chart Generation by Jesus-German Ortiz-Barajas, Jonathan Tonglet, Vivek Gupta, Iryna Gurevych (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12983.txt.

Description

Jesus-German Ortiz-Barajas, Jonathan Tonglet, Vivek Gupta, and Iryna Gurevych test how language models can be misused to make misleading charts. Multimodal models now automate chart generation from data tables. That enables efficient analysis and reporting at scale. It also introduces new misuse risks, since a chart can lie while its data stay true.

Their framework is called ChartAttack. It evaluates how models can be prompted to generate misleading charts at scale. Slanted axes, cherry picked ranges, and swapped colors are classic chart tricks. Knowing how easily models produce them helps set guardrails. The work serves data literacy and AI safety at once.

Catalog record

CREATORJesus-German Ortiz-Barajas, Jonathan Tonglet, Vivek Gupta, Iryna Gurevych
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-12983

Browse the full library · About the Tower of Babel