Do Large Language Models Understand Data Visualization Rules?
Martín Sinnona Valentín Bonás Emmanuel Iarussi Viviana Siless, Universidad Torcuato Di Tella, Buenos Aires, Argentina, Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina, Universidad de Buenos Aires, Buenos Aires, Argentina [email protected] · 2026
Read Do Large Language Models Understand Data Visualization Rules? by Martín Sinnona Valentín Bonás Emmanuel Iarussi Viviana Siless, Universidad Torcuato Di Tella, Buenos Aires, Argentina, Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina, Universidad de Buenos Aires, Buenos Aires, Argentina [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-20137.txt.
Description
Chart rules distilled from decades of design and perception research keep visual communication trustworthy. Whether language models can enforce those rules directly has been unclear. A 2026 arXiv paper by Martin Sinnona and three co-authors tests language models against visualization rules, with ground truth verified by answer set programming.
Systems such as Draco encode rules as logical constraints, enabling precise automated checks. Maintaining symbolic encodings takes expert effort. That burden motivates language models as flexible rule validators instead. The authors turned part of Draco's constraint set into plain-language statements. They built a dataset of two thousand Vega-Lite examples, each marked with its rule violations. Models were tested on accuracy in detecting violations and on prompt adherence, whether outputs follow the required structured format. Frontier models achieve the strongest results, though remaining gaps are reported.
Catalog record
| CREATOR | Martín Sinnona Valentín Bonás Emmanuel Iarussi Viviana Siless, Universidad Torcuato Di Tella, Buenos Aires, Argentina, Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina, Universidad de Buenos Aires, Buenos Aires, Argentina [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-20137