ViTaB-A: Evaluating Multimodal Large Language Models on Visual Table Attribution

Yahia Alqurnawi Preetom Biswas Anmol Rao Tejas Anvekar Chitta Baral Vivek Gupta School of Computing and Augmented Intelligence Arizona State University Tempe, AZ 85281, USA {yalqurna,pbiswa11,arao75,tanvekar,cbaral,vgupt140}@asu.edu Project page Dataset Code · 2026

Read ViTaB-A: Evaluating Multimodal Large Language Models on Visual Table Attribution by Yahia Alqurnawi Preetom Biswas Anmol Rao Tejas Anvekar Chitta Baral Vivek Gupta School of Computing and Augmented Intelligence Arizona State University Tempe, AZ 85281, USA {yalqurna,pbiswa11,arao75,tanvekar,cbaral,vgupt140}@asu.edu Project page Dataset Code (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-15769.txt.

Description

Alqurnawi and colleagues test whether multimodal large language models can show their work on tables. Such models answer questions on tables in Markdown, JSON, and image form, but users also need to know where answers come from. The paper studies structured data attribution, the ability to point to specific rows and columns supporting an answer, evaluating several models across table formats and prompting strategies.

Results reveal a clear gap between answering and attributing. Question answering accuracy stays moderate, but attribution accuracy runs much lower, near random for JSON inputs across all models. Models cite rows more reliably than columns and struggle more with textual formats than images, with notable differences across model families. Overall, current models prove unreliable at fine-grained, trustworthy attribution for structured data, limiting their use where transparency and traceability matter.

Catalog record

CREATORYahia Alqurnawi Preetom Biswas Anmol Rao Tejas Anvekar Chitta Baral Vivek Gupta School of Computing and Augmented Intelligence Arizona State University Tempe, AZ 85281, USA {yalqurna,pbiswa11,arao75,tanvekar,cbaral,vgupt140}@asu.edu Project page Dataset Code
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-15769

Browse the full library · About the Tower of Babel