ViTaB-A: Evaluating Multimodal Large Language Models on Visual Table Attribution
Yahia Alqurnawi Preetom Biswas Anmol Rao Tejas Anvekar Chitta Baral Vivek Gupta School of Computing and Augmented Intelligence Arizona State University Tempe, AZ 85281, USA {yalqurna,pbiswa11,arao75,tanvekar,cbaral,vgupt140}@asu.edu Project page Dataset Code · 2026
Read ViTaB-A: Evaluating Multimodal Large Language Models on Visual Table Attribution by Yahia Alqurnawi Preetom Biswas Anmol Rao Tejas Anvekar Chitta Baral Vivek Gupta School of Computing and Augmented Intelligence Arizona State University Tempe, AZ 85281, USA {yalqurna,pbiswa11,arao75,tanvekar,cbaral,vgupt140}@asu.edu Project page Dataset Code (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-15769.txt.
Description
Alqurnawi and colleagues test whether multimodal large language models can show their work on tables. Such models answer questions on tables in Markdown, JSON, and image form, but users also need to know where answers come from. The paper studies structured data attribution, the ability to point to specific rows and columns supporting an answer, evaluating several models across table formats and prompting strategies.
Results reveal a clear gap between answering and attributing. Question answering accuracy stays moderate, but attribution accuracy runs much lower, near random for JSON inputs across all models. Models cite rows more reliably than columns and struggle more with textual formats than images, with notable differences across model families. Overall, current models prove unreliable at fine-grained, trustworthy attribution for structured data, limiting their use where transparency and traceability matter.
Catalog record
| CREATOR | Yahia Alqurnawi Preetom Biswas Anmol Rao Tejas Anvekar Chitta Baral Vivek Gupta School of Computing and Augmented Intelligence Arizona State University Tempe, AZ 85281, USA {yalqurna,pbiswa11,arao75,tanvekar,cbaral,vgupt140}@asu.edu Project page Dataset Code |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-15769