MMTabReal : Real-World Benchmark for Multimodal Table Understanding
Prasham Titiya, Jainil TrivediChitta Baral, Vivek GuptaArizona State University · 2025
Read MMTabReal : Real-World Benchmark for Multimodal Table Understanding by Prasham Titiya, Jainil TrivediChitta Baral, Vivek GuptaArizona State University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21771.txt.
Description
Prasham Titiya, Jainil Trivedi, Chitta Baral, and Vivek Gupta benchmark vision language models on real world tables in a 2025 paper. Business tables mix charts, maps, icons, and color codes, and models trained on plain text tables stumble on the blend.
The suite holds five hundred human curated tables with over four thousand questions, spanning four question kinds, five reasoning kinds, and eight layouts. Top models dropped twenty to forty percent against older benchmarks, failing mostly at visual grounding, spatial matching, and multi step math. The release is for testing only, with a call for tighter vision table fusion.
Catalog record
| CREATOR | Prasham Titiya, Jainil TrivediChitta Baral, Vivek GuptaArizona State University |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-21771