MMTabReal : Real-World Benchmark for Multimodal Table Understanding

Prasham Titiya, Jainil TrivediChitta Baral, Vivek GuptaArizona State University · 2025

Read MMTabReal : Real-World Benchmark for Multimodal Table Understanding by Prasham Titiya, Jainil TrivediChitta Baral, Vivek GuptaArizona State University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21771.txt.

Description

Prasham Titiya, Jainil Trivedi, Chitta Baral, and Vivek Gupta benchmark vision language models on real world tables in a 2025 paper. Business tables mix charts, maps, icons, and color codes, and models trained on plain text tables stumble on the blend.

The suite holds five hundred human curated tables with over four thousand questions, spanning four question kinds, five reasoning kinds, and eight layouts. Top models dropped twenty to forty percent against older benchmarks, failing mostly at visual grounding, spatial matching, and multi step math. The release is for testing only, with a call for tighter vision table fusion.

Catalog record

CREATORPrasham Titiya, Jainil TrivediChitta Baral, Vivek GuptaArizona State University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-21771

Browse the full library · About the Tower of Babel