Table Understanding and (Multimodal) LLMs: A Cross-Domain Case Study on Scientific vs. Non-Scientific Data

Ekaterina Borisova 1,2 , Fabio Barth 1 , Nils Feldhus 1,2,3 , Raia Abu Ahmad 1,2 , Malte Ostendorff 4 , Pedro Ortiz Suarez 5 , Georg Rehm 1,6 , Sebastian Möller 1,2 · 2025

Read Table Understanding and (Multimodal) LLMs: A Cross-Domain Case Study on Scientific vs. Non-Scientific Data by Ekaterina Borisova 1,2 , Fabio Barth 1 , Nils Feldhus 1,2,3 , Raia Abu Ahmad 1,2 , Malte Ostendorff 4 , Pedro Ortiz Suarez 5 , Georg Rehm 1,6 , Sebastian Möller 1,2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00152.txt.

Description

Ekaterina Borisova and co-authors test in 2025 how well large language models read tables, in words and in pictures. Tables are the workhorse format of science, business, and medicine, yet model skill on them is under-measured. The team built a benchmark of 3,017 tables from papers, Wikipedia, and finance, each in five formats from image to LaTeX.

Text and multimodal models were scored across domains and formats, with extra analysis of how much context the models actually use. Models held up across formats, but scientific tables proved a real weak spot. The benchmark, TableEval, is offered for future testing.

Catalog record

CREATOREkaterina Borisova 1,2 , Fabio Barth 1 , Nils Feldhus 1,2,3 , Raia Abu Ahmad 1,2 , Malte Ostendorff 4 , Pedro Ortiz Suarez 5 , Georg Rehm 1,6 , Sebastian Möller 1,2
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-00152

Browse the full library · About the Tower of Babel