Table Understanding and (Multimodal) LLMs: A Cross-Domain Case Study on Scientific vs. Non-Scientific Data
Ekaterina Borisova 1,2 , Fabio Barth 1 , Nils Feldhus 1,2,3 , Raia Abu Ahmad 1,2 , Malte Ostendorff 4 , Pedro Ortiz Suarez 5 , Georg Rehm 1,6 , Sebastian Möller 1,2 · 2025
Read Table Understanding and (Multimodal) LLMs: A Cross-Domain Case Study on Scientific vs. Non-Scientific Data by Ekaterina Borisova 1,2 , Fabio Barth 1 , Nils Feldhus 1,2,3 , Raia Abu Ahmad 1,2 , Malte Ostendorff 4 , Pedro Ortiz Suarez 5 , Georg Rehm 1,6 , Sebastian Möller 1,2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00152.txt.
Description
Ekaterina Borisova and co-authors test in 2025 how well large language models read tables, in words and in pictures. Tables are the workhorse format of science, business, and medicine, yet model skill on them is under-measured. The team built a benchmark of 3,017 tables from papers, Wikipedia, and finance, each in five formats from image to LaTeX.
Text and multimodal models were scored across domains and formats, with extra analysis of how much context the models actually use. Models held up across formats, but scientific tables proved a real weak spot. The benchmark, TableEval, is offered for future testing.
Catalog record
| CREATOR | Ekaterina Borisova 1,2 , Fabio Barth 1 , Nils Feldhus 1,2,3 , Raia Abu Ahmad 1,2 , Malte Ostendorff 4 , Pedro Ortiz Suarez 5 , Georg Rehm 1,6 , Sebastian Möller 1,2 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-00152