Efficient Table Retrieval and Understanding with Multimodal Large Language Models

Zhuoyan Xu, Haoyang Fang, Boran Han, Bonan Min, Bernie Wang, Cuixiong Hu, Shuai Zhang · 2026

Read Efficient Table Retrieval and Understanding with Multimodal Large Language Models by Zhuoyan Xu, Haoyang Fang, Boran Han, Bonan Min, Bernie Wang, Cuixiong Hu, Shuai Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07642.txt.

Description

Tables often arrive as images in financial reports, handwritten records, and scans, and most table-understanding systems assume the right table is already in hand. Zhuoyan Xu and six co-authors present TabRAG, a method for answering queries over large collections of table images with multi-modal large language models.

Candidate tables are retrieved with jointly trained visual-text foundation models, reranked finely by the multi-modal model, and then reasoned over to answer the query. The pipeline handles the useful case: find the table first, then understand it. Document AI builders get a retrieval-to-thinking method for the messy reality of tables locked in images.

Catalog record

CREATORZhuoyan Xu, Haoyang Fang, Boran Han, Bonan Min, Bernie Wang, Cuixiong Hu, Shuai Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07642

Browse the full library · About the Tower of Babel