IndoTabVQA : A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents
Somraj Gautam, Anathapindika Dravichi, Gaurav Harit · 2026
Read IndoTabVQA : A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents by Somraj Gautam, Anathapindika Dravichi, Gaurav Harit (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11970.txt.
Introduction
Gautam, Dravichi, and Harit introduce IndoTabVQA, a benchmark for cross-lingual table visual question answering on real document images in Bahasa Indonesia. It holds 1,593 document images in three visual styles and 1,593 question-answer sets in four languages: Bahasa Indonesia, English, Hindi, and Arabic. Benchmarks of leading vision-language models reveal large gaps, especially on complex tables and in low-resource languages. Fine-tuning a compact 3B model and a LoRA-tuned 7B model lifts accuracy by 11.6 and 17.8 percent, while adding explicit table region coordinates gains another 4 to 7 percent.
Catalog record
| CREATOR | Somraj Gautam, Anathapindika Dravichi, Gaurav Harit |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38926 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.11970
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
IndoTabVQA : A Benchmark for Cross-Lingual Table Understanding in Bahasa Indonesia Documents Somraj Gautam, Anathapindika Dravichi, Gaurav Harit Abstract We introduce IndoTabVQA , a benchmark for evaluating cross-lingual Table Visual Question Answering (VQA) on real-world document images in Bahasa Indonesia. The dataset comprises 1,593 document images, across three visual styles (bordered, borderless, and colorful) with one or more than one tables, and 1,593 question-answer sets in four languages: Bahasa Indonesia, English, Hindi, and Arabic. This enables evaluation of Vision-Language Models (VLMs) in both monolingual (Bahasa documents with Bahasa questions) and cross-lingual settings (Bahasa documents with questions in other languages). We benchmark leading open-source VLMs (Qwen2.5-VL, Gemma-3, LLaMA-3.2) and GPT-4o and reveal substantial performance gaps, particularly on structurally complex tables and in low-resource languages. Fine-tuning a compact 3B and LoRA-finetuned 7B model on our dataset yields 11.6% and 17.8% improvements in accuracy. Providing explicit table region coordinates as additional input further improves performance by 4-7%, demonstrating the value of Spatial priors for table-based reasoning. Our findings underscore the importance of language-diverse, domain-specific datasets and demonstrate that targeted fine-tuning can significantly enhance VLM performance on specialized document understanding tasks. IndoTabVQA provides a valuable resource for advancing research in cross-lingual, structure-aware document understanding, especially in underrepresented regions of the world. Full dataset can be accessed at: https://huggingface.co/datasets/NusaBharat/INDOTABVQA . 1 Introduction Figure 1: IndoTabVQA presents document images in Bahasa Indonesia, and semantically aligned QA pairs in four languages, enabling cross-lingual evaluation of VLMs. Vision-Language Models (VLMs) have demonstrated strong performance on text-centric visual understanding tasks, as shown on benchmarks such as TextVQA 19 , ST-VQA 25 , DocVQA 16 , and OCRBench 13 . Recent table-focused datasets such as TableVQA-Bench 11 , TabComp 4 , and ComTQA 27 further assess numerical reasoning and structure-aware comprehension. However, these benchmarks share a critical limitation: they are predominantly monolingual and English-centric, providing limited insight into VLM performance on low-resource languages or cross-lingual generalization. Documents in languages like Bahasa Indonesia, Hindi, and Arabic represent billions of users globally, yet VLMs trained primarily on English data may fail to process these documents reliably. For table-based VQA specifically, models must handle both linguistic variation and structural complexity, a challenging combination that remains underexplored. The Core Problem: Existing VQA benchmarks do not adequately test whether VLMs can (1) understand tables in low-resource languages, or (2) answer questions about these tables when queries are posed in different languages. This gap limits our understanding of true multilingual capability and hinders the development of globally applicable document AI systems. This paper introduces IndoTabVQA , a benchmark designed to evaluate the cross-lingual and structure-aware capabilities of VLMs in the context of real-world document tables. Our benchmark comprises document images containing tables in Bahasa Indonesia, a language spoken by over 200 million people but underrepresented in vision-language research, paired with question-answer (QA) annotations in Bahasa Indonesia, English, Hindi, and Arabic, as shown in Fig. 1 . Detailed statistics of our benchmark are presented in section 2.5 and table 1 . Our work provides three main contributions: • A novel cross-lingual benchmark featuring real-world documents in an underrepresented language (Bahasa Indonesia) with parallel annotations in four languages, enabling systematic evaluation of cross-lingual visual reasoning. • Comprehensive baseline evaluation of current VLMs, revealing specific failure modes in structure-aware reasoning and language transfer that inform future model development. • Analysis of Spatial priors and fine-tuning showing that explicit table localization and domain adaptation are effective strategies for improving VLM performance on specialized document tasks. IndoTabVQA addresses a critical gap in multilingual document AI and provides a testbed for developing more inclusive and robust vision-language systems. The dataset and evaluation code will be made publicly available upon acceptance. 2 IndoTabVQA Dataset This section describes the construction of IndoTabVQA in detail, covering the dataset scope and design, data collection, the diversity of table types, the annotation protocol, statistics, and benchmark configuration. 2.1 Dataset Scope and Design IndoTabVQA enables evaluation in two settings: • Monolingual setting: Both documents and QA pairs are in Bahasa Indonesia, testing the model’s ability to understand low-resource language content. • Cross-lingual setting: Documents remain in Bahasa Indonesia while questions are posed in English, Hindi, or Arabic. This probes whether models can align visual content in one language with semantically equivalent questions in another, assessing true cross-lingual transfer rather than memorized language patterns. This design isolates two distinct challenges: (1) visual-linguistic understanding of low-resource document content, and (2) cross-lingual alignment between visual and textual modalities. 2.2 Data Collection and Sources We sourced table images from real-world Indonesian documents across government reports (statistical summaries, budget allocations), educational records (enrollment data, performance metrics), business documents (invoices, financial statements), public health data (demographic statistics, service records). A significant portion of our data derives from the Institutional Repository of the Ministry of Primary and Secondary Education of Indonesia 1 1 1 https://repositori.kemendikdasmen.go.id . We retrieved documents from the official portal and manually selected those containing well-formed tables suitable for VQA. Figure 2: Architecture comparison with left-to-right pipeline flow across three evaluation settings. Each row represents a complete evaluation pipeline from input to output. Setting 1: Uses a pretrained VLM without fine-tuning (zero-shot). Setting 2: Fine-tunes the model on table QA data but without spatial information. Setting 3: Introduces spatial priors through table detection, enabling the model to use table locations during reasoning. 2.3 Visual Diversity: Table Types To reflect real-world document variation, we categorize tables into three types based on visual presentation: • Bordered Tables (500 images): Traditional tables with explicit cell borders, commonly found in official forms and reports. • Borderless Tables (602 images): Tables without explicit cell lines, requiring inference of structure from whitespace, alignment, and text positioning. • Colorful Tables (491 images): Tables using background colors, cell shading, or highlighted headers for emphasis or grouping. This taxonomy is not mutually exclusive (some tables have both borderless and colors as table present in Fig. 1 ), but we assign each image to its primary category for analysis purposes and give the color category a higher priority. 2.4 Annotation Protocol Each table instance is paired with one question–answer (QA) item, authored in Bahasa Indonesia, following a controlled template designed to cover lookup, aggregation, comparison, and structural reasoning. Annotators were instructed to write unambiguous, table-grounded, and answer-contained questions. We then translated each Bahasa QA into English, Hindi, and Arabic using automatic translation, followed by human validation by native speakers. Validators corrected lexical errors, normalized number formats, ensured that entity references remained faithful to the table, and flagged ambiguous or culturally mismatched translations. Each QA underwent a two-stage quality check: (1) internal consistency (answer must exist exactly in the table region) and (2) cross-lingual equivalence (the four versions must express the same intent). Items failing either check were revised or removed. Table 7 summarises the key statistics. Extended guidelines and annotation examples appear in Appendix A . Figure 3 illustrates language coverage by country, highlighting our focus on evaluating VLMs in linguistically diverse and underrepresented regions, such as Southeast Asia, the Middle East, South Asia, and other English-dominated countries . 2.5 Dataset Statistics and Properties Table 1 summarizes the key characteristics of the dataset. The visual content in all images is exclusively in Bahasa Indonesia, ensuring linguistic consistency across table elements. However, the