SPRINT : Script-agnostic Structure Recognition in Tables

Dhruv Kudale, Badri Vishal Kasuba, Venkatapathy Subramanian, Parag Chaudhuri, Ganesh Ramakrishnan · 2025

Read SPRINT : Script-agnostic Structure Recognition in Tables by Dhruv Kudale, Badri Vishal Kasuba, Venkatapathy Subramanian, Parag Chaudhuri, Ganesh Ramakrishnan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11932.txt.

Introduction

Dhruv Kudale and co-authors present, in a 2025 paper, a table-reading system that works across writing scripts, not just English. Reading table structure is key for search, rebuilding tables, and document understanding. Most top systems were trained on English, and building labeled data for other languages is slow and costly.

Their system treats the task as predicting the arrangement of cells, in a compact sequence code for table layout. Paired with a grid estimator, it raised structure scores even on non-English documents. On standard benchmarks it matched top models while running faster. On non-English tables it beat the leaders by a wide margin. The team also gives a converter to web table format and releases its code.

Catalog record

CREATORDhruv Kudale, Badri Vishal Kasuba, Venkatapathy Subramanian, Parag Chaudhuri, Ganesh Ramakrishnan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-11932

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SPRINT : Script-agnostic Structure Recognition in Tables Dhruv Kudale, Badri Vishal Kasuba, Venkatapathy Subramanian, Parag Chaudhuri, Ganesh Ramakrishnan Abstract Table Structure Recognition (TSR) is vital for various downstream tasks like information retrieval, table reconstruction, and document understanding. While most state-of-the-art (SOTA) research predominantly focuses on TSR in English documents, the need for similar capabilities in other languages is evident, considering the global diversity of data. Moreover, creating substantial labeled data in non-English languages and training these SOTA models from scratch is costly and time-consuming. We propose TSR as a language-agnostic cell arrangement prediction and introduce SPRINT — Script-agnostic Structure Recognition in Tables. SPRINT uses recently introduced Optimized Table Structure Language (OTSL) sequences to predict table structures. We show that when coupled with a pre-trained table grid estimator, SPRINT can improve the overall tree edit distance-based similarity structure scores of tables even for non-English documents. We experimentally evaluate our performance across benchmark TSR datasets including PubTabNet, FinTabNet, and PubTables-1M. Our findings reveal that SPRINT not only matches SOTA models in performance on standard datasets but also demonstrates lower latency. Additionally, SPRINT excels in accurately identifying table structures in non-English documents, surpassing current leading models by showing an absolute average increase of 11.12%. We also present an algorithm for converting valid OTSL predictions into a widely used HTML-based table representation. To encourage further research, we release our code and Multilingual Scanned and Scene Table Structure Recognition Dataset, MUSTARD labeled with OTSL sequences for 1428 tables in thirteen languages encompassing several scripts at https://github.com/IITB-LEAP-OCR/SPRINT 1 Introduction Tables in documents serve as powerful tools for organizing and presenting complex data in a structured and visually comprehensible manner. The structure of tables can vary from simple rows and columns to intricate designs with merged cells and hierarchical arrangements. Additionally, the styling of tables, including multilingual content, font choices, colors, and the presence of borders contribute to the overall diversity of tables. It is necessary to understand the structure of tables to perform OCR, table reconstruction, or any other document analysis tasks. Depending upon the application and nature of representation, table structures are generally divided into two notions namely physical structure and logical structure. It is important to deduce both these structures for various downstream applications. The physical structure of the table is denoted by the actual demarcation of table regions like rows, columns, cells, etc. which are generally represented using bounding boxes. The logical structure of a table represents the underlying topology and gives us more information about the cell adjacency relations. It also conveys more about the cells spanned or merged which benefits table reconstruction in the required format. Logical structures of tables are generally represented using HTML, LATEX, or more recently through OTSL [ 21 ] sequences. Logical structure prediction is considered to be a sequence generation task. Recently, as seen in Fig 1 , many Image-to-sequence-based (Im2Seq) models have been employed to predict the logical structures of tables. (a) Graph illustrating the comparative TSR performance of SPRINT (our approach) along with other approaches [ 21 , 20 , 22 ] for FinTabNet and MUSTARD datasets. (b) Sample table from MUSTARD (c) Slow, inaccurate TSR using MTL-TabNet [ 20 ] (d) Fast, accurate script agnostic TSR by SPRINT Figure 1 : Recent performance trends of various Im2Seq models for TSR Im2Seq TSR models are transformer-based models that take a table image as an input and produce a sequence denoting the logical structure of the table. A lot of popular Im2Seq models [ 39 , 20 ] have adapted Global Context Attention (GCA) [ 18 ] in their encoders to boost the TSR performance on popular benchmark datasets. But even though the usage of such GCA-incorporated Im2Seq models like MTL-TabNet [ 20 ] have improved the TSR performance by proposing new architectures, they suffer from two major drawbacks: First of all, they are unable to generalize well on tables having content in different scripts. Secondly, they end up using only HTML-based tag sequences for representing table structures. Such drawbacks are highlighted in the graph shown in Fig 7 . MTL-TabNet [ 20 ] that achieves the best TSR performance on the FinTabNet dataset is not only relatively slower but also is unable to generalize well on MUSTARD achieving an overall tree edit distance-based similarity structure (TEDS-S) score of under 75%. On the other hand, the OTSL-based table structure representation [ 21 ] has proven to be beneficial for faster decoding. It is also evident that using the same TableFormer [ 22 ] architecture, the performance is better and faster using OTSL representation as compared to the HTML representation. Most of these Im2Seq models rely on large HTML tag-based vocabularies making them relatively slower. To design script-agnostic TSR, the model must generalize well on diverse data. MUSTARD comprises of diverse tables from different sources. As shown in Fig 1(c) , MTL-TabNet incorrectly estimates the structure of MUSTARD table shown in Fig 1(b) by interpreting three columns with empty cells on either extreme side of the first row. This is mainly because SOTA models like MTL-TabNet are trained on upsampled table images that mostly have English content and they implicitly capture some language-specific or font-specific features from the image. Since MUSTARD consists of document tables as well as scene tables in several scripts, sizes, and styles, it becomes challenging to perform script-specific or modality-specific TSR. Moreover, all the above-mentioned conventional approaches require training of heavy DL models that require lots of labeled data. Labeled data for tables in non-English languages is limited. To the best of our knowledge, no labeled datasets are available for tables with content in various scripts with their logical structures annotated. Thus, we propose SPRINT , for a fast and script-agnostic structure recognition in tables that addresses the above highlighted gaps. Since SPRINT views table structures as a script-agnostic arrangement of cells, it is beneficial to blur the language-specific or font-specific peculiarities in the table images before they are sent to Im2Seq models. We model the global context of such blurred or downsampled images, using GCA-based encoders as used in SOTA. This helps SPRINT to generalize better on tables having content in different scripts. The SPRINT decoder also leverages a minimal OTSL vocabulary rather than a larger error-prone HTML vocabulary [ 21 ] . As seen in Fig 1(d) , the table structure of the sample image (Fig 1(b) ) is accurately predicted with two columns and five rows represented using the OTSL sequence. The ’F’ in OTSL representation stands for a filled cell and ’L’ stands for a left-ward-looking cell indicating a column span of 2 in the first row. Employing OTSL vocabulary helps in faster decoding of structure sequences. Thus, downsampling table images, usage of a GCA-based encoder, and adapting the OTSL-based representation help in making SPRINT both fast and script agnostic. Through this work, we make the following contributions 1. We present the architecture and design of SPRINT , an Im2Seq model that consists of a GCA-based encoder and a transformer-based decoder that uses the OTSL-based representation for fast and accurate predictions. 2. We propose the usage of SPRINT along with a loosely coupled Table Grid Estimator [ 29 ] for deducing the logical structure of tables having content

Read the complete text