TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignment
Chunxia Qin, Chenyu Liu, Pengcheng Xia, Baocai Yin, Bing Yin, Cong Liu · 2026
Read TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignment by Chunxia Qin, Chenyu Liu, Pengcheng Xia, Baocai Yin, Bing Yin, Cong Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22819.txt.
Introduction
Qin and co-authors present TDATR, an end-to-end system for table recognition in documents. Split pipelines handle structure and content apart, which complicates the workflow. TDATR uses a perceive-then-fuse plan. First, detail-aware learning tasks teach structure and content together in a language modeling style. Then fused details yield structured HTML output. A structure-guided module locates cells and tightens vision-language alignment. The system reaches top or near-top results on seven benchmarks. It does so with no dataset-specific fine-tuning.
Catalog record
| CREATOR | Chunxia Qin, Chenyu Liu, Pengcheng Xia, Baocai Yin, Bing Yin, Cong Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57313 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22819
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignment Thanks: Corresponding author, [email protected] Chunxia Qin, Chenyu Liu, Pengcheng Xia, Baocai Yin, Bing Yin, Cong Liu Abstract Tables are pervasive in diverse documents, making table recognition (TR) a fundamental task in document analysis. Existing modular TR pipelines separately model table structure and content, leading to suboptimal integration and complex workflows. End-to-end approaches rely heavily on large-scale TR data and struggle in data-constrained scenarios. To address these issues, we propose TDATR (Table Detail-Aware Table Recognition) improves end-to-end TR through table detail-aware learning and cell-level visual alignment. TDATR adopts a “perceive-then-fuse” strategy. The model first performs table detail-aware learning to jointly perceive table structure and content through multiple structure understanding and content recognition tasks designed under a language modeling paradigm. These tasks can naturally leverage document data from diverse scenarios to enhance model robustness. The model then integrates implicit table details to generate structured HTML outputs, enabling more efficient TR modeling when trained with limited data. Furthermore, we design a structure-guided cell localization module integrated into the end-to-end TR framework, which efficiently locates cell and strengthens vision–language alignment. It enhances the interpretability and accuracy of TR. We achieve state-of-the-art or highly competitive performance on seven benchmarks without dataset-specific fine-tuning. 1 Introduction Figure 1 : Comparison of different table recognition paradigms. (a) Modular TR pipelines suffer from complex workflows and sub-optimization. (b) End-to-end TR models underperform in data-scarce scenarios due to weak detail perception. (c) Our “perceive-then-fuse” framework enhances structure and content awareness and unifies TR and cell localization for robust end-to-end TR. Tables convey structured data that bridges visual layouts and semantic information Chandran and Kasturi 1993 . Tables are pervasive across diverse domains such as scientific publications Zhong et al. 2020 ; Chi et al. 2019 , invoices Long et al. 2021 , and financial reports Zheng et al. 2021 . Table recognition (TR) converts table images into machine-readable formats (e.g., HTML, LaTeX). Accurate TR facilitates downstream applications such as retrieval augmented generation Yu et al. 2025 , document understanding and document digitization Lv et al. 2023 ; Blecher et al. 2023 . Most existing TR systems follow a modular design, decomposing TR into two subtasks: table structure recognition (TSR) Chandran and Kasturi 1993 and table content recognition (TCR) Shi et al. 2016 . Each component is trained independently, and the final TR result is obtained through post-processing Anand et al. 2023 , as shown in 1 (a). However, this separation overlooks the inherent interdependence between structure and content, resulting in suboptimal integration and error accumulation. Specifically, table structures provide strong priors for constraining content boundaries, which guide the localization of text lines and prevent confusion between column separators and inter-character spacing. Semantic continuity of cell content Zhang et al. 2024b helps distinguish visually adjacent cells, providing cues for structure recognition. Recent studies Wan et al. 2024 ; Zhong et al. 2020 ; Feng et al. 2025 attempt to unify TSR and TCR into a single vision–language model that directly generates structured outputs. While simplifying the pipeline, this paradigm relies heavily on large-scale annotated TR. Real world TR data are scarce due to the high cost of labeling both table structure and content Chen et al. 2022 . Consequently, end-to-end TR Zhao et al. 2024 ; Feng et al. 2025 ; Zhong et al. 2020 models often struggle to generalize robustly to diverse real-world tables. Moreover, most existing approaches only predict TR result without explicit spatial correspondence (e.g., cell locations) Zhao et al. 2024 ; Feng et al. 2025 ; Zhong et al. 2020 , limiting the interpretability and applicability of TR results. Current end-to-end TR models typically rely on generic document Feng et al. 2025 ; Luo et al. 2024 or vision pre-training Peng et al. 2024 , neglecting the fine-grained perception of table structure and content that is essential for precise table recognition. To address these limitations, we propose TDATR (Table Detail-Aware Table Recognition), a framework that enhances end-to-end TR through detail-aware learning and cell-level visual alignment. TDATR follows a “perceive-then-fuse” strategy. In the perception stage, the model performs table detail-aware learning through our unified structure understanding and content recognition tasks under a language modeling paradigm. This equips model with strong table-detail perception and allows effective pre-training on large-scale and multi-domain data. In the fusion stage, the model integrates the implicitly learned table details to generate structured HTML outputs using only limited TR data. This paradigm effectively decouples TR capability learning and alleviates the difficulty of modeling TR sequences from scratch. Furthermore, we introduce a structure-guided cell localization module that efficiently localizes cell positions and strengthens vision–language alignment through structure priors and multi-level visual features, improving both interpretability and accuracy. Experimental results on seven public benchmarks across different scenarios demonstrate the effectiveness and robustness of our method. Additionally, ablation studies further validate the efficacy of our key designs. Our main contributions are summarized as follows. 1. We propose a “perceive-then-fuse” strategy that reduces reliance on large-scale labeled TR data and simplifies the end-to-end sequence modeling of TR. 2. We design table detail-aware learning that unifies structure understanding and content recognition through a set of pretraining tasks under a language modeling paradigm, enabling effective utilization of diverse document data to enhance model robustness. 3. We develop a structure-guided cell localization module that refines cell boxes via structure priors and multi-level visual features, enhancing visual alignment and TR accuracy. 4. We evaluate our unified model on seven public benchmarks without dataset-specific fine-tuning, demonstrating strong performance and robustness across diverse table styles and scenarios. 2 Related Work Modular table recognition methods employ two separate models for table structure recognition (TSR) and table content recognition (TCR). The TSR model aims to acquire the physical and logical coordinates of cells. TSR models Zhang et al. 2022 ; Ma et al. 2023 ; Baek et al. 2023 ; Zhang et al. 2024a ; Wang et al. 2023 ; Lyu et al. 2023 under the split-and-merge paradigm recover the grid structure of tables by detecting row and column separators, then merge grids into cells to generate TSR results. However, this approach assumes continuous boundaries for cells in the same row or column, making it difficult to handle misaligned tables. Detect-based TSR models Xing et al. 2023 ; Liu et al. 2021a ; Liu et al. 2022a obtain table structures by first detecting table cells and then recognizing their logical coordinates, but they are limited by ambiguous cell boundary definitions in borderless tables. Image-to-markup based TSR methods Zhang et al. 2024b ; Huang et al. 2023 represent table structures as markup sequences (e.g., HTML, LaTeX). However, they require large-scale training data. The TCR models localize and recognize text lines in tables using existing OCR models Du et al. 2022 ; Ye et al. 2023 ; Liu et al. 2021b ; Peng et al. 2022 ; Shi et al. 2016 . Text lines are assigned to cells via IoU-based Anand et al. 2023 or logical-based Peng et al. 2024 post-processing to produce final results. However, since TSR and TCR are trained independently, their inter-dependencies cannot be exploited, leading to suboptimal performance and inevitable error accumulation in fusion. End-to-end table recognition methods integrate TSR and TCR