Reading or Reasoning? Format Decoupled Reinforcement Learning for Document OCR
Yufeng Zhong, Lei Chen, Zhixiong ZengXuanle ZhaoDeyang JiangLiming ZhengJing HuangHaibo QiuPeng ShiSiqi Yang, Lin MaMeituanEmails: <[email protected], [email protected]>Project: https://github.com/DocTron-hub/FD-RL · 2026
Read Reading or Reasoning? Format Decoupled Reinforcement Learning for Document OCR by Yufeng Zhong, Lei Chen, Zhixiong ZengXuanle ZhaoDeyang JiangLiming ZhengJing HuangHaibo QiuPeng ShiSiqi Yang, Lin MaMeituanEmails: <[email protected], [email protected]>Project: https://github.com/DocTron-hub/FD-RL (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08834.txt.
Introduction
Yufeng Zhong and a large team from Meituan work on how AI reads text in scans and photos. Most past work treats this read task as pure sight work. Train sets get rich, and the model learns to copy marks. But hard scans need thought as well, such as when text is bent, dim, or cut off.
The team splits sight from thought in train rewards. A model gets praise for true marks and for sound steps to reach them. That split is the core of their method, called FD-RL. A reader who builds scan tools gets a train plan that may read hard pages with more care. It treats a page as a thing to solve, not just to see.
Catalog record
| CREATOR | Yufeng Zhong, Lei Chen, Zhixiong ZengXuanle ZhaoDeyang JiangLiming ZhengJing HuangHaibo QiuPeng ShiSiqi Yang, Lin MaMeituanEmails: <[email protected], [email protected]>Project: https://github.com/DocTron-hub/FD-RL |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-08834
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Reading or Reasoning? Format Decoupled Reinforcement Learning for Document OCR Yufeng Zhong, Lei Chen, Zhixiong ZengXuanle ZhaoDeyang JiangLiming ZhengJing HuangHaibo QiuPeng ShiSiqi Yang, Lin MaMeituanEmails: <[email protected], [email protected]>Project: https://github.com/DocTron-hub/FD-RL Abstract Reading text from images or scanned documents via OCR models has been a longstanding focus of researchers. Intuitively, text reading is perceived as a straightforward perceptual task, and existing work primarily focuses on constructing enriched data engineering to enhance SFT capabilities. In this work, we observe that even advanced OCR models exhibit significantly higher entropy in formatted text ( e.g. , formula, table, etc.) compared to plain text, often by an order of magnitude. These statistical patterns reveal that advanced OCR models struggle with high output uncertainty when dealing with format sensitive document, suggesting that reasoning over diverse reading pathways may improve OCR performance. To address this, we propose format decoupled reinforcement learning (FD-RL), which leverages high-entropy patterns for targeted optimization. Our approach employs entropy-based data filtration strategy to identify format-intensive instances, and adopt format decoupled rewards tailored to different format types, enabling format-level validation rather than token-level memorization. FD-RL achieves an average score of 90.41 on OmniDocBench, setting a new record for end-to-end models on this highly popular benchmark. More importantly, we conduct comprehensive ablation studies over data, training, filtering, and rewarding strategies, thoroughly validating their effectiveness. † † * Equal contribution. \dagger Project leader. \ddagger Corresponding author. 1 Introduction Document parsing via Optical Character Recognition (OCR) aims to recognize and extract text from document images, which plays a vital role in diverse application domains. Given its importance, numerous advanced methods have recently been proposed, such as Deepseek-OCR 33 , dots.ocr 26 , and PaddleOCR-VL 7 . Figure 1 : Document samples with a high proportion of formatted text exhibit high entropy properties. We divide the document content into plain text and formatted text . The horizontal axis represents the proportion of formatted text to the total document content, and the vertical axis represents the ratio of token entropy. We present a representative document example for each type. Traditional document OCR methods 29 ; 7 ; 21 utilize a two-stage pipeline that first detects layout information and then employs specialized parsers to recognize text. While these pipeline-based methods offer high stability and performance, they suffer from limited flexibility and high fine-tuning costs. In contrast, vision-language model (VLM)-based methods 3 ; 16 ; 13 ; 23 ; 14 ; 33 ; 26 employ VLMs to decode text directly from visual inputs, showing simplified workflows and superior generalization capabilities. Recently, some pipeline-based VLM methods 9 ; 11 ; 18 ; 6 integrate the advantages of both approaches, significantly improving the accuracy of VLM-based methods by utilizing pre-detected layout information. Although existing work achieves strong performance through meticulously designed data engineering and training pipelines, they still exhibit significantly higher entropy in formatted text ( e.g. , formula, table, etc) compared to plain text tokens. As shown in Figure 1 , we conduct an empirical analysis across a large corpus, categorizing document samples by their formatted text proportion into five bins: 20%, 40%, 60%, 80%, and 100%. We then compute the average output entropy during inference based on Qwen3-VL 25 for all samples within each bin. The empirical results reveal a clear pattern: document samples with higher formatted text proportions exhibit substantially higher entropy, indicating lower output certainty and larger model confusion. In fact, existing work shows that the high entropy tokens act as critical forks to steer the language model toward diverse reasoning pathways 30 . Therefore, the formatted text with high entropy may generate diverse reading pathways, producing diverse reward information that can facilitate reinforcement learning algorithms such as GRPO 27 . A simple example is that formulas can be read in several different, semantically equivalent reading pathways (e.g., 1/2 vs. \frac{1}{2} ). Recently, some RL-based OCR models 28 ; 4 ; 24 meticulously develop composite reward mechanisms to optimize complex layout analysis and reading order reasoning. However, these early attempts empirically construct RL datasets that could improve performance, lacking consideration for high-entropy formatted text and proper RL design. In this paper, we propose a novel Format Decoupled Reinforcement Learning (FD-RL) method for document OCR, employing a two-stage SFT-then-RL training paradigm and customized data engineering. First, the customized data engineering provides a large-scale format-rich training corpus by integrating diverse data sources, including open-source datasets, real-world PDF documents, and synthetic OCR samples. Then, the SFT stage learns powerful OCR reading capabilities from diverse data, providing the foundation for RL reasoning. Finally, the RL stage provides two key innovations for reasoning over document OCR, termed as entropy-based data filtration and format decoupled reward. The data filtration strategy aims to select high entropy document samples by ranking them according to their averaged token entropy, inferred by the SFT model. The format decoupled reward first carefully separates the content of different formats from the model output, and then tailors a unique reward function for each format. The main contributions of this study are as follows: • We propose format decoupled reinforcement learning, which explores a SFT-then-RL training paradigm for reasoning-after-reading over documents. • We construct a large-scale, format-rich corpus from diverse sources with optimized mixing ratios, establishing a robust SFT baseline for subsequent RL training. • We devise entropy-based data curation that identifies high-entropy document samples, and calculate format decoupled rewards with content-specific reward functions. • We achieve 90.41 on OmniDocBench, a SOTA performance over previous end-to-end methods. Comprehensive ablation studies, encompassing data, training, data filtering, and format decoupled reward, thoroughly validates our effectiveness. 2 Related Work 2.1 Traditional Pipeline-based OCR Models Pipeline-based OCR models 29 ; 7 ; 21 decompose document parsing into sequential stages: initial layout analysis to localize and segment content regions (including text, formulas, and tables), followed by region-specific parsers that extract and sequence outputs in reading order. For instance, MinerU 29 employs PDF-Extract-Kit 19 coupled with refined pre- and post-processing strategies to ensure extraction accuracy across varied document formats, while PP-StructureV3 7 combines layout detection, table recognition, and structural analysis in a multi-component pipeline to enable comprehensive document parsing. Although these pipeline-based models ensure stability through specialized components, they exhibit constrained adaptability and require significant effort for domain-specific customization. 2.2 VLM-based OCR Methods 2.2.1 End-to-End VLMs End-to-end VLMs 3 ; 16 ; 13 ; 23 ; 14 ; 33 ; 26 adopt unified architectures that directly generate structured outputs from document images in a single forward pass, enabling streamlined processing and robust cross-domain generalization. Recent work in this direction includes POINTS-Reader 13 , which leverages public vision-language backbones with a training paradigm that synthesizes high-quality data and employs self-improvement strategies to bridge the gap between synthetic and real-world distributions. Similarly, dots.ocr 26 utilizes native-resolution vision encoders to process documents at full fidelity while curating large-scale document corpora to enhance model performance. These methods demonstrate the effectiveness of unified VLM architectures for document parsing tasks. Figure 2 : Overview of our training data construction pipeline. We construct the dataset via (1) open-source dataset quality enhancement, (2) real-world PDF construction, and (3) synthetic OCR data generation, yielding a large-scale dataset covering nine common document categories: notes, financial reports, slides, exam papers, synthetic data, magazines, academic papers, books, and newspapers. 2.2.2 Pipeline-based VLMs Pipeline-based