PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Training

Zelun Zhang, Hongen Liu, Suyin Liang, Yubo Zhang, Yiqing Xiang, Jiaxuan Liu, Ting Sun, Manhui Lin, Yue Zhang, Changda Zhou, Tingquan Gao, Cheng Cui † , Yi Liu, Dianhai Yu, Yanjun Ma PaddlePaddle Team, Baidu Inc. † Project Leader Official Website : https://www.paddleocr.com Source Code : https://github.com/PaddlePaddle/PaddleOCR Models : https://huggingface.co/PaddlePaddle · 2026

Read PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Training by Zelun Zhang, Hongen Liu, Suyin Liang, Yubo Zhang, Yiqing Xiang, Jiaxuan Liu, Ting Sun, Manhui Lin, Yue Zhang, Changda Zhou, Tingquan Gao, Cheng Cui † , Yi Liu, Dianhai Yu, Yanjun Ma PaddlePaddle Team, Baidu Inc. † Project Leader Official Website : https://www.paddleocr.com Source Code : https://github.com/PaddlePaddle/PaddleOCR Models : https://huggingface.co/PaddlePaddle (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03264.txt.

Introduction

Zhang and a large team upgrade a compact model for document parsing. PaddleOCR-VL-1.6 builds on a 0.9-billion-parameter baseline. The old model's errors cluster in weak regions: places where behavior is unstable, data is sparse, or labels are unreliable. Widening the corpus at random would waste effort on strong regions.

The new version uses a region-aware data plan. Weak regions of the old model are found and enhanced with care. The trust in supervision signals is raised at the same time. A staged post-training recipe then applies curated data choice and reinforcement learning in steps. The model scores about 96 percent on OmniDocBench, a new state of the art for the task. It also stands well against top vision-language models. The authors offer the recipe as a practical path for the model series. The lesson is to fix the weak spots, not to add data blindly.

Catalog record

CREATORZelun Zhang, Hongen Liu, Suyin Liang, Yubo Zhang, Yiqing Xiang, Jiaxuan Liu, Ting Sun, Manhui Lin, Yue Zhang, Changda Zhou, Tingquan Gao, Cheng Cui † , Yi Liu, Dianhai Yu, Yanjun Ma PaddlePaddle Team, Baidu Inc. † Project Leader Official Website : https://www.paddleocr.com Source Code : https://github.com/PaddlePaddle/PaddleOCR Models : https://huggingface.co/PaddlePaddle
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03264

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PaddleOCR-VL-1.6: Expanding the Frontier of Document Parsing with Under-Optimized Region Refinement and Progressive Post-Training Zelun Zhang, Hongen Liu, Suyin Liang, Yubo Zhang, Yiqing Xiang, Jiaxuan Liu, Ting Sun, Manhui Lin, Yue Zhang, Changda Zhou, Tingquan Gao, Cheng Cui † , Yi Liu, Dianhai Yu, Yanjun Ma PaddlePaddle Team, Baidu Inc. † Project Leader Official Website : https://www.paddleocr.com Source Code : https://github.com/PaddlePaddle/PaddleOCR Models : https://huggingface.co/PaddlePaddle Abstract We introduce PaddleOCR-VL-1.6, an upgraded compact document parsing model built upon PaddleOCR-VL-1.5. Although PaddleOCR-VL-1.5 establishes a strong 0.9B baseline, its remaining errors concentrate in under-optimized regions where model behavior is unstable, data coverage is sparse, or supervision is unreliable. Rather than expanding the training corpus indiscriminately, PaddleOCR-VL-1.6 introduces a region-aware data optimization framework that identifies weak regions from the previous model, applies targeted enhancement to these regions, and improves the reliability of supervision signals. It further adopts a progressive post-training recipe based on curated data selection and reinforcement learning, pushing model performance to a higher level through staged optimization. PaddleOCR-VL-1.6 achieves a new state-of-the-art score of 96.33% on OmniDocBench v1.6, demonstrates strong competitiveness against top-tier VLMs, and provides a practical post-training recipe for the PaddleOCR-VL series. \reportnumber 001 Figure 1 : Performance of PaddleOCR-VL-1.6 on OmniDocBench v1.6 and Real5-OmniDocBench. Contents 1 Introduction Document parsing has become a central interface between unstructured documents and large language model applications. Modern document systems are expected to recover not only plain text, but also layout regions, reading order, mathematical formulas, tables, charts, seals, and spatially grounded text instances. This structured conversion determines whether document collections can be faithfully transformed into Markdown, JSON, or other machine-readable formats for downstream indexing, retrieval, and reasoning. As retrieval-augmented generation systems increasingly depend on high-fidelity document ingestion [ 19 ] , document parsing has moved from a narrow OCR task toward a broader vision-language problem that requires visual localization, structural reconstruction, and semantic preservation across heterogeneous document elements [ 21 , 28 , 15 , 23 ] . Recent progress in document parsing has been driven by both specialized document VLMs and general-purpose multimodal models. PaddleOCR-VL [ 9 ] showed that a compact 0.9B vision-language model can achieve strong multilingual document parsing performance without relying on larger parameter scales. Other systems, including DeepSeek-OCR [ 44 ] , MonkeyOCR [ 21 ] , Dolphin [ 15 ] , and HunyuanOCR [ 37 ] , have further explored end-to-end parsing, heterogeneous prompting, and unified OCR-centric modeling. Building on this line, PaddleOCR-VL-1.5 [ 8 ] strengthened the PaddleOCR-VL series through improved robustness and broader task coverage, while preserving the compact 0.9B model scale. These advances establish a strong starting point for PaddleOCR-VL-1.6: the question is no longer whether compact document parsing VLMs are viable, but how to further improve them once the main architecture has already entered a high-performance regime. In this regime, the remaining errors are not well described as uniformly distributed noise. Recent benchmark reports and model analyses suggest that top systems increasingly encounter difficult regions that are not fully addressed by increasing data volume or model size alone [ 9 , 28 , 32 ] . Long-tail document layouts, rare scripts, dense formulas, complex tables, and noisy supervision can remain underrepresented or unreliable even when the overall training corpus is large. PaddleOCR-VL-1.5 [ 8 ] already incorporated uncertainty-aware sampling and distortion-oriented robustness improvements, which helped expose the value of targeted data construction. PaddleOCR-VL-1.6 extends this direction by treating the remaining problem as one of under-optimized regions: localized parts of the data and supervision space where the model is unstable, insufficiently covered, or trained against labels that may not be reliable. To address this problem, we introduce an Under-Optimized Region driven data engine. The engine starts from PaddleOCR-VL-1.5 and diagnoses three complementary types of residual regions. Boundary-fragile regions contain samples whose predictions vary across training checkpoints or under semantic-preserving visual perturbations, indicating unstable decision boundaries. Coverage-sparse regions correspond to low-density neighborhoods in feature semantic space, where long-tail document patterns are likely to be absorbed by dominant distributions under conventional sampling. External-support-deficient regions identify existing training samples whose labels cannot be supported by independent expert parsers, revealing unreliable supervision rather than merely difficult inputs. These signals are then handled through two routes. Boundary-fragile and coverage-sparse samples serve as seeds for region-guided retrieval from internal large document pools, thereby strengthening these underrepresented distributions with minimal disruption to the existing data distribution. External-support-deficient samples are used for existing-label correction. Retrieved unlabeled samples are labeled through expert consensus, and unresolved data are further processed with an Iterable Judge-and-Refine labeling strategy. The curated data produced by this engine are used in a progressive post-training recipe rather than a single mixed training stage. The Continued Pre-training stage incorporates all curated data to inject broad distributional coverage and corrected supervision into the model. The Supervised Fine-Tuning stage then focuses on high-difficulty and high-quality samples, sharpening model behavior in regions where PaddleOCR-VL-1.5 remains fragile or previously learned from unreliable labels. Finally, GRPO [ 35 ] is applied to further improve model performance. Since data efficiency is critical for reinforcement learning on compact models, we adopt a carefully designed GRPO-oriented data selection strategy. Specifically, candidate samples are jointly assessed from three perspectives: improvement potential, entropy-based uncertainty, and rollout reward distributions. Only high-value samples with the greatest expected gains are selected for the final reinforcement learning stage. PaddleOCR-VL-1.6 actively addresses current challenges in document processing with a high-performance, resource-efficient multimodal document parsing solution. Its key contributions include: • We introduce PaddleOCR-VL-1.6, an upgraded version of PaddleOCR-VL-1.5 [ 8 ] built upon improved data strategies and a refined post-training pipeline. It preserves the high-efficiency compact 0.9B model scale while achieving state-of-the-art performance on OmniDocBench v1.6. • We introduce Under-Optimized Region Mining, which diagnoses model-specific boundary-fragile, coverage-sparse, and unreliable-supervision regions. We further develop a high-precision automatic annotation pipeline that combines multi-expert consensus with an Iterable Judge-and-Refine labeling strategy, enabling large-scale labeling of unlabeled samples. • We design a reliable data selection strategy for reinforcement learning on compact models, where data quality is particularly critical. Candidate samples are evaluated from three complementary perspectives: improvement potential, entropy-based uncertainty, and rollout reward distributions, ensuring effective reinforcement learning for compact models. • We develop a progressive CPT-SFT-RL post-training recipe for the PaddleOCR-VL series, providing a practical reference for efficient adaptation to downstream domain-specific scenarios. 2 PaddleOCR-VL-1.6 Overview PaddleOCR-VL-1.6 continues the compact design philosophy of the PaddleOCR-VL series. The full system consists of two models: PP-DocLayoutV3 for layout analysis and PaddleOCR-VL-1.6-0.9B for vision-language understanding. In this upgrade, we keep PP-DocLayoutV3 unchanged and focus on improving the PaddleOCR-VL-1.6-0.9B model. PaddleOCR-VL-1.6-0.9B inherits the lightweight architecture of PaddleOCR-VL-1.5-0.9B [ 9 ] , integrating a Native Resolution Visual Encoder [ 11 ] , an Adaptive MLP Connector, and the lightweight ERNIE-4.5-0.3B Language Model [ 4 ] . The main upgrade lies not in enlarging the model or modifying the architecture, but in a more targeted data engine and a refined post-training process. This design allows PaddleOCR-VL-1.6 to retain the high inference efficiency of PaddleOCR-VL-1.5 while achieving stronger system performance. Figure 2 : The overview of PaddleOCR-VL-1.6. Consistent with its predecessor, PaddleOCR-VL-1.6 supports two primary practical tasks: document parsing and text spotting. For document parsing, the system follows a robust two-stage framework. In the first stage, PP-DocLayoutV3

Read the complete text