Team PA-VCG’s Solution for Competition on Understanding Chinese College Entrance Exam Papers in ICDAR’25
Wei Wu †, Wenjie Wang †, Yang Tan †, Ying Liu, Liang Diao ∗, Lin Huang, Kaihe Xu, Wenfeng Xie, Ziling Lin · 2025
Read Team PA-VCG’s Solution for Competition on Understanding Chinese College Entrance Exam Papers in ICDAR’25 by Wei Wu †, Wenjie Wang †, Yang Tan †, Ying Liu, Liang Diao ∗, Lin Huang, Kaihe Xu, Wenfeng Xie, Ziling Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00834.txt.
Introduction
Wei Wu and co-authors report their winning entry in a 2025 contest on reading Chinese college entrance exam papers. Exam sheets pose hard problems for software, with dense print and complex page layouts. The team, called PA-VCG in the title, built a system to pull text and structure from such sheets.
Their method uses sharp page images and feeds more than one image at once to the model. Extra training tuned to exam papers then lifts the scores further. The system took first place in the contest. The work shows how task-specific training can help machines read crowded school documents.
Catalog record
| CREATOR | Wei Wu †, Wenjie Wang †, Yang Tan †, Ying Liu, Liang Diao ∗, Lin Huang, Kaihe Xu, Wenfeng Xie, Ziling Lin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 6 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-00834
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Team PA-VCG’s Solution for Competition on Understanding Chinese College Entrance Exam Papers in ICDAR’25
Wei Wu †, Wenjie Wang †, Yang Tan †, Ying Liu, Liang Diao ∗, Lin Huang, Kaihe Xu, Wenfeng Xie, Ziling Lin
Abstract
This report presents Team PA-VGG’s solution for the ICDAR’25 Competition on Understanding Chinese College Entrance Exam Papers. In addition to leveraging high-resolution image processing and a multi-image end-to-end input strategy to address the challenges of dense OCR extraction and complex document layouts in Gaokao papers, our approach introduces domain-specific post-training strategies. Experimental results demonstrate that our post-training approach achieves the most outstanding performance, securing first place with an accuracy rate of 89.6%.
0
0
footnotetext:
†
Main Contribution
∗
Corresponding author
Code:
https://github.com/Dejavuvvw/1st_solution_UCCEEP_ICDAR2025
Model:
https://huggingface.co/Dejavuvvw/1st_solution_UCCEEP_ICDAR2025
1
Competition Setting
This competition tests MLLMs’ skill in analyzing Chinese Gaokao exam papers. To do well, models need to handle both detailed OCR processing for accurate text extraction and complex document layouts, like charts, tables, and multi-column formats, all at the same time.
2
Method
2.1
High resolution for dense OCR prediction
The competition entails analyzing dense Chinese Gaokao exam paper images, each containing about
1,000 text tokens
. Recent studies
[
1
,
2
,
6
]
show that such token-dense scenarios require
high-resolution visual processing
to tackle OCR-intensive tasks. Prior work confirms that effective visual encoding boosts performance, especially in retaining fine-grained text and structure.
Table 1
:
Training hyper-parameters
Hyper-paramerter
Lora
Full
batch-size
16
64
learning rate
5e-5
6e-6
learning rate schedule
cosine
cosine
learning rate warm-up ratio
0
0
weight decay
0.1
0.1
grad norm clipping
1
1
epoch
10
5
optimizer
AdamW
AdamW
float precision
bfloat16
bfloat16
deepspeed configuration
-
zero3-offload
2.2
Multiple images MLLM
Unlike methods that process a single image at a time followed by reasoning, our approach directly inputs all task-related images and prompts end-to-end into MLLM. This allows the model to fully leverage image feature information across multiple images, enhancing its layout, text, and image feature extraction capabilities.
2.3
MLLM Finetuning
Distillation from OCR foundation MLLM
To avoid a decline in the generalization ability of the multimodal large model and ensure the basic OCR capability is preserved during fine-tuning for downstream tasks, we utilize OVIS2
[
4
]
, a foundation OCR MLLM, to extract text information from the data. Subsequently, this text information is combined with task-specific data as distillation data for post-training.
Lora Finetune
Lora
[
3
]
, a commonly used method for specific tasks, efficiently adapts pre-trained models by adding a few trainable parameters. It is known for its fast convergence and ability to prevent overfitting. We integrated Lora adapters into key layers of the models. Experimental results demonstrate that Lora fine-tuning enhances the models’ ability to answer the competition question.
Full-parameter Finetune
To further explore the potential accuracy limits, we conducted full-parameter fine-tuning on the models. This approach, unlike Lora, involves updating all model parameters, which consequently demands more computational resources. Conventionally, fine-tuning a large model on a limited dataset is prone to overfitting. Surprisingly, our experiments showed that full-parameter fine-tuning avoided overfitting and significantly outperformed the Lora method. The underlying reasons for this unexpected outcome require further investigation.
2.4
Prompt Refinement and Post Processing
Page-Aware Prompt Refinement
By analysis of the error samples of the baseline model, we find that the MLLM still has unclear recognition of page numbers. Therefore, we explicitly add page number indications in the prompt. The prompt is as follows:
Page1:<image>,Page2:<image>,Page3:<image>.
{question}
.
Besides, for different questions, we refine the system prompts to supply necessary prior knowledge and rule constraints for answering.
Process Reasoning Refinement
We observe that with direct end-to-end training, the model fails to implicitly learn the intermediate reasoning process. For example, we found that MLLMs perform poorly in determining whether the answer to a given question is contained within a single page and in predicting the page number where the answer first appears. To address these limitations, we introduce a
process reasoning refinement
by generating intermediate-step Q&A augmented data, such as asking “Is the answer to question 12 split across multiple pages?” and “Please provide, in Arabic numerals, the page number where the answer section first appears.”
Post process
To regulate the output of MLLM, several post-processing steps are implemented. For instance, we eliminate blank characters and any text unrelated to the answers.
3
Implementation Details and Experiment
Table 2
:
Compatible Table with Row Coloring
Model
Config
Params
Acc (%)
QwenVL-2.5 (3B)
LoRA baseline
3B
75.0
QwenVL-2.5 (7B)
LoRA baseline
7B
75.6
QwenVL-2.5 (3B)
+ Prompt Refine + Distil
3B
76.6
Ovis-2 (4B)
Full fine-tuning
4B
70.0
QwenVL-2.5 (7B)
Full (lr=1e-6)
7B
82.2
QwenVL-2.5 (7B)
Full (lr=6e-6)
7B
88.3
QwenVL-2.5 (7B)
Full + PR + Distil
7B
89.6
Considering the GPU memory constraints, we excluded training data with more than 25 images. Our training code leverages the widely-used Transformers
[
5
]
and ms-swift
[
7
]
libraries. We conducted experiments on various base models, including Qwen2.5 VL 3B, Qwen2.5 VL 7B, and Ovis2 4B. For Lora fine-tuning, we used a single A800-80G GPU, whereas for full-parameter fine-tuning, we employed eight A800-80G GPUs.
The detailed training hyper-parameters are shown in Table
1
. We conducted extensive ablation studies to validate our design choices. As shown in Table
, our full-parameter fine-tuning approach with learning rate 6e-6 achieves the best performance when combined with prompt refinement and OCR distillation. The final competition results validate our methodology, as shown in Table
3
.
Table 3
:
Final Competition Team Rankings
Rank
Team Name
Acc. (%)
1
PA-VGG
89.6
2
PAL Team
82.1
3
360ailab
78.8
4
PKU-CNKI
75.9
5
GlintAnything
74.0
6
TeamCufe