Team PA-VCG’s Solution for Competition on Understanding Chinese College Entrance Exam Papers in ICDAR’25

Wei Wu †, Wenjie Wang †, Yang Tan †, Ying Liu, Liang Diao ∗, Lin Huang, Kaihe Xu, Wenfeng Xie, Ziling Lin · 2025

Read Team PA-VCG’s Solution for Competition on Understanding Chinese College Entrance Exam Papers in ICDAR’25 by Wei Wu †, Wenjie Wang †, Yang Tan †, Ying Liu, Liang Diao ∗, Lin Huang, Kaihe Xu, Wenfeng Xie, Ziling Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00834.txt.

Introduction

Wei Wu and co-authors report their winning entry in a 2025 contest on reading Chinese college entrance exam papers. Exam sheets pose hard problems for software, with dense print and complex page layouts. The team, called PA-VCG in the title, built a system to pull text and structure from such sheets.

Their method uses sharp page images and feeds more than one image at once to the model. Extra training tuned to exam papers then lifts the scores further. The system took first place in the contest. The work shows how task-specific training can help machines read crowded school documents.

Catalog record

CREATORWei Wu †, Wenjie Wang †, Yang Tan †, Ying Liu, Liang Diao ∗, Lin Huang, Kaihe Xu, Wenfeng Xie, Ziling Lin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE6 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-00834

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Team PA-VCG’s Solution for Competition on Understanding Chinese College Entrance Exam Papers in ICDAR’25
Wei Wu †, Wenjie Wang †, Yang Tan †, Ying Liu, Liang Diao ∗, Lin Huang, Kaihe Xu, Wenfeng Xie, Ziling Lin

Abstract
This report presents Team PA-VGG’s solution for the ICDAR’25 Competition on Understanding Chinese College Entrance Exam Papers. In addition to leveraging high-resolution image processing and a multi-image end-to-end input strategy to address the challenges of dense OCR extraction and complex document layouts in Gaokao papers, our approach introduces domain-specific post-training strategies. Experimental results demonstrate that our post-training approach achieves the most outstanding performance, securing first place with an accuracy rate of 89.6%.



0
0
footnotetext:
†
Main Contribution
∗
Corresponding author

Code:

https://github.com/Dejavuvvw/1st_solution_UCCEEP_ICDAR2025

Model:

https://huggingface.co/Dejavuvvw/1st_solution_UCCEEP_ICDAR2025

1
Competition Setting

This competition tests MLLMs’ skill in analyzing Chinese Gaokao exam papers. To do well, models need to handle both detailed OCR processing for accurate text extraction and complex document layouts, like charts, tables, and multi-column formats, all at the same time.

2
Method

2.1
High resolution for dense OCR prediction

The competition entails analyzing dense Chinese Gaokao exam paper images, each containing about
1,000 text tokens
. Recent studies
[
1
,
2
,
6
]
show that such token-dense scenarios require
high-resolution visual processing
to tackle OCR-intensive tasks. Prior work confirms that effective visual encoding boosts performance, especially in retaining fine-grained text and structure.

Table 1
:
Training hyper-parameters

Hyper-paramerter

Lora

Full

batch-size

16

64

learning rate

5e-5

6e-6

learning rate schedule

cosine

cosine

learning rate warm-up ratio

0

0

weight decay

0.1

0.1

grad norm clipping

1

1

epoch

10

5

optimizer

AdamW

AdamW

float precision

bfloat16

bfloat16

deepspeed configuration

-

zero3-offload

2.2
Multiple images MLLM

Unlike methods that process a single image at a time followed by reasoning, our approach directly inputs all task-related images and prompts end-to-end into MLLM. This allows the model to fully leverage image feature information across multiple images, enhancing its layout, text, and image feature extraction capabilities.

2.3
MLLM Finetuning

Distillation from OCR foundation MLLM

To avoid a decline in the generalization ability of the multimodal large model and ensure the basic OCR capability is preserved during fine-tuning for downstream tasks, we utilize OVIS2
[
4
]
, a foundation OCR MLLM, to extract text information from the data. Subsequently, this text information is combined with task-specific data as distillation data for post-training.

Lora Finetune

Lora
[
3
]
, a commonly used method for specific tasks, efficiently adapts pre-trained models by adding a few trainable parameters. It is known for its fast convergence and ability to prevent overfitting. We integrated Lora adapters into key layers of the models. Experimental results demonstrate that Lora fine-tuning enhances the models’ ability to answer the competition question.

Full-parameter Finetune

To further explore the potential accuracy limits, we conducted full-parameter fine-tuning on the models. This approach, unlike Lora, involves updating all model parameters, which consequently demands more computational resources. Conventionally, fine-tuning a large model on a limited dataset is prone to overfitting. Surprisingly, our experiments showed that full-parameter fine-tuning avoided overfitting and significantly outperformed the Lora method. The underlying reasons for this unexpected outcome require further investigation.

2.4
Prompt Refinement and Post Processing

Page-Aware Prompt Refinement

By analysis of the error samples of the baseline model, we find that the MLLM still has unclear recognition of page numbers. Therefore, we explicitly add page number indications in the prompt. The prompt is as follows:

Page1:<image>,Page2:<image>,Page3:<image>.
{question}
.

Besides, for different questions, we refine the system prompts to supply necessary prior knowledge and rule constraints for answering.

Process Reasoning Refinement

We observe that with direct end-to-end training, the model fails to implicitly learn the intermediate reasoning process. For example, we found that MLLMs perform poorly in determining whether the answer to a given question is contained within a single page and in predicting the page number where the answer first appears. To address these limitations, we introduce a
process reasoning refinement
by generating intermediate-step Q&A augmented data, such as asking “Is the answer to question 12 split across multiple pages?” and “Please provide, in Arabic numerals, the page number where the answer section first appears.”

Post process

To regulate the output of MLLM, several post-processing steps are implemented. For instance, we eliminate blank characters and any text unrelated to the answers.

3
Implementation Details and Experiment

Table 2
:
Compatible Table with Row Coloring

Model

Config

Params

Acc (%)

QwenVL-2.5 (3B)

LoRA baseline

3B

75.0

QwenVL-2.5 (7B)

LoRA baseline

7B

75.6

QwenVL-2.5 (3B)

+ Prompt Refine + Distil

3B

76.6

Ovis-2 (4B)

Full fine-tuning

4B

70.0

QwenVL-2.5 (7B)

Full (lr=1e-6)

7B

82.2

QwenVL-2.5 (7B)

Full (lr=6e-6)

7B

88.3

QwenVL-2.5 (7B)

Full + PR + Distil

7B

89.6

Considering the GPU memory constraints, we excluded training data with more than 25 images. Our training code leverages the widely-used Transformers
[
5
]
and ms-swift
[
7
]
libraries. We conducted experiments on various base models, including Qwen2.5 VL 3B, Qwen2.5 VL 7B, and Ovis2 4B. For Lora fine-tuning, we used a single A800-80G GPU, whereas for full-parameter fine-tuning, we employed eight A800-80G GPUs.

The detailed training hyper-parameters are shown in Table
1
. We conducted extensive ablation studies to validate our design choices. As shown in Table
, our full-parameter fine-tuning approach with learning rate 6e-6 achieves the best performance when combined with prompt refinement and OCR distillation. The final competition results validate our methodology, as shown in Table
3
.

Table 3
:
Final Competition Team Rankings

Rank

Team Name

Acc. (%)

1

PA-VGG

89.6

2

PAL Team

82.1

3

360ailab

78.8

4

PKU-CNKI

75.9

5

GlintAnything

74.0

6

TeamCufe

Read the complete text