DeQA-Doc: Adapting DeQA-Score to Document Image Quality Assessment
Junjie Gao, Runze Liu, Yingzhe Peng, Shujian Yang, Jin Zhang, Kai Yang, Zhiyuan You, Ant Group, Southeast University, Shanghai Jiao Tong University, CUHK, MBZUAI [email protected], {runze.liu, yingzhe.peng}@seu.edu.cn, [email protected]{zj346862, chengyue.yk}@antgroup.com, zhiyuanyou@fo · 2025
Read DeQA-Doc: Adapting DeQA-Score to Document Image Quality Assessment by Junjie Gao, Runze Liu, Yingzhe Peng, Shujian Yang, Jin Zhang, Kai Yang, Zhiyuan You, Ant Group, Southeast University, Shanghai Jiao Tong University, CUHK, MBZUAI [email protected], {runze.liu, yingzhe.peng}@seu.edu.cn, [email protected]{zj346862, chengyue.yk}@antgroup.com, zhiyuanyou@fo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12796.txt.
Introduction
Junjie Gao and co-authors adapt a leading image quality scorer to judge document images, in a 2025 paper. Scanned documents feed digitization, text recognition, and archives. Poor scans break those pipelines downstream. Existing quality tools often give shaky scores on real-world documents.
Their system, DeQA-Doc, builds on a multimodal large language model scorer. A soft label strategy lets it output smooth, continuous quality grades. The model reads both visual flaws and text layout cues. Tests aim for scores that match human judgment more closely. Digitization teams could route bad scans for recapture automatically. The work extends a strong general scorer into a niche with high practical stakes.
Catalog record
| CREATOR | Junjie Gao, Runze Liu, Yingzhe Peng, Shujian Yang, Jin Zhang, Kai Yang, Zhiyuan You, Ant Group, Southeast University, Shanghai Jiao Tong University, CUHK, MBZUAI [email protected], {runze.liu, yingzhe.peng}@seu.edu.cn, [email protected]{zj346862, chengyue.yk}@antgroup.com, zhiyuanyou@fo |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12796
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DeQA-Doc: Adapting DeQA-Score to Document Image Quality Assessment Junjie Gao, Runze Liu, Yingzhe Peng, Shujian Yang, Jin Zhang, Kai Yang, Zhiyuan You, Ant Group, Southeast University, Shanghai Jiao Tong University, CUHK, MBZUAI [email protected], {runze.liu, yingzhe.peng}@seu.edu.cn, [email protected]{zj346862, chengyue.yk}@antgroup.com, [email protected] Abstract Document quality assessment is critical for a wide range of applications including document digitization, OCR, and archival. However, existing approaches often struggle to provide accurate and robust quality scores, limiting their applicability in practical scenarios. With the rapid progress in Multi-modal Large Language Models (MLLMs), recent MLLM-based methods have achieved remarkable performance in image quality assessment. In this work, we extend this success to the document domain by adapting DeQA-Score, a state-of-the-art MLLM-based image quality scorer, for document quality assessment. We propose DeQA-Doc, a framework that leverages the visual language capabilities of MLLMs and a soft label strategy to regress continuous document quality scores. To adapt DeQA-Score to DeQA-Doc, we adopt two complementary solutions to construct soft labels without the variance information. Also, we relax the resolution constrains to support the large resolution of document images. Finally, we introduce ensemble methods to further enhance the performance. Extensive experiments demonstrate that DeQA-Doc significantly outperforms existing baselines, offering accurate and generalizable document quality assessment across diverse degradation types. Codes and model weights are available in https://github.com/Junjie-Gao19/DeQA-Doc . 1 Introduction Assessing the quality of document images is a fundamental task in document understanding [ 42 , 15 , 18 ] , with wide-ranging applications in digitization, OCR, information retrieval, and archival systems [ 23 , 29 , 31 ] . Traditional Document Image Quality Assessment (DIQA) methods rely heavily on hand-crafted features or shallow models [ 18 , 17 , 1 , 2 , 40 , 42 ] , which often fail to capture high-level semantic and structural information. While more recent approaches incorporate deep learning-based metrics [ 15 , 21 , 3 , 48 ] but still struggle to generalize across diverse document layouts and degradation types. In contrast, Multi-modal Large Language Models (MLLMs) have shown promising capabilities in related fields such as Image Quality Assessment (IQA) [ 51 , 36 , 38 , 45 , 44 , 37 , 52 , 46 ] , owing to their ability to jointly reason over visual and textual modalities. Building on this progress, we explore the application of MLLM-based quality prediction to the document domain. Specifically, we adapt DeQA-Score [ 46 ] , a state-of-the-art MLLM framework, originally developed for image quality scoring to perform document quality assessment. We introduce DeQA-Doc, a simple yet effective extension that leverages MLLMs’ visual-linguistic alignment and incorporates a distribution-based soft label strategy to regress continuous quality scores. A key challenge in adapting DeQA-Score to documents lies in the lack of annotation variance information in DIQA datasets, which is required for constructing soft labels. To address this, we propose two complementary solutions: (1) assigning a fixed pseudo variance based on empirical statistics from other datasets, and (2) using linear interpolation between adjacent quality levels as a lightweight surrogate for cases where only mean opinion scores are available. Another challenge lays in that document images often have significantly larger resolutions, but DeQA-Score can only handle images with a fixed resolution of 448\times 448 . DeQA-Score uses mPLUG-Owl2 as the base model, and its vision encoder is implemented with a CLIP backbone [ 27 ] , which by default only accepts input images of a fixed resolution, typically 448\times 448 . However, document images often have significantly larger resolutions, and aggressive down-sampling may lead to severe information loss, especially for fine-grained layout and text details. To enable flexible input resolutions, we propose two alternative methods. First, we can remove the absolute position embeddings from the CLIP encoder. Second, alternatively, we can change the base model from mPLUG-Owl2 to Qwen2.5-VL, which can take dynamic and original image resolutions. These modifications decouple the model from the original fixed spatial grid and allow it to process high-resolution document images directly, preserving more structural and semantic information during encoding. Our framework is instantiated on top of two strong MLLM backbones, mPLUG-Owl2 [ 43 ] and Qwen2.5-VL [ 4 ] , and incorporates architectural modifications such as resolution-flexible vision encoding to better accommodate high-resolution document images. We adopt a hybrid training objective that combines cross entropy loss for next token prediction and KL divergence loss for soft label supervision. To enhance performance, we further apply two ensemble strategies: model ensemble, which averages predictions from mPLUG-Owl2 and Qwen2.5-VL, and prompt ensemble, which aggregates outputs from multiple semantically diverse prompts. These strategies effectively leverage complementary model capacities and mitigate prompt sensitivity, yielding more robust and accurate predictions, as validated in our experiments. Extensive experiments demonstrate that DeQA-Doc achieves competitive performance on the DIQA-5000 dataset, significantly outperforming existing baselines. The proposed method offers a robust generalizable solution for document quality assessment, and highlights the potential of MLLMs to unify image and document quality evaluation under a shared framework. 2 Related Works Document Image Quality Assessment (DIQA) aims to automatically evaluate the quality of a document image. In this context, quality is often synonymous with readability, which can be assessed from either a machine perspective, typically measured by OCR accuracy, or a human perspective, based on perceptual visual quality. Traditional DIQA methods rely heavily on hand-crafted features or shallow models [ 2 , 18 , 17 , 1 , 40 , 42 ] . Deep-learning-based methods train models on large-scale datasets [ 15 , 21 , 3 ] , significantly improving the performance. However, existing approaches often struggle to provide accurate and robust quality scores, limiting their applicability in practical scenarios. Image Quality Assessment (IQA) methods are categorized into Full-Reference (FR) and No-Reference (NR) based on the availability of a pristine reference image. FR-IQA computes a similarity score to a reference. Classical methods rely on hand-crafted metrics like structural similarity [ 34 ] and phase congruency with gradient magnitude [ 47 ] . Driven by large-scale datasets [ 49 , 11 , 14 ] , deep learning-based approaches [ 7 , 8 , 10 , 6 ] , pioneered by LPIPS [ 49 ] and PieAPP [ 26 ] , have achieved high accuracy in quality regression. NR-IQA directly predicts a quality score. Early works used hand-crafted natural image statistics [ 24 , 22 , 28 ] . Recent advances further improve accuracy through strategies like multi-dataset co-training [ 50 ] , multi-scale features [ 16 ] , CLIP pre-training [ 33 ] , multi-dimension attention [ 41 ] , and multitask learning [ 51 ] . MLLM-based IQA methods leverage MLLMs’ powerful foundational knowledge to achieve better performance and detailed assessment results [ 39 ] . Researches have focus on low-level perception ability [ 36 ] , multi-image quality comparison [ 38 ] , and fine-grained visual quality grounding and analysis [ 5 ] . Some works have proposed quality scoring strategies. Q-Bench [ 35 ] and Q-Instruct [ 36 ] propose a binary softmax strategy, enabling MLLMs to generate quality scores by predicting two discrete quality levels. Inspired by humans’ annotation process, Q-Align [ 37 ] discretizes scores to five discrete levels using one-hot label to train MLLMs. DeQA-Score [ 46 ] introduces score distribution regression, further improving the