Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Framework
Xinyue Li, Zhichao Zhang, Zhiming Xu, Shubo Xu, Xiongkuo Min, Yitong Chen, Guangtao Zhai · 2026
Read Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Framework by Xinyue Li, Zhichao Zhang, Zhiming Xu, Shubo Xu, Xiongkuo Min, Yitong Chen, Guangtao Zhai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20689.txt.
Introduction
Xinyue Li and six co-authors work on how machines judge the quality of a picture. Their 2026 paper uses large models that can read both images and text. Such models can rate image quality well, the team notes. But training them for this job is costly. It also needs many scores from human raters.
The team argues that the true bottleneck is not how well the model sees flaws. The hard part is scale calibration: matching the model's scores to the human score scale. Their framework splits the job in two. One part handles perception, how the image looks. The other part handles calibration, how scores line up. By splitting the two, the method needs far fewer human labels. That makes quality checks cheaper to run.
Catalog record
| CREATOR | Xinyue Li, Zhichao Zhang, Zhiming Xu, Shubo Xu, Xiongkuo Min, Yitong Chen, Guangtao Zhai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20689
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Decoupling Perception and Calibration: Label-Efficient Image Quality Assessment Framework Xinyue Li, Zhichao Zhang, Zhiming Xu, Shubo Xu, Xiongkuo Min, Yitong Chen, Guangtao Zhai Abstract Recent multimodal large language models (MLLMs) have demonstrated strong capabilities in image quality assessment (IQA) tasks. However, adapting such large-scale models is computationally expensive and still relies on substantial Mean Opinion Score (MOS) annotations. We argue that for MLLM-based IQA, the core bottleneck lies not in the quality perception capacity of MLLMs, but in MOS scale calibration. Therefore, we propose LEAF, a L abel- E fficient Image Quality A ssessment F ramework that distills perceptual quality priors from an MLLM teacher into a lightweight student regressor, enabling MOS calibration with minimal human supervision. Specifically, the teacher conducts dense supervision through point-wise judgments and pair-wise preferences, with an estimate of decision reliability. Guided by these signals, the student learns the teacher’s quality perception patterns through joint distillation and is calibrated on a small MOS subset to align with human annotations. Experiments on both user-generated and AI-generated IQA benchmarks demonstrate that our method significantly reduces the need for human annotations while maintaining strong MOS-aligned correlations, making lightweight IQA practical under limited annotation budgets. The code will be released upon the publication. 1 Introduction Image Quality Assessment (IQA) is a key component of modern visual systems, supporting a wide range of applications including camera calibration, image enhancement, content filtering, streaming media optimization, and large-scale data management 8 ; 24 . IQA facilitates efficient benchmarking and optimization of image enhancement and generative models by providing feedback that is consistent with human standards 7 ; 15 ; 43 ; 28 . Multimodal large language models (MLLMs) have recently demonstrated outstanding capabilities in IQA tasks, often matching specialized IQA models by leveraging strong visual understanding and rich prior knowledge 44 ; 30 ; 34 . This advancement has led to an emerging practice, treating MLLMs as high-performing quality evaluators and adapting them for IQA through instruction tuning or task-specific fine-tuning 15 ; 29 ; 6 . However, despite the considerable accuracy of these MLLM-based methods, they still face two practical barriers that limit their usability in real-world IQA pipelines, as shown in Figure 1 . Figure 1: Using MLLMs for IQA is computationally expensive and annotation-intensive. MLLMs can perceive the key information of image quality. This work advocates decoupling quality perception from MOS calibration, thereby enabling efficient image quality assessment with minimal human supervision. First, MLLM-based methods are computationally expensive throughout the pipeline, both during training and at deployment 34 . For example, 29 and 35 proposed MLLM-based IQA methods, which require training and inference on large memory GPUs. This makes large MLLMs difficult to use in settings that demand fast, low-cost, and scalable quality prediction, such as on-device assessment, large-scale data filtering, and real-time monitoring 34 . Second, current IQA methods mainly rely on supervised learning with human mean opinion scores (MOS) 15 ; 30 . Although MOS can provide reliable subjective judgments under controlled protocols, MOS annotation is resource-intensive. For example, the KonIQ-10K 10 dataset contains more than 10,000 images and has collected a total of 1.2 million opinion scores. Moreover, subjective quality perception drifts with the scenario. Therefore, MOS annotations need to be recollected as scenarios and time changes. Figure 2: Direct MLLM scoring on AGIQA-3K exhibits strong monotonic correlation with MOS (SRCC= 0.816 ) but suffers from pronounced scale bias and non-linear mapping (shown in (a)). Calibrating a Linear with only 10\% MOS substantially improves MOS alignment (PLCC from 0.824 to 0.907 ) and reduces residual bias (mean residual from 0.263 to 0.006 ). More importantly, for a pretrained MLLM, the primary limitation is often not the capability of quality perception, but the absence of explicit MOS scale calibration. Specifically, MLLMs perform well in capturing comparative and quality classification, such as distinguishing better versus worse images or assigning coarse quality levels. However, they struggle to map these perceptual judgments onto the MOS rating scales of specific datasets and specific scenarios. Figure 2 illustrates this phenomenon on the AGIQA-3K dataset. Direct MLLM scoring preserves reliable ranking, but suffers from clear MOS scale miscalibration. Calibrating only a lightweight head with 10\% MOS largely removes the residual bias and improves MOS alignment while keeping ranking performance (Fig. 2 (b,c)). This suggests that the key challenge is MOS scale calibration rather than relearning perception. Consequently, directly fine-tuning MLLMs using large-scale MOS annotations is an inefficient strategy. More experimental details are reported in the supplementary materials. Inspired by this observation, in this work, we answer this question with LEAF , a L abel- E fficient Image Quality A ssessment F ramework that transfers perceptual quality knowledge from an MLLM teacher into a lightweight student. The key idea is to use the teacher to provide dense supervision on a large unlabeled image set, and reserve human MOS labels only for final calibration. Concretely, the teacher provides two complementary forms of supervision: (i) point-wise quality judgments for individual images, and (ii) pair-wise preferences that encode relative quality rankings, and also include estimates of decision reliability. Leveraging these signals, we formulate a Joint Teacher-Guided Distillation to enable the student to learn the teacher’s quality perception. We then conduct Calibration Fine-Tuning on only a small MOS subset to align the student’s scoring scale with human judgments. Our contributions are summarized as follows: • We formulate a label-efficient IQA framework that decouples perceptual knowledge from MOS calibration, based on the insight that MLLMs are strong at quality perception but weak at dataset-specific MOS alignment. • We propose a two-stage teacher-guided framework that transfers perceptual quality priors to a lightweight student by joint distillation of point-wise judgments and confidence-weighted pair-wise preferences, followed by calibration using a small MOS-labeled subset. • Experiments on both UGC and AIGC benchmarks validate the proposed decoupling principle, showing that strong MOS-aligned correlation can be achieved with limited MOS supervision, while avoiding costly task-specific fine-tuning of MLLMs. 2 Related Work 2.1 Image Quality Assessment 2.1.1 Handcrafted IQA Early image quality assessment (IQA) relied on handcrafted fidelity and perception priors, among which SSIM-style structural comparison methods became influential and were further extended to improve robustness under diverse distortions 31 . Complementary handcrafted cues were explored through phase and gradient features to better capture perceptually significant structural changes 40 . No-reference IQA subsequently adopted natural scene statistics to treat distortions as a deviation from natural regularities, as demonstrated by DIIVINE 20 , BRISQUE 18 , and the opinion-unaware NIQE 19 . 2.1.2 Deep Learning–based IQA Deep IQA learns quality-aware representations directly from data, while WaDIQaM 4 is an early blind image quality assessment model based on CNN. Full-reference IQA also shifted to deep feature distances, such as LPIPS 41 , DISTS 7 , and PieAPP 22 . Later blind IQA methods improved adaptability and spatial sensitivity through hypernetworks in HyperIQA 27 , attention mechanisms 5 , pseudo-reference hallucination in HIQA 16 , and stronger CNN interactions 42 , while transformers such as MUSIQ 11 and MANIQA 37 further strengthen global and multi-scale modeling. 2.1.3 Multi-modal Model-based IQA Multimodal IQA exploits vision-language priors, where LIQE 43 combines image and text embeddings and CLIP-IQA 28 supports prompt-based zero-shot assessment. For AI-generated images, prompt consistency can be explicitly modeled within