DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment

Xinyue Li, Shubo Xu, Zhichao Zhang, Zhaolin Cai, Yitong Chen*, Guangtao Zhai* · 2026

Read DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment by Xinyue Li, Shubo Xu, Zhichao Zhang, Zhaolin Cai, Yitong Chen*, Guangtao Zhai* (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12813.txt.

Introduction

Xinyue Li and five colleagues split video quality work into perception and calibration. Pretrained multimodal models already sense quality, but tuning them to new scenes costs heavy retraining. DPC-VQA freezes a multimodal model for a base score and adds a light branch for a residual fix. The split avoids full retraining and keeps performance reliable. On user-made and AI-made benchmarks, it matches strong baselines. It uses under 2 percent of standard parameters and stays effective with only 20 percent of labels.

Catalog record

CREATORXinyue Li, Shubo Xu, Zhichao Zhang, Zhaolin Cai, Yitong Chen*, Guangtao Zhai*
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37992
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.12813

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DPC-VQA: Decoupling Quality Perception and Residual Calibration for Video Quality Assessment DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05, 2018, Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 Thanks: * Corresponding author CCS: Computing methodologies Visual inspection CCS: Human-centered computing Visualization design and evaluation methods Xinyue Li, Shubo Xu, Zhichao Zhang, Zhaolin Cai, Yitong Chen*, Guangtao Zhai* Abstract . Recent multimodal large language models (MLLMs) have shown promising performance on video quality assessment (VQA) tasks. However, adapting them to new scenarios remains expensive due to large-scale retraining and costly mean opinion score (MOS) annotations. In this paper, we argue that a pretrained MLLM already provides a useful perceptual prior for VQA, and that the main challenge is to efficiently calibrate this prior to the target MOS space. Based on this insight, we propose DPC-VQA , a decoupling perception and calibration framework for video quality assessment. Specifically, DPC-VQA uses a frozen MLLM to provide a base quality estimate and perceptual prior, and employs a lightweight calibration branch to predict a residual correction for target-scenario adaptation. This design avoids costly end-to-end retraining while maintaining reliable performance with lower training and data costs. Extensive experiments on both user-generated content (UGC) and AI-generated content (AIGC) benchmarks show that DPC-VQA achieves competitive performance against representative baselines, while using less than 2% of the trainable parameters of conventional MLLM-based VQA methods and remaining effective with only 20% of MOS labels. The code will be released upon publication. Figure 1. Comparison between existing MLLM-based VQA pipelines and the proposed DPC-VQA framework. Top left: existing methods typically predict quality scores by training or fine-tuning an MLLM with a regressor. Bottom left: when the target scenario changes, they often require scenario-specific retraining with costly MOS supervision. Right: DPC-VQA instead preserves the pretrained MLLM as a frozen quality prior and adapts it through lightweight residual calibration. 1. Introduction Figure 2. Motivation for decoupling quality perception and residual calibration. (a) Frozen MLLM quality predictions are already correlated with MOS, indicating a useful base quality prior. (b) The residual error shows a clear dependency on the base score, suggesting that the remaining discrepancy is structured and learnable. (c) Residual errors are concentrated around zero, implying that most samples require only limited correction. These results motivate calibrating a perceptually grounded base score rather than relearning video quality prediction end-to-end. All results are computed on the KoNViD-1k dataset for analysis. As video content becomes the dominant medium in modern multimedia systems ( 32 ; 3 ; 39 ) , video quality assessment (VQA) plays an increasingly important role in video acquisition, compression, streaming, transmission, restoration, and generation ( 19 ; 4 ; 40 ) . This broad applicability also requires VQA methods to go beyond strong performance on a single benchmark, and instead support efficient adaptation to diverse real-world scenarios and domains ( 1 ; 25 ; 20 ; 4 ) . Over the past decade, VQA methods have evolved from hand-crafted feature-based models to deep neural networks with increasingly strong representation ability ( 32 ; 12 ; 24 ) . More recently, multimodal large language models (MLLMs) have further advanced this trend and shown promising performance in video quality assessment ( 23 ; 38 ) . These results suggest that pretrained MLLMs can serve as a strong foundation for VQA tasks ( 37 ; 20 ) . However, adapting MLLMs to practical VQA scenarios remains difficult ( 33 ; 35 ) . Real-world VQA settings vary substantially in content domains, distortion types, capture conditions, and scoring protocols ( 34 ; 1 ; 25 ) . When the target scenario changes, existing methods often require retraining or dataset-specific adaptation, which becomes particularly expensive for MLLM-based models due to their large scale ( 30 ; 13 ) . At the same time, current VQA pipelines rely on mean opinion score (MOS) annotations, whose collection is notoriously costly because it requires repeated human subjective evaluation ( 32 ; 11 ) . These two factors together make large-scale adaptation of MLLM-based VQA difficult in practice, as illustrated in Figure 1 . In this work, we argue that a pretrained MLLM can already provide a useful generic perceptual prior for VQA. The practical bottleneck is then not how to relearn quality perception from scratch, but how to efficiently calibrate this prior to the MOS space of a target benchmark or scenario. Our motivation is supported by three empirical observations. First, as shown in Figure 2 (a), the predictions from a frozen MLLM already exhibit clear correlation with ground-truth MOS, indicating that the pretrained model provides a useful base quality prior. Second, Figure 2 (b) shows that the residual error depends systematically on the base score rather than behaving as random noise, suggesting that the remaining discrepancy is structured and learnable. Third, Figure 2 (c) shows that the residual errors are largely concentrated around zero, implying that most samples require only limited correction rather than full re-estimation. Together, these observations support calibrating a strong pretrained quality prior instead of learning video quality prediction from scratch for each target scenario. Based on this insight, we decouple VQA into two complementary components: quality perception and score calibration . We propose DPC-VQA , a D ecoupling P erception and C alibration framework for V ideo Q uality A ssessment. Specifically, the frozen MLLM serves as the perception branch and provides a base quality estimate, while a trainable calibration branch predicts a bounded residual correction in the target MOS space. To improve calibration, the residual predictor can further incorporate auxiliary video features in addition to the frozen MLLM representation. The final prediction is obtained by combining the base score with the learned residual. In this way, the proposed framework leverages the rich quality perception ability already encoded in the pretrained MLLM and adapts it to diverse target scenarios through lightweight calibration rather than costly end-to-end retraining. This design substantially reduces adaptation cost and remains effective even under limited MOS supervision. Our main contributions are summarized as follows: • We propose DPC-VQA , a decoupling perception and calibration framework for video quality assessment, where a frozen MLLM provides a base quality score and perceptual prior, and a lightweight calibration branch adapts it for target scenarios. • We propose a residual calibration mechanism that refines the base quality prediction via token-wise bounded residual estimation and adaptive aggregation, enabling efficient and fine-grained adaptation to target quality spaces. • Extensive experiments on both UGC and AIGC benchmarks show that the proposed framework achieves competitive performance against representative baselines, while using less than 2% of the trainable parameters of conventional MLLM-based VQA methods and remaining effective with only 20% of MOS labels. 2. Related Work 2.1. No-Reference Video Quality Assessment Video quality assessment (VQA) methods are commonly divided into full-reference (FR), reduced-reference (RR), and no-reference (NR) settings. Since reference information is often unavailable in practice, NR-VQA has become the dominant paradigm for perceptual video quality prediction. Early NR-VQA methods relied on hand-crafted features and statistical priors. For example, TLVQM ( 7 ) and RAPIQUE ( 22 ) estimate video quality using distortion- and motion-aware descriptors, but their ability to

Read the complete text