Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment

Wulin Xie ∗, Rui Dai †, Ruidong Ding, Kaikui Liu, Xiangxiang Chu, Xinwen Hou, Jie Wen · 2026

Read Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment by Wulin Xie ∗, Rui Dai †, Ruidong Ding, Kaikui Liu, Xiangxiang Chu, Xinwen Hou, Jie Wen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22920.txt.

Introduction

Wulin Xie and six co-authors improve how machines judge image quality the way humans do. Image quality assessment predicts scores that match human opinion of a photo or video. Recent methods use large multimodal models trained with rewards, but they treat all training samples the same.

Some samples give stable predictions and others are noisy, so equal weighting boosts the noisy ones. Their method, Q-Hawkeye, weights training by reliability for steadier learning. Trustworthy quality scores matter for photo apps, streaming, and medical imaging. Reliability weighting addresses the first flaw, while a second flaw concerns models that produce confident scores without stable grounds.

Catalog record

CREATORWulin Xie ∗, Rui Dai †, Ruidong Ding, Kaikui Liu, Xiangxiang Chu, Xinwen Hou, Jie Wen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22920

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Q-Hawkeye: Reliable Visual Policy Optimization for Image Quality Assessment Wulin Xie ∗, Rui Dai †, Ruidong Ding, Kaikui Liu, Xiangxiang Chu, Xinwen Hou, Jie Wen Abstract Image Quality Assessment (IQA) predicts perceptual quality scores consistent with human judgments. Recent RL-based IQA methods built on MLLMs focus on generating visual quality descriptions and scores, ignoring two key reliability limitations: (i) although the model’s prediction stability varies significantly across training samples, existing GRPO-based methods apply uniform advantage weighting, thereby amplifying noisy signals from unstable samples in gradient updates; (ii) most works emphasize text-grounded reasoning over images while overlooking the model’s visual perception ability of image content. In this paper, we propose Q-Hawkeye, an RL-based reliable visual policy optimization framework that redesigns the learning signal through unified Uncertainty-Aware Dynamic Optimization and Perception-Aware Optimization. Q-Hawkeye estimates predictive uncertainty using the variance of predicted scores across multiple rollouts and leverages this uncertainty to reweight each sample’s update strength, stabilizing policy optimization. To strengthen perceptual reliability, we construct paired inputs of degraded images and their original images and introduce an Implicit Perception Loss that constrains the model to ground its quality judgments in genuine visual evidence. Extensive experiments demonstrate that Q-Hawkeye outperforms state-of-the-art methods and generalizes better across multiple datasets. The code and models will be made available. † † affiliationnotice: ∗ Work done during an internship at Amap. † Project Leader. 1 Introduction Image Quality Assessment (IQA) aims to predict perceptual quality scores consistent with human subjective judgments and serves as a fundamental component in vision applications such as enhancement and AIGC quality control ( 11 ; 44 ; 5 ; 27 ) . Depending on whether a reference is available, IQA is typically categorized into full-reference (FR) and no-reference (NR) settings ( 42 ; 23 ) , with NR-IQA being especially practical in real-world scenarios ( 24 ) . With the rapid progress of multimodal large language models (MLLMs) ( 10 ; 58 ; 8 ) , recent IQA methods have leveraged their ability to jointly model low-level degradations and high-level perceptual attributes, often producing text-grounded rationales alongside scalar scores ( 45 ) . Recently, reinforcement learning has been explored as a post-training paradigm to further improve reasoning and generalization. For instance, Q-Insight ( 25 ) applies GRPO ( 34 ) with verifiable rewards to jointly optimize score prediction and distortion awareness, while VisualQuality-R1 ( 46 ) frames NR-IQA as a pairwise ranking problem, performs multiple rollouts per image pair, and uses a Thurstone-style probabilistic formulation with continuous fidelity rewards to induce reasoning-aware quality ranking behavior. Despite this progress, we observe two persistent limitations in RL-based IQA methods. Firstly, rollout score distributions vary markedly across images; some samples generate consistent predictions, while others predict scores with broad and unstable distributions (Fig. 1 ). This difference reflects predictive uncertainty: for certain images, the model has not formed a stable quality judgment. However, existing GRPO-based methods ( 25 ; 3 ; 46 ) commonly apply uniform update strength across samples, causing unstable instances to inject noise into gradient updates and undermining optimization reliability ( 40 ; 20 ; 4 ) . Secondly, existing methods focus on the model’s textual reasoning, score regression, or ranking ability, but ignore the model’s visual perception ability to image content and degradation, which is crucial for visual quality assessment ( 41 ) . As shown in Fig. 2 and Fig. 7 , images with degradation still receive scores and outputs close to relatively clean images, suggesting that in the absence of explicit constraints, the model’s scores and outputs may not be fully grounded in the visual content. In other words, the model can partially rely on dataset regularities or language priors rather than image-intrinsic evidence, restricting the model’s reliability and generalization. Figure 1 : Illustration of predictive uncertainty during training. Sample A shows a high-variance score distribution with inconsistent reasoning, while Sample B shows a low-variance distribution with consistent reasoning. To address these challenges, we propose Q-Hawkeye, a new RL training paradigm for the IQA task that redesigns the learning signal from the perspectives of model uncertainty and visual perceptual ability. Firstly, we introduce an Uncertainty-Aware Dynamic Optimization strategy that performs multiple rollouts per image and estimates uncertainty from the variance of the predicted scores. This uncertainty is then used to adaptively reweight sample-wise update strength, upweighting low-uncertainty samples to consolidate reliable judgments while downweighting high-uncertainty ones to avoid aggressive updates where the policy remains unstable. Secondly, we introduce a Perception-Aware Optimization strategy. Specifically, we first construct paired inputs of original images and their degraded counterparts across diverse distortion types, and introduce an Implicit Perception Loss over the policy outputs under the two visual conditions. This loss encourages the model to produce distinguishable output distributions for original and degraded inputs, thereby strengthening the model’s perceptual ability to visual contents. In summary, our contributions are: • We propose Q-Hawkeye, a reliable visual policy optimization framework for IQA, which introduces unified Uncertainty-Aware Dynamic Optimization and Perception-Aware Optimization strategies that jointly improve the reliability of image quality assessment. • Unlike prior methods that focus on textual reasoning and description abilities, we explicitly explore the visual perceptual capability of MLLMs for IQA. Specifically, we first construct original-degraded image pairs and then introduce an Implicit Perception Loss that drives visually grounded and separable quality judgments, enhancing the model’s perceptual ability to image’s visual content. • Extensive experiments demonstrate our Q-Hawkeye outperforms existing state-of-the-art IQA methods with improved robustness and generalization across datasets and degradation conditions. 2 Related Work Score-based IQA Methods predict continuous quality scores for images. Approaches fall into traditional non-MLLM regressors and recent MLLM-based predictors. Non-MLLM methods cover both full-reference and no-reference IQA, evolving from hand-crafted statistical features to deep CNN or Transformer regressors such as ( 36 ; 33 ; 39 ; 49 ; 32 ; 35 ; 19 ) . MLLM-based methods instead leverage large vision–language models for scoring, including discrete quality level prediction ( 43 ; 24 ; 37 ; 14 ) , distribution-based supervision ( 51 ) , reinforcement-driven quality and degradation modeling ( 25 ) , and pairwise ranking with preference optimization ( 46 ) , aiming to align scores with human judgments and generalize across diverse distortions. Ranking-based IQA Methods view perceptual quality as a relative preference. Instead of directly regressing a score, the model learns which image in a pair is of higher quality. Early work such as ( 28 ; 31 ) demonstrated that quality-discriminable image pairs can be generated automatically and used to train learning-to-rank models. Subsequent approaches extended this idea with multitask or uncertainty-aware objectives that jointly model quality, content, and distortion type, and with fidelity-style pairwise losses that help align synthetic and in-the-wild degradations, improving robustness across datasets ( 2 ; 56 ) . Recently, multimodal ranking-based methods such as Compare2Score ( 60 ) train a vision–language comparator to express relative quality preferences and then convert these pairwise preferences into continuous scores via probabilistic inference against anchor images, effectively bridging preference reasoning and single-image scoring. Reinforcement learning (RL) has recently become a core paradigm for training reasoning-oriented LLMs ( 9 ; 48 ; 18 ) . DeepSeek-R1 ( 15 ) introduces Group Relative Policy Optimization (GRPO), which eliminates value models by using group-relative

Read the complete text