VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Results
Yixiao Li * Xin Li * Chris Wei Zhou * Shuo Xing Hadi Amirpour Xiaoshuai Hao Guanghui Yue Baoquan Zhao Weide Liu Xiaoyuan Yang Zhengzhong Tu Xinyu Li Chuanbiao Song Chenqi Zhang Jun Lan Huijia Zhu Weiqiang Wang Xiaoyan Sun Shishun Tian Dongyang Yan Weixia Zhang Junlin Chen Wei Sun Zhihua Wang Zhuohan · 2025
Read VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Results by Yixiao Li * Xin Li * Chris Wei Zhou * Shuo Xing Hadi Amirpour Xiaoshuai Hao Guanghui Yue Baoquan Zhao Weide Liu Xiaoyuan Yang Zhengzhong Tu Xinyu Li Chuanbiao Song Chenqi Zhang Jun Lan Huijia Zhu Weiqiang Wang Xiaoyan Sun Shishun Tian Dongyang Yan Weixia Zhang Junlin Chen Wei Sun Zhihua Wang Zhuohan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06413.txt.
Introduction
Judging the quality of super-resolved images made by modern generative methods is the challenge summarized in a 2025 paper led by Yixiao Li with thirty co-authors. The VQualA challenge at ICCV 2025 built a dataset of images upscaled by GAN and diffusion methods, whose artifacts differ from classic super-resolution. One hundred eight participants registered; four teams submitted valid final solutions.
The paper describes the dataset, the competing methods, and the results, with the best submissions reaching state-of-the-art quality prediction on the benchmark. The project is public, and the authors aim to standardize how perceptually convincing, but possibly invented, detail in generated super-resolution gets scored.
Catalog record
| CREATOR | Yixiao Li * Xin Li * Chris Wei Zhou * Shuo Xing Hadi Amirpour Xiaoshuai Hao Guanghui Yue Baoquan Zhao Weide Liu Xiaoyuan Yang Zhengzhong Tu Xinyu Li Chuanbiao Song Chenqi Zhang Jun Lan Huijia Zhu Weiqiang Wang Xiaoyan Sun Shishun Tian Dongyang Yan Weixia Zhang Junlin Chen Wei Sun Zhihua Wang Zhuohan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06413
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Results Yixiao Li * Xin Li * Chris Wei Zhou * Shuo Xing Hadi Amirpour Xiaoshuai Hao Guanghui Yue Baoquan Zhao Weide Liu Xiaoyuan Yang Zhengzhong Tu Xinyu Li Chuanbiao Song Chenqi Zhang Jun Lan Huijia Zhu Weiqiang Wang Xiaoyan Sun Shishun Tian Dongyang Yan Weixia Zhang Junlin Chen Wei Sun Zhihua Wang Zhuohang Shi Zhizun Luo Hang Ouyang Tianxin Xiao Fan Yang Zhaowang Wu Kaixin Deng Abstract This paper presents the ISRGC-Q Challenge, built upon the Image Super-Resolution Generated Content Quality Assessment (ISRGen-QA) dataset, and organized as part of the Visual Quality Assessment (VQualA) Competition at the ICCV 2025 Workshops. Unlike existing Super-Resolution Image Quality Assessment (SR-IQA) datasets, ISRGen-QA places a greater emphasis on SR images generated by the latest generative approaches, including Generative Adversarial Networks (GANs) and diffusion models. The primary goal of this challenge is to analyze the unique artifacts introduced by modern super-resolution techniques and to evaluate their perceptual quality effectively. A total of 108 participants registered for the challenge, with 4 teams submitting valid solutions and fact sheets for the final testing phase. These submissions demonstrated state-of-the-art (SOTA) performance on the ISRGen-QA dataset. The project is publicly available at: https://github.com/Lighting-YXLI/ISRGen-QA . 0 0 footnotetext: * Yixiao Li ([email protected]), Xin Li ([email protected]), and Chris Wei Zhou ([email protected]) are the challenge organizers. Shuo Xing, Hadi Amirpour, Xiaoshuai Hao, Guanghui Yue, Baoquan Zhao, Weide Liu, Xiaoyuan Yang, and Zhenzhong Tu are the technical supporters of the challenge. (Corresponding author: Chris Wei Zhou ). The other authors are participants of the VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment. 0 0 footnotetext: VQualA webpage: https://vquala.github.io/ 0 0 footnotetext: The ISRGen-QA dataset: https://github.com/Lighting-YXLI/ISRGen-QA 1 Introduction Super-resolution (SR) image quality assessment metrics aim to evaluate the perceptual quality of SR images from a human-centric perspective. This necessity arises from the inherently ill-posed nature of the SR task, where a single low-resolution image may correspond to multiple plausible high-resolution reconstructions. As a result, SR faces a fundamental challenge in balancing fidelity (i.e., similarity to the ground truth) and naturalness (i.e., perceptual realism) [ 55 , 53 ] . Moreover, SR images exhibit distinct distortion characteristics that differ significantly from those found in traditionally degraded images. Conventional distortions (e.g., blur, noise, and compression artifacts) [ 56 ] typically stem from information loss and lead to perceptual degradation. In contrast, SR methods often introduce enhancement-induced artifacts, including over-sharpened edges, hallucinated or false textures, and unnatural reconstruction patterns. Consequently, accurately assessing the perceptual quality of SR images is crucial [ 16 , 54 ] —not only for evaluating but also for guiding the design and optimization of next-generation super-resolution algorithms. To assess the SR-specific distortions, several SR-IQA datasets have been built, including the QADS [ 52 ] , Waterloo [ 41 ] , SISR-IQA [ 32 ] , CVIU [ 23 ] , RealSRQ [ 7 ] , and SISAR [ 51 ] . The QADS [ 52 ] database contains 20 original HR references selected from the MDID database [ 28 ] , and 980 SR images created by 21 SR algorithms, including 4 interpolation-based, 11 dictionary-based, and 6 DNN-based SR models, with upsampling factors equaling 2, 3, and 4. Each SR image is associated with the mean opinion score (MOS) collected from 100 individuals. In the CVIU [ 23 ] database, 1,620 SR images are produced by 9 SR approaches from 30 HR references. The HR reference images are selected from BSD200 according to the PSNR values. Six pairs of scaling factors (i.e., 2, 3, 4, 5, 6, 8) and kernel widths (i.e., 0.8, 1.0, 1.2, 1.6, 1.8, 2.0) are adopted, where a larger subsampling factor corresponds to a larger blur kernel width. Each image is rated by 50 subjects, and the mean of the median 40 scores is calculated for each image as the MOS. The Waterloo [ 41 ] database involves 13 original HR references at 512×512 resolution, 39 low-resolution (LR) references, and 312 interpolated SR images generated by 8 interpolation algorithms, with upsampling factors of 2, 4, and 8. Subjective scores were collected from 30 participants aged 20–30 (17 males and 13 females). The SISR-IQA [ 32 ] database contains 15 ground-truth HR images selected from Set5, Set14, and BSD100, and 360 SR images reconstructed using 8 SR algorithms (e.g., DRCN [ 8 ] and VDSR [ 9 ] ) with upsampling factors of 2, 3, and 4. LR images were generated via nearest neighbor interpolation. Subjective quality scores for all 360 SR images were collected from 16 participants, who were unaware of the HR references and SR methods. The RealSRQ [ 7 ] database contains 60 real-world HR references and 180 corresponding LR images at three scaling factors (2, 3, 4). A total of 1,620 SR images were generated using 10 SISR algorithms, including 5 non-deep methods and 5 deep models (SRCNN [ 5 ] , CSCN [ 37 ] , VDSR [ 9 ] , SRGAN [ 10 ] , and USRnet [ 43 ] ). Subjective scores were collected from 60 participants (32 males and 28 females). The SISAR [ 51 ] database contains 12,600 SR images generated from 100 natural LR images. These images were processed using 10 SR algorithms or combinations, including 2 interpolation-based, 4 learning-based (SRCNN [ 5 ] , VDSR [ 9 ] , RCAN [ 50 ] , SAN [ 3 ] ), and 4 hybrid methods (e.g., SRCNN+BICUBIC). SR images were generated at 6 different scaling factors (i.e., 1.5, 2, 2.7, 3, 4, 3.6). Subjective scores were collected from 23 participants aged 20–30 with normal vision. Despite the progress in constructing SR-IQA databases, the super-resolution algorithms employed in these datasets have failed to keep pace with the rapid advancements in the field. For example, the most recent methods included are USRNet [ 43 ] (2020) and SAN [ 3 ] (2019), with SRGAN being the only generative adversarial network (GAN)-based approach represented. This lag significantly limits the effectiveness and generalizability of the resulting SR-IQA metrics in evaluating modern SR techniques. With the rapid advances of the generative methods in SR tasks, recent SR models have increasingly incorporated generative priors, particularly through GAN- and diffusion-based models [ 46 , 11 , 40 , 15 , 25 ] . While these methods have shown promising results, striking an effective balance between perceptual realism and reconstruction fidelity remains challenging. GAN-based approaches often yield high-fidelity metrics but may fail to capture vivid textures due to their unstable adversarial training and tendency toward over-optimization [ 39 ] . While diffusion models can produce detailed textures by leveraging powerful generative priors, their reliance on stochastic noise sampling and mismatches between prior and LR distributions can undermine pixel-level accuracy [ 42 ] . Consequently, the construction of subjective quality assessment datasets specifically involving SR images produced by the latest generative models is of paramount importance for facilitating the further refinement and advancement of SR techniques. In conjunction with the ICCV 2025 Workshop, we present the ISRGC-Q Challenge on image super-resolution generated content quality assessment. The goal of this challenge is to automatically evaluate the perceptual quality of super-resolved (SR) images, ensuring that the predicted