Causal Disentanglement for Full-Reference Image Quality Assessment

Zhen Zhang, Jielei Chu, Tian Zhang, Fengmao Lv, Tianrui Li · 2026

Read Causal Disentanglement for Full-Reference Image Quality Assessment by Zhen Zhang, Jielei Chu, Tian Zhang, Fengmao Lv, Tianrui Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21654.txt.

Introduction

Zhen Zhang and colleagues rethink full-reference image quality assessment, which judges a distorted image against its pristine original, through causal disentanglement rather than direct feature comparison. They split degradation from content, model how content masks degradation through a visual masking module, and predict quality from the isolated degradation features with or without labels. The method competes with leading systems on standard benchmarks and generalizes better across underwater, medical, and other scarce-data image domains.

Catalog record

CREATORZhen Zhang, Jielei Chu, Tian Zhang, Fengmao Lv, Tianrui Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71988
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.21654

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Causal Disentanglement for Full-Reference Image Quality Assessment Zhen Zhang, Jielei Chu, Tian Zhang, Fengmao Lv, Tianrui Li Abstract Existing deep network-based full-reference image quality assessment (FR-IQA) models typically rely on pairwise comparisons of deep features from reference and distorted images. Although effective on standard IQA benchmarks, existing FR-IQA methods still face two major limitations. Training-dependent methods require labeled IQA data for supervised optimization, but reliable quality annotations are difficult to obtain because they rely on subjective experiments. Training-free methods avoid supervised training, but their fixed perceptual priors limit their adaptability to non-standard or domain-specific image scenarios. To address these limitations, we propose a novel FR-IQA paradigm based on causal disentanglement representation learning. Unlike conventional feature comparison-based methods, our approach formulates degradation estimation as a causal disentanglement process guided by interventions on latent representations. Specifically, we first decouple degradation and content representations by exploiting the content invariance between reference and distorted images. Inspired by the human visual masking effect, we then design a masking module to model the causal influence of image content on degradation features, thereby extracting content-influenced degradation representations from distorted images. Finally, quality scores are predicted from these representations using either supervised regression or label-free dimensionality reduction. Extensive experiments show that our method achieves highly competitive performance on standard IQA benchmarks under fully supervised, few-label, and label-free settings. Moreover, on diverse non-standard image domains with scarce data, including infrared, neutron, screen-content, medical, and tone-mapped images, our method exhibits stronger MOS-free domain adaptation than existing training-free FR-IQA models. Cdoe: https://github.com/yuchen152/Causal-Disentanglement-for-Full-Reference-Image-Quality-Assessment I Introduction Image quality assessment can help operators screen and provide high-quality digital images to their subscribers. Therefore, developing image quality assessment (IQA) methods that align well with human subjective perception becomes extremely important. IQA can be categorized into full-reference IQA (FR-IQA) [ 49 , 55 , 38 ] , reduced-reference IQA (RR-IQA) [ 37 ] , and no-reference IQA (NR-IQA) [ 30 ] . FR-IQA models are generally believed to be less practical than NR-IQA models because of their reliance on pristine images. However, recent studies [ 7 , 8 , 24 ] have shown that FR-IQA models can guide perceptual image enhancement, a task that poses challenges for many NR-IQA models [ 58 ] . As such, FR-IQA models remain crucial. Fig. 1: (a) shows the typical FR-IQA architecture. Most deep FR-IQA models compute the differences between feature maps to predict quality scores. (b) shows the proposed FR-IQA architecture, where we extract content-influenced degradation features to predict quality scores. FR-IQA obtains quality assessment results by determining the difference between the distorted image and the reference image. In previous studies, this difference was usually regarded as a measure of the distance between these images. As shown in Figure 1 , deep network-based FR-IQA models often employ deep learning for feature decomposition and score pooling. These FR-IQA models typically extract feature maps from both distorted and reference images, and compute their differences to derive quality scores. Deep network-based FR-IQA methods can be categorized into end-to-end deep learning models (training-dependent) and training-free models. Although these methods have achieved great success in the field of FR-IQA, several limitations remain. Training-dependent methods [ 7 , 2 , 25 ] rely on large-scale labeled IQA data. However, due to the high subjectivity of human perception, obtaining reliable ground truth typically necessitates a large panel of human observers to conduct exhaustive scoring or ranking (e.g., MOS). Consequently, this heavy reliance restricts their scalability and applicability, particularly in data-scarce or emerging domains (e.g., infrared or screen-content images). Moreover, training-free [ 16 , 41 , 23 , 62 ] methods typically leverage pre-trained models (e.g., VGG [ 45 ] , EfficientNet [ 47 ] ) trained on ImageNet to extract feature maps from both reference and distorted images. They then compute the distance between these maps to derive the quality scores. However, these methods cannot be readily adapted to specific datasets, leading to severe performance drops in some scenarios. For instance, DBIQA [ 25 ] demonstrated that DeepWSD [ 22 ] only achieves excellent performance in limited scenarios. Therefore, it is essential to develop an FR-IQA method that does not rely on subjective quality annotations and can be efficiently adapted to specific datasets. In this work, we propose a method based on causal disentanglement representation learning that can be efficiently adapted to diverse scenarios (e.g., image enhancement or radiographic imaging) without the need for costly Mean Opinion Score (MOS) annotations. To achieve this label-free adaptability, the key lies in establishing unsupervised paradigms for both training and prediction. For the training phase, our approach is built upon the premise that a distorted image fundamentally comprises two components: image content and image degradation. In FR-IQA, distorted images are typically synthesized by applying degradations to reference images. This generation process not only validates this premise but also guarantees that the image content remains strictly identical between the reference and the distorted images. By exploiting this image content invariance, we can decouple the degradation features from the image content in an unsupervised manner. However, merely decoupling image degradation is insufficient to fully simulate human subjective perception. According to the visual masking effect (VME), the Human Visual System (HVS) exhibits varying sensitivities to the same distortion depending on the underlying image content. For example, noise is highly visible in smooth areas (e.g., a clear sky) but nearly imperceptible in textured ones (e.g., dense grass). This phenomenon reveals that human perception of image degradation is affected by the interaction between image content and distortion. Because image content influences the visibility of degradation, it is imperative to explicitly model how image content influences the degradation representation. To this end, we propose a method based on causal disentanglement representation learning to extract content-influenced degradation features. In the prediction phase, employing supervised or few-shot regression allows the model to explicitly map these causal features to subjective scores, thereby achieving a finer alignment with human visual perception. When MOS annotations are unavailable, absolute quality prediction is not identifiable without additional supervision. Therefore, the zero-shot setting is evaluated as relative ranking rather than MOS fitting. Specifically, based on the analysis above, the learned content-influenced degradation feature is assumed to be primarily governed by a latent perceptual quality variable, so that its quality-relevant variation lies near a low-dimensional manifold in the high-dimensional feature space. Under this view, the intrinsic geometry of the feature manifold reflects the relative perceptual severity of distortions. We thus employ UMAP to recover a one-dimensional embedding that preserves the local neighborhood structure of the learned feature space. The resulting coordinate serves as a relative quality descriptor, enabling zero-shot quality ranking and discrimination without relying on MOS supervision. The main contributions of this work are summarized as follows. \bullet We propose a new causal disentanglement architecture for FR-IQA, which departs from conventional pairwise feature comparison. The proposed architecture decouples content and degradation representations by exploiting the content invariance between reference and distorted images, and further incorporates content-conditioned causal modulation to model the visual masking effect. \bullet Extensive experiments demonstrate that the proposed method achieves highly competitive performance on standard IQA benchmarks. Our model exhibits consistent robustness across fully supervised, few-label, and MOS-free settings. \bullet Comprehensive cross-domain experiments on diverse, non-standard image domains (e.g., screen-content, radiographic,

Read the complete text