Low-Complexity Patch-based No-Reference Point Cloud Quality Metric exploiting Weighted Structure and Texture Features
Michael Neri, Federica Battisti · 2025
Read Low-Complexity Patch-based No-Reference Point Cloud Quality Metric exploiting Weighted Structure and Texture Features by Michael Neri, Federica Battisti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15001.txt.
Introduction
Michael Neri and Federica Battisti judge 3D point cloud quality without a reference copy in a 2025 paper. Compression and streaming can mar point clouds before a viewer sees them. When no clean original exists, quality must be guessed from the damaged cloud alone.
Their metric studies small patches of the cloud one at a time. Each patch yields structure and texture features, which are weighted and merged. A light learning stage turns those features into a score that mimics human opinion. Tests across three public data sets show solid prediction power. The method also transfers between data sets, and part-by-part checks confirm the patch design. Low complexity suits live streaming checks.
Catalog record
| CREATOR | Michael Neri, Federica Battisti |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-15001
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Low-Complexity Patch-based No-Reference Point Cloud Quality Metric exploiting Weighted Structure and Texture Features Michael Neri, Federica Battisti Abstract During the compression, transmission, and rendering of point clouds, various artifacts are introduced, affecting the quality perceived by the end user. However, evaluating the impact of these distortions on the overall quality is a challenging task. This study introduces PST-PCQA, a no-reference point cloud quality metric based on a low-complexity, learning-based framework. It evaluates point cloud quality by analyzing individual patches, integrating local and global features to predict the Mean Opinion Score. In summary, the process involves extracting features from patches, combining them, and using correlation weights to predict the overall quality. This approach allows us to assess point cloud quality without relying on a reference point cloud, making it particularly useful in scenarios where reference data is unavailable. Experimental tests on three state-of-the-art datasets show good prediction capabilities of PST-PCQA, through the analysis of different feature pooling strategies and its ability to generalize across different datasets. The ablation study confirms the benefits of evaluating quality on a patch-by-patch basis. Additionally, PST-PCQA’s light-weight structure, with a small number of parameters to learn, makes it well-suited for real-time applications and devices with limited computational capacity. For reproducibility purposes, we made code, model, and pretrained weights available at https://github.com/michaelneri/PST-PCQA . CNN Convolutional Neural Network DNN Deep Neural Network FR Full-Reference FPS Farthest Point Sampling GAP Global Average Pooling GCN Graph Convolutional Network GMP Global Max Pooling G-PCC Geometry-based Point Cloud Compression GVP Global Variance Pooling HVS Human Vision System k-NN k-Nearest Neighbour KRCC Kendall Rank Correlation Coefficient LiDAR Light Detection and Ranging ML Lachine Learning MLP multilayer perceptron MOS mean opinion score MPED Multiscale Potential Energy Discrepancy MSE Mean Squared Error NR No-Reference NSS Natural Scene Statistics PCQA Point Cloud Quality Assessment PLCC Pearson Linear Correlation Coefficient PST Patch-based Structure and Texture QoE Quality of Experience RMSE Root Mean Squared Error RF Random Forest RR Reduced-Reference SFE Structure Feature Extractor TFE Texture Feature Extractor SRCC Spearman Rank Order Correlation Coefficient SVR Support Vector Regression VGG Visual Geometry Group V-PCC Video-based Point Cloud Compression VR Virtual Reality I Introduction IN recent years, thanks to the increasing capability of 3D acquisition systems, point clouds have emerged as one of the most popular formats for immersive media [ 1 ] . Point clouds consist of a collection of points defined by geometric coordinates and optional attributes such as color and reflectivity. They provide the users with a more immersive experience than 2D content thanks to a realistic visualization and the possibility of interaction [ 2 ] . Point clouds might undergo several distortions during acquisition, transmission, and display [ 3 ] . Acquisition distortions refer to errors and inaccuracies that occur during the capture of 3D data, typically from sensors like LiDAR ( LiDAR ) or structured light cameras. When transmitting these data over networks, compression is often necessary to reduce the file size, thus introducing artifacts like noise, resolution loss, or geometric inaccuracies [ 4 , 5 ] . During the display phase, hardware limitations or rendering algorithms may further affect the quality, potentially resulting in visual inconsistencies or inaccuracies [ 5 ] . While compression artifacts [ 6 ] are the most common distortions affecting the rendered point cloud, several other types of distortions can occur, which usually affect geometry and color consistency by introducing noise [ 7 ] , degrading the overall visual quality of the content. Fig. 1: Description of the no-reference point cloud quality assessment task. From acquisition to rendering, the pristine point cloud is subject to several distortions that may impact the quality perceived by the user. Given that human observers are the primary users of point clouds in numerous applications, employing subjective quality assessment emerges as the most direct and dependable method for evaluating the quality of point clouds [ 8 ] . Despite its significance, subjective quality evaluation poses challenges due to its time-consuming nature and high cost. For the practical implementation of quality-focused point cloud systems, there is a strong demand for objective PCQA ( PCQA ) models capable of accurately predicting subjective quality assessments [ 9 ] . Objective quality estimators can be categorized into three classes: FR ( FR ), RR ( RR ), and NR ( NR ). FR metrics assess quality by comparing the target against an unaltered original, requiring complete access to original data. RR methods need only partial original data, e.g., compression parameters, thus balancing accuracy with data accessibility. NR architectures, instead, evaluate quality without any reference to the original, offering flexibility in real scenarios but potentially at the cost of precision (Figure 1 ). Moreover, the availability of pristine information may be difficult at the end user device, especially in broadcasting and telecommunication scenarios, thus motivating the development of no-reference metrics for immersive multimedia [ 10 ] . However, currently the literature lacks no-reference methods for efficient estimation of the quality of distorted point clouds [ 11 , 8 ] . (a) V-PCC (b) Gaussian noise (c) Downsampling (d) G-PCC Fig. 2: Examples of compression techniques applied to the House point cloud from WPC [ 12 ] dataset: (a) V-PCC with ’geometryQP’= 35 and ’textureQP’= 45 ; (b) Gaussian noise with standard deviation = 0 for points’ coordinates and 16 for points’ RGB values; (c) downsampling uniformly dividing the point cloud in 2^{8} segments; (d) G-PCC with trisoup, ’NodeSizeLog2’= 4 and RAHT quantization step= 64 . State-of-the-art NR PCQA metrics present several challenges: • non-ML methods exhibit low correlation between predicted and ground truth quality scores [ 13 , 14 ] ; • methods exploiting specific features extracted from the point clouds (e.g., texture and structure) are mainly working in a global way on the entire point cloud [ 15 ] ; • deep learning-based NR PCQA require a significant amount of computational resources and available datasets (also needed to reduce generalization issues) [ 16 , 17 , 18 ] . In this work, we introduce PST-PCQA, a low-complexity learning-based NR PCQA for non-sparse point clouds that outperforms state-of-the-art architectures. In more detail, PST-PCQA splits point cloud into patches from which texture and structure features are extracted. Those features are then combined to predict the overall quality. This approach is lightweight, i.e., the number of learnable parameters ( 1.8 M) is the lowest in the state-of-the-art, with a total decrease of 93 % with respect to the most efficient approach. This characteristic is crucial in devices where the computational load is limited and in applications where system response time should be real-time. Fig. 3: Description of the proposed approach. The main contributions of this paper are as follows: • the definition of a new lightweight NR PCQA , namely PST ( PST )- PCQA , that exploits texture and structure features of the point cloud; • a patch-wise quality estimation strategy. This approach allows the adoption of learned weights per patch and to improve explainability; • an extensive analysis on state-of-the-art datasets for NR PCQA to demonstrate the effectiveness of the approach. Comparisons with other methods in the literature are carried out. The remainder of this paper is structured as follows: Section II details the relevant works in the literature. Section