High Efficiency Wiener Filter-based Point Cloud Quality Enhancement for MPEG G-PCC

Yuxuan Wei, Zehan Wang, Tian Guo, Hao Liu, Liquan Shen, Hui Yuan · 2025

Read High Efficiency Wiener Filter-based Point Cloud Quality Enhancement for MPEG G-PCC by Yuxuan Wei, Zehan Wang, Tian Guo, Hao Liu, Liquan Shen, Hui Yuan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17467.txt.

Introduction

Yuxuan Wei and co-authors add a Wiener filter stage to MPEG's point cloud compression to clean up decoded quality, in a 2025 paper. Point clouds pack scenes into huge point sets, and the lossy side of the G-PCC standard leaves visible damage at low bitrates. The filter sits inside both encoder and decoder and is sharpened by inherited coefficients and a brightness-based sorting of points.

A fast neighbor search built on Morton codes keeps the added cost down. Tested under a standard lossless-geometry setup, the method saved roughly 6 to 8 percent of bitrate across color channels at equal quality. The gains target immersive media that streams detailed scenes.

Catalog record

CREATORYuxuan Wei, Zehan Wang, Tian Guo, Hao Liu, Liquan Shen, Hui Yuan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-17467

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

High Efficiency Wiener Filter-based Point Cloud Quality Enhancement for MPEG G-PCC Yuxuan Wei, Zehan Wang, Tian Guo, Hao Liu, Liquan Shen, Hui Yuan Abstract Point clouds, which directly record the geometry and attributes of scenes or objects by a large number of points, are widely used in various applications such as virtual reality and immersive communication. However, due to the huge data volume and unstructured geometry, efficient compression of point clouds is very crucial. The Moving Picture Expert Group is establishing a geometry-based point cloud compression (G-PCC) standard for both static and dynamic point clouds in recent years. Although lossy compression of G-PCC can achieve a very high compression ratio, the reconstruction quality is relatively low, especially at low bitrates. To mitigate this problem, we propose a high efficiency Wiener filter that can be integrated into the encoder and decoder pipeline of G-PCC to improve the reconstruction quality as well as the rate-distortion performance for dynamic point clouds. Specifically, we first propose a basic Wiener filter, and then improve it by introducing coefficients inheritance and variance-based point classification for the Luma component. Besides, to reduce the complexity of the nearest neighbor search during the application of the Wiener filter, we also propose a Morton code-based fast nearest neighbor search algorithm for efficient calculation of filter coefficients. Experimental results demonstrate that the proposed method can achieve average Bjøntegaard delta rates of -6.1%, -7.3%, and -8.0% for Luma, Chroma Cb, and Chroma Cr components, respectively, under the condition of lossless-geometry-lossy-attributes configuration compared to the latest G-PCC encoding platform (i.e., geometry-based solid content test model version 7.0 release candidate 2) by consuming affordable computational complexity. I Introduction Apoint cloud is a set of points that precisely describe the geometry and the corresponding attributes for the surface of an object or a scene [ 1 ] . It can be used extensively in fields such as virtual reality [ 2 ] , and metaverse [ 3 ] . However, its data volume is very huge, challenging the current network bandwidth and storage capacity. Effective point cloud compression is vital to address this challenge as well as enhancing real-time processing capabilities [ 4 ] . To promote the widespread application of point clouds, the Moving Picture Experts Group (MPEG) started the standardization of 3D point cloud compression in 2017 [ 5 ] , leading to two branches: video-based point cloud compression (V-PCC) [ 6 ] and geometry-based point cloud compression (G-PCC) [ 7 ] . As the 3D digital human and metaverse is becoming more and more popular, currently, a sub-branch of G-PCC, named as geometry-based solid content test model (GeS-TM), is specifically designed for the compression of dynamic solid (i.e., denser) point clouds [ 8 ] . Fig. 1: Encoding framework of GeS-TM. The modules within the dotted boxes are optional to perform. As shown in Fig. 1 , in GeS-TM, the geometry and attributes are compressed separately. Initially, coordinate conversion and voxelization are performed to convert point positions into non-negative integers. The encoding process begins with geometry encoding by using either trisoup [ 9 ] or octree [ 10 ] to generate geometry bitstream. The decoded geometry is then used to encode the attributes by using the region adaptive hierarchical transform (RAHT) [ 11 ] , i.e., a hierarchical transform that resembles an adaptive variation of a Haar wavelet. The transformed attributes are subsequently predicted, quantized and arithmetically encoded to generate the attribute bitstream. Additionally, as GeS-TM is primarily designed for dense dynamic point clouds, it also incorporates inter-octree coding with motion compensation [ 12 ] to enhance the compression efficiency [ 13 ] . Attribute quantization inevitably introduces distortion, especially when the quantization parameter (QP) is large. To improve the coding efficiency, quality enhancement for the reconstructed point cloud is an efficient way. Besides, for dynamic point cloud compression with inter prediction, the distortion of the reference frame can also propagate to subsequent frames, causing distortion accumulation [ 14 ] . Therefore, improving the quality of a reference frame (e.g., the first frame) can enhance the quality of the subsequent frames as well, and thus further improve the coding efficiency. Accordingly, we make the following contributions: • We first analyze the feasibility of Wiener filter for the reconstructed point clouds and propose a basic quality enhancement method for color attributes based on Wiener filter, namely BWF. • To improve the coding efficiency, we further propose a coefficients inheritance-based Wiener filter (CIWF) for inter-coded frames and a variance classification-based Wiener filter (VCWF) for Luma component. • To reduce the computational complexity, we also propose a Morton code-based fast k nearest neighbor search method (M-KNN) for fast derivation of filter coefficients. • Finally, by integrating the proposed Wiener filter into the latest G-PCC encoder, significant coding gain can be achieved. Specifically, for Luma, Cb, and Cr components, respectively, average Bjontegaard delta rates of -6.1%, -7.3%, and -8.0% can be achieved under the condition of lossless-geometry-lossy-attributes configuration. The remainder of this paper is organized as follows. In Section II , we briefly review related work about point cloud quality enhancement. In Section III , we analyze the statistical characteristic of reconstructed point clouds, based on which, we describe the proposed method in detail in Section IV . After that, in Section V , we give extensive experimental results to illustrate the advancement of the proposed method. Finally, we conclude this paper and discuss future work in Section VI . II Related work In recent years, technologies for point cloud compression have advanced rapidly, and a variety of quality enhancement methods for compressed point clouds also emerged. Most existing methods, however, focus on static point clouds. In this section, we first give an overview of quality enhancement methods for static point clouds, which can be roughly divided into traditional methods and neural network-based methods. Subsequently, a brief overview of quality enhancement methods for dynamic point clouds is given. II-A Quality Enhancement for Static Point Clouds Traditional quality enhancement methods mainly include Kalman filter-based methods [ 15 ] , Wiener filter-based methods [ 16 , 17 ] , and graph signal processing-based methods [ 19 , 20 , 21 , 22 , 23 , 24 ] . In the previous research, our team [ 15 ] proposed a Kalman filter-based method to improve not only the reconstruction quality but also the prediction accuracy in the compression pipeline. As Kalman filter is very sensitive to the stationary of signals, it is only efficient for the Chroma red difference and Chroma blue difference, i.e., Cr and Cb, components. For Luma component, its performance is trivial. Therefore, in [ 16 ] and [ 17 ] , we developed a Wiener filter-based quality enhancement method for both G-PCC and V-PCC to mitigate coding distortion of color attributes. However, the time complexity is extremely high due to the high complexity of KNN for nearest neighbor search, and the performance of Luma component is also far less than that of Chroma components. Besides, Lin et al. [ 18 ] proposed using median and bilateral filters to improve the color quality of point clouds, which is achieved by assigning the median or weighted average of the nearest neighbor attributes to the current point. This

Read the complete text