Rate-Distortion Optimized Skip Coding of Region Adaptive Hierarchical Transform Coefficients for MPEG G-PCC

Zehan Wang, Yuxuan Wei, Hui Yuan Wei Zhang, Peng Li · 2024

Read Rate-Distortion Optimized Skip Coding of Region Adaptive Hierarchical Transform Coefficients for MPEG G-PCC by Zehan Wang, Yuxuan Wei, Hui Yuan Wei Zhang, Peng Li (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-05574.txt.

Introduction

Zehan Wang and co-authors squeeze 3D point cloud video harder by skipping near-empty layers, in a 2024 paper. Point clouds capture scenes as swarms of dots, and the MPEG G-PCC standard packs them with a layered transform. In the last layers, most values sit at zero, yet bits still get spent sending them.

Their method decides, layer by layer, whether the leftovers are worth coding at all. A rate-distortion rule with a tuned penalty weight makes the call. On dynamic test clouds the scheme saved about 3.5 to 5.6 percent of bitrate across color channels against the reference software. Leaner streams ease the bandwidth bill for 3D video calls and virtual scenes.

Catalog record

CREATORZehan Wang, Yuxuan Wei, Hui Yuan Wei Zhang, Peng Li
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-05574

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Rate-Distortion Optimized Skip Coding of Region Adaptive Hierarchical Transform Coefficients for MPEG G-PCC Zehan Wang, Yuxuan Wei, Hui Yuan Wei Zhang, Peng Li Abstract Three-dimensional (3D) point clouds are becoming more and more popular for representing 3D objects and scenes. Due to limited network bandwidth, efficient compression of 3D point clouds is crucial. To tackle this challenge, the Moving Picture Experts Group (MPEG) is actively developing the Geometry-based Point Cloud Compression (G-PCC) standard, incorporating innovative methods to optimize compression, such as the Region-Adaptive Hierarchical Transform (RAHT) nestled within a layer-by-layer octree-tree structure. Nevertheless, a notable problem still exists in RAHT, i.e. , the proportion of zero residuals in the last few RAHT layers leads to unnecessary bitrate consumption. To address this problem, we propose an adaptive skip coding method for RAHT, which adaptively determines whether to encode the residuals of the last several layers or not, thereby improving the coding efficiency. In addition, we propose a rate-distortion cost calculation method associated with an adaptive Lagrange multiplier. Experimental results demonstrate that the proposed method achieves average Bjøntegaard rate improvements of -3.50%, -5.56%, and -4.18% for the Luma, Cb, and Cr components, respectively, on dynamic point clouds, when compared with the state-of-the-art G-PCC reference software under the common test conditions recommended by MPEG. I Introduction Athree-dimensional (3D) point cloud is composed of a large number of unordered points with 3D coordinates and their associated attributes (color, reflectance, etc.). It can be used to represent 3D shape and structure of objects and scenes, and can be extensively used in immersive communication, cultural heritage preservation, and autonomous driving [ 1 ] , etc. However, the data volume of 3D point cloud is extremely large, leading to a great challenge of efficient storage and transmission. Therefore, 3D point cloud compression was put on the agenda. Point cloud coding methods developed significantly in recent years, including transformation-based methods [ 2 ] , 3D-to-2D projection methods [ 3 ] , and deep learning-based approaches [ 4 , 5 ] . To promote the application of 3D point clouds, the Moving Picture Experts Group (MPEG) started to establish coding standards for 3D point cloud in 2017 [ 6 ] , and proposed three test models, i.e., test model category 1 (TMC1) [ 7 ] for static point clouds, test model category 2 (TMC2) [ 8 ] for dynamic point clouds, and test model category 3 (TMC3) [ 9 ] for radar point clouds. Later, as both TMC1 and TMC3 directly encode point clouds in 3D space, they are merged together and renamed as geometry-based point cloud compression (G-PCC) (the corresponding test model is named as TMC13) [ 10 ] , while TMC2 compresses 3D point clouds by converting them into 2D geometry and attribute videos and is named as video-based point cloud compression (V-PCC) [ 11 ] . Based on the requirement of immersive communication, to further improve the compression efficiency of solid (denser) and dynamic point clouds [ 12 ] , MPEG proposed a new branch of G-PCC, namely, geometry-based solid content test model (GeS-TM), in 2023. This paper focuses on this new branch of G-PCC. Fig. 1: G-PCC encoding and decoding frameworks. The yellow, green, and blue colors represent data processing, geometry processing, and attribute processing, respectively. The encoding and decoding frameworks of G-PCC are illustrated in Fig. 1 . In the encoding stage, the encoder first converts the coordinates of the input 3D point cloud to normalized coordinates that can be uniformly processed by the encoder. Subsequently, after geometry quantization and removal of redundant points, the point cloud is voxelized, and then encoded by using methods such as trisoup [ 13 ] , octree [ 14 ] , or predictive tree [ 15 ] , to generate the corresponding geometry bitstream. Next, the reconstructed geometry information is used for attribute encoding in which three methods, i.e., region-adaptive hierarchical transform (RAHT) [ 16 ] , levels of detail (LoD)-based predictive transform (PT) [ 17 ] , and lifting transform (LT) [ 18 ] , can be selected. Arithmetic entropy coding is then applied to the transformed coefficients to generate the corresponding attribute bitstream. In the decoding stage, the geometry bitstream is first subjected to arithmetic decoding to obtain the reconstructed geometry. The reconstructed geometry is then transformed back through inverse coordinate conversion. Simultaneously, the reconstructed geometry and attribute bitstreams are jointly fed into the decoder for arithmetic decoding and inverse quantization. Furthermore, based on the attribute encoding methods (i.e, RAHT, PT, and LT), the decoder performs corresponding inverse transformations to reconstruct the attribute information [ 19 , 20 ] . In this paper, we focus on RAHT which is the unique transform method in GeS-TM. RAHT is based on 3D Haar wavelet transform with an octree structure and proceeds from the root node (the upmost layer) to the leaf nodes (the bottommost layer) of the octree. The transform generates alternating-current (AC) coefficients and direct-current (DC) coefficients. The encoder encodes AC coefficients layer by layer. To reduce temporal and spatial redundancy of AC coefficients, G-PCC introduces intra-frame and inter-frame prediction for the transformed coefficients, therefore the encoder only needs to encode the residuals between the coefficients and its predicted counterpart [ 21 , 22 ] . However, there are a large number of near-zero AC residuals in the lower layers of the octree, leading to significant redundancy in the bitstream. To further improve encoding efficiency, we propose a skip coding method for the residuals of RAHT by using Rate-Distortion (RD) Optimization (RDO) to adaptively determine whether to encode the residuals of each layer or not. Additionally, we also introduce a new rate-distortion cost calculation method associated with an adaptive Lagrange multiplier. The rest of the paper is organized as follows. In Section II, we briefly review related work. In Section III, we describe the technical details of the proposed method. Experimental results and conclusions are given in Sections IV and V, respectively. II Related Work Research on point cloud compression has made notable progress in recent years, accompanied by ongoing enhancements and optimizations in G-PCC standard. Queiroz et al proposed region-adaptive hierarchical transform in [ 16 ] which was adopted by G-PCC as a transform coding method for dense point clouds. RAHT relies on a pre-partitioned octree structure, where each non-empty voxel block (namely a transform block hereafter) contains 2×2×2 sub-blocks (namely sub-blocks hereafter). Within each transform block, RAHT uses a Haar wavelet transform in the X, Y, and Z directions, respectively. The specific transformation formulas for the Haar transform of 2 sub-blocks are as follows: \begin{bmatrix}DC\\ AC\end{bmatrix}=\begin{bmatrix}a&-b\\ a&b\end{bmatrix}\begin{bmatrix}A_{1}\\ A_{2}\end{bmatrix}, (1) where a=\sqrt{w_{1}/(w_{1}+w_{2})} , b=\sqrt{w_{2}/(w_{1}+w_{2})} , A_{1},A_{2} represent the sum of attributes within the two transform sub-blocks, w_{1},w_{2} represent the number of points within the two transform sub-blocks. For each transform block with 8 sub-blocks, we can obtain one DC coefficient and seven AC coefficients. The process of RAHT is illustrated in Fig. 2 . Fig. 2: The process of RAHT. Take the points in the current node as an example, first, a 3D Haar Wavelet transform is performed along with the Y direction to obtain 3 immediate DC coefficients and 2 AC coefficients; second, the 3 immediate DC coefficients are further transformed along with the Z

Read the complete text