Accelerating Merge with Motion Vector Difference via Filter Difference Analysis for VVenC

double-blind submission, Xinmin Feng 1 , Shengyang Xu 2 , Jianhua Chen 2 , Li Li 1 , Dong Liu 1,† , Feng Wu 1 · 2026

Read Accelerating Merge with Motion Vector Difference via Filter Difference Analysis for VVenC by double-blind submission, Xinmin Feng 1 , Shengyang Xu 2 , Jianhua Chen 2 , Li Li 1 , Dong Liu 1,† , Feng Wu 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31084.txt.

Introduction

Feng and five colleagues speed up a costly tool inside VVenC, the reference encoder for the Versatile Video Coding standard. The tool, Merge with Motion Vector Difference, refines a block's motion by trying many direction and distance offsets, which improves prediction but makes the encoder search exhaustively and slowly. Their goal is to skip candidates that cannot pay off.

The team approximates the encoder's 8-tap interpolation filter with a 2-tap version and derives a criterion from spatial gradients and prediction residuals that estimates each candidate's likely gain. Implementation tricks, including symmetric offset inference and a cross-shaped downsampled dot product, keep the added cost tiny. Against existing fast methods, their algorithm cuts the average search ratio from 21.07 percent to 11.05 percent.

Catalog record

CREATORdouble-blind submission, Xinmin Feng 1 , Shengyang Xu 2 , Jianhua Chen 2 , Li Li 1 , Dong Liu 1,† , Feng Wu 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.31084

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Accelerating Merge with Motion Vector Difference via Filter Difference Analysis for VVenC Thanks: This work was supported by Hupan Laboratory through Hupan Laboratory Research Intern Program. double-blind submission, Xinmin Feng 1 , Shengyang Xu 2 , Jianhua Chen 2 , Li Li 1 , Dong Liu 1,† , Feng Wu 1 Abstract Merge with Motion Vector Difference (MMVD) is a key coding tool in Versatile Video Coding for improving motion prediction accuracy. However, its exhaustive search strategy imposes a significant computational burden on the encoder. To address this issue, we propose a novel fast MMVD algorithm for the VVenC encoder based on fractional motion vector filter difference analysis. By approximating the 8-tap interpolation filter with a 2-tap filter, we derive a criterion based on spatial gradients and prediction residuals for estimating the potential gain of MMVD candidates. We further generalize this criterion to accommodate both shifted integer reference samples and 2D separable filtering. To minimize the overhead of the proposed method, we introduce implementation optimizations, including symmetric offset inference and cross-shaped downsampled dot-product computation. Compared with existing fast MMVD algorithms in VVenC, our method reduces the average MMVD search ratio from 21.07% to 11.05% and decreases the efficiency-complexity metric η \eta from 11.79 to 7.10 under the fast preset. I Introduction Merge mode is a key technique in modern video coding standards for exploiting spatial and temporal redundancies. Adopted in both High Efficiency Video Coding (HEVC) [ 12 ] and Versatile Video Coding (VVC) [ 3 ] , it reduces motion vector (MV) bitrate by reusing motion information from a list of merge candidates for the current coding unit (CU). In HEVC, this list is built from spatial and temporal neighbors. VVC enhances it with history-based [ 7 ] and subblock-based motion vector prediction [ 9 ] , geometric partitioning [ 5 ] , and combined inter-intra prediction [ 13 ] . It also incorporates decoder-side motion vector refinement [ 4 ] and Merge with Motion Vector Difference (MMVD) [ 6 ] for higher motion precision. Unlike standard merge mode, MMVD allows signaling an additional motion vector difference (MVD) to refine the selected base motion. Specifically, MMVD selects one of the first two merge candidates as the base motion. The refinement is represented by a direction and a distance. Four directions, including 0°, 90°, 180°, and 270°, are supported, with the direction index signaled in the bitstream. As shown in Table I , two predefined distance tables [ 10 ] , each containing eight entries, define the offset magnitude. The encoder selects one table at the picture level and signals a distance index for the MVD. Though effective in coding, MMVD significantly increases encoding complexity because of exhaustive search over all direction–distance combinations. Specifically, enabling MMVD in VVenC introduces encoding time overheads of 36.39% and 21.20% under the faster and fast presets, respectively, hindering its usage in low-latency scenarios. TABLE I : Distance tables (in unit of luma samples) used in MMVD. Index 0 1 2 3 4 5 6 7 Table 1 1/4 1/2 1 2 4 8 16 32 Table 2 1 2 4 8 16 32 64 128 (a) (b) Fig. 1 : Illustration of MMVD search process. (a) MMVD Search Process. (b) Distribution of MMVD steps. In this paper, we focus on accelerating MMVD from the perspective of fractional motion vector filter difference analysis. As shown in Fig. 1 (b), existing MMVD modes still require evaluating a large portion of quarter-pixel MVD candidates, which accounts for 60% \sim 80% of total trials. To alleviate this issue, we propose a residual-gradient criterion that estimates whether a given MMVD direction is likely to provide coding gain. The criterion is first derived for a 1D interpolation case where regular merge and MMVD use the same integer-positioned reference samples. We then extend it to practical cases where MMVD offsets crosses an integer-sample boundary, causing the interpolation support to shift by one sample, as well as to 2D separable filtering. In addition, we introduce several engineering optimizations, including symmetric offset inference and efficient dot-product computation, to reduce the overhead of the proposed method itself. Experimental results on the VVenC encoder demonstrate that, across multiple presets, our approach achieves a better trade-off between encoding complexity and RD performance than existing MMVD acceleration schemes. II Methodology In this section, we present an efficient method for accelerating MMVD in VVC by reusing the regular-merge prediction and the spatial gradients of the reference blocks. The core idea is to approximate the 8-tap fractional motion compensation filters with 2-tap filters and derive a lightweight criterion for early termination of non-promising MMVD directions. II-A MMVD Prediction Approximation Fig. 2 : Illustration of the integer-positioned reference samples used by the regular-merge and MMVD predictions using a 2-tap interpolation filter as an example. The fractional MV of regular merge and MMVD, denoted as i and j , respectively, may use either (a) the same pair of integer-positioned reference samples, referred to as the aligned-support case, or (b) different sample pairs after a one-sample support shift, referred to as the shifted-support case. We first distinguish two cases based on whether MMVD changes the integer-positioned reference samples used for interpolation, as shown in Fig. 2 . Specifically, let i\in\{0,\ldots,15\} denote the fractional phase of the regular-merge MV along one dimension, and let \Delta denote the MMVD offset in 1/16 -sample units. The refined position of MMVD q:=i+\Delta can be decomposed as s=\left\lfloor q/16\right\rfloor and j=q-16s\in\{0,\ldots,15\} , where j is the refined fractional phase and s is the corresponding integer-position shift. s=0 indicates that regular merge and MMVD use the same pair of integer-positioned reference samples, whereas s=\pm 1 indicates that MMVD uses an adjacent pair. In this paper, we refer to these two cases as the aligned-support and shifted-support cases, respectively. In the aligned-support case, both predictions are interpolated from the same reference block: \bm{P}_{i}=\bm{P}_{\text{ref}}*\widetilde{\bm{H}}[i] and \bm{P}_{j}=\bm{P}_{\text{ref}}*\widetilde{\bm{H}}[j] , where \widetilde{\bm{H}}[i] and \widetilde{\bm{H}}[j] are the corresponding 8-tap DCT-IF filters. As shown in Fig. 3 , the main coefficients of the interpolation filter are concentrated on two neighboring integer samples. Therefore, we approximate the 8-tap filter \widetilde{\bm{H}} with a 2-tap filter \bm{H}=[H^{(0)},H^{(1)}] , where H^{(0)}+H^{(1)}=64 . The difference between the two approximated filters is \Delta\bm{H}_{i,j}=\bm{H}[j]-\bm{H}[i]=\alpha_{i,j}\bm{D},\quad\bm{D}=[-1,1], (1) where \alpha_{i,j}=H_{i}^{(0)}-H_{j}^{(0)} is precomputed for each phase pair. Thus, the MMVD prediction can be approximated as \bm{P}_{j}\approx\bm{P}_{i}+\alpha_{i,j}(\bm{P}_{\text{ref}}*\bm{D})=\bm{P}_{i}+\alpha_{i,j}\bm{g}_{\text{ref}}, (2) where \bm{g}_{\text{ref}} is the spatial gradient of the reference block along the MMVD direction. Let \bm{O} be the original block and \bm{e}_{i}=\bm{O}-\bm{P}_{i} be the residual of the regular-merge candidate. The distortion of the MMVD candidate is approximated as d_{i,j}=\|\bm{O}-\bm{P}_{j}\|^{2}\approx\|\bm{e}_{i}-\alpha_{i,j}\bm{g}_{\text{ref}}\|^{2}. (3) Expanding this term yields d_{i,j}\approx\|\bm{e}_{i}\|^{2}+\alpha_{i,j}^{2}\|\bm{g}_{\text{ref}}\|^{2}-2\alpha_{i,j}\langle\bm{e}_{i},\bm{g}_{\text{ref}}\rangle. (4) The key observation is that the potential gain of the MMVD candidate is mainly determined by the sign of the inner-product term -\langle\bm{e}_{i},\bm{g}_{\text{ref}}\rangle . If -\alpha_{i,j}\langle\bm{e}_{i},\bm{g}_{\text{ref}}\rangle\geq 0 , the MMVD candidate is unlikely to achieve lower distortion than regular merge, and its evaluation can therefore be skipped. We further extend the analysis to the shifted-support case. As shown in Fig. 2 (b), the union of the two supports contains three integer samples, which can be factorized using the same differential kernel: \bm{\Delta H}_{i,j}=\begin{cases}-\bm{D}*[{H}_{j}^{(0)},\,{H}_{i}^{(1)}],\text{ leftward shift},\\ \phantom{-}\bm{D}*[{H}_{i}^{(0)},\,{H}_{j}^{(1)}],\text{ rightward shift}.\end{cases} (5) Thus, the gradient \bm{g}_{\text{ref}} only needs to be computed once. The final prediction adjustment

Read the complete text