Evaluating the Effect of Compression on Video Temporal Consistency Using Objective Quality Metrics
Peter Zsoldos · 2026
Read Evaluating the Effect of Compression on Video Temporal Consistency Using Objective Quality Metrics by Peter Zsoldos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18378.txt.
Introduction
Peter Zsoldos studies how video compression harms temporal consistency, the frame-to-frame steadiness viewers see as flicker or shaky texture. Testing AV1, HEVC, VP9, and H.264 at varied rates in 2026, he finds it falls unevenly as compression tightens. Clips with unpredictable motion suffer worse instability than busier but predictable motion. This challenges the idea that motion volume alone sets encoding difficulty.
Catalog record
| CREATOR | Peter Zsoldos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19871 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18378
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating the Effect of Compression on Video Temporal Consistency Using Objective Quality Metrics Thanks: The author thanks the EMJM Imaging program for their valuable support. Peter Zsoldos Abstract While video compression algorithms effectively reduce bitrate, aggressive quantization often compromises temporal coherence, introducing artifacts such as flicker, motion inconsistency, and unstable textures. Although spatial quality degradation is well-documented, the relationship between compression intensity and temporal stability remains insufficiently characterized. This paper systematically examines the progression of frame-to-frame coherence errors across different bitrate regimes, utilizing multiple codecs (AV1, HEVC, VP9, H.264) and content types. Our findings reveal that temporal consistency degrades non-linearly with increasing compression. Most critically, we identify a “Predictability anomaly” where sequences with unpredictable or irregular dynamics experience disproportionately higher instability than sequences with higher, but more predictable, motion magnitude. This challenges the conventional assumption that motion volume alone dictates encoding difficulty and highlights the necessity of temporal-aware metrics in compression pipelines. I Introduction Video compression is fundamental to modern streaming and real-time communication, enabling efficient transmission by removing spatial and temporal redundancies. While modern codecs achieve impressive bitrate reductions, they inevitably introduce distortions that manifest over time. Among these, temporal inconsistencies—such as frame-to-frame flicker, “floating” textures, and motion jitter—are critically important yet often overlooked by traditional spatial quality assessments. Existing research has extensively characterized spatial artifacts like blocking and blurring. However, most current assessments rely on frame-by-frame metrics like PSNR, which fail to capture the dynamic lack of coherence that severely impacts human perceptual quality in motion-heavy content. To bridge this gap, we distinguish ”temporal consistency”—the preservation of visual features like texture and brightness over time—from ”temporal stability,” which we define as the encoder’s ability to maintain a reliable inter-frame prediction loop without reverting to frequent I-frame ”resets” that cause flickering or ”breathing” artifacts . This work addresses the resulting research gap by systematically analyzing how varying compression levels influence these temporal properties across four codec generations: H.264, HEVC, VP9, and AV1. By utilizing a suite of objective temporal metrics, we quantify the onset of artifacts and identify a critical non-linear relationship between content complexity and stability. Uniquely, our findings challenge the assumption that motion volume is the primary driver of compression difficulty; we reveal that unpredictable dynamics cause significantly greater instability than high-magnitude, structured motion. II Related Work The impact of video compression on temporal coherence has been studied through artifact detection, quality assessment, and post-processing [ 3 ] . Lossy compression introduces distinct temporal artifacts, such as flickering and “floating” textures, which traditional frame-by-frame metrics (e.g., PSNR, SSIM) fail to capture [ 4 ] . To address this, Lin et al. developed the PEA265 database and SSTAM metric, demonstrating the perceptual significance of these spatio-temporal distortions [ 5 , 6 ] . Recognizing these limitations, researchers have proposed metrics that integrate temporal information, ranging from the Spatio-Temporal SSIM (ST-SSIM) [ 13 ] and motion-compensated filtering [ 9 ] to recent two-stream deep learning networks that explicitly model temporal degradation [ 2 ] . While frameworks like Q-STAR have modeled the trade-offs between resolution and quantization [ 7 ] , they often overlook frame-to-frame coherence under bitrate-driven constraints. This leaves a critical gap in understanding how compression intensity specifically influences temporal stability, motivating the systematic investigation presented in this study. This study aims to answer the following research question: How do successive generations of video codecs (H.264 through AV1) balance bitrate efficiency with temporal stability, and to what extent does motion predictability, rather than simple motion volume—dictate the onset of temporal artifacts and the reliability of objective quality metrics? III Methodology The code for this paper can be reached at: https://github.com/Hannibal0319/video_compression III-A Datasets and Complexity Grouping We utilized two benchmark datasets: the Ultra Video Group (UVG) dataset (1080p, 50fps) [ 12 ] , the HEVC Class B dataset (1080p, 24–60fps) [ 10 ] and the BVI-HD dataset (1080p, 50–120fps) [ 14 ] , providing a wider variety of textures and motion patterns. From these sources, a total of 44 aggregated sequences were selected for evaluation. To systematically evaluate motion dynamics, we categorize the sequences using Temporal Information (TI) . TI is defined as the maximum standard deviation over time of the space-time difference between consecutive frames, representing the ”dynamic energy” or motion volume within a sequence. The 44 aggregated sequences were sorted by their TI values and divided into four quartiles to analyze the impact of different motion types: • TI Group 1 (Static): 0–25 th percentile; contains content with stationary backgrounds and minimal movement. • TI Group 2 (Predictable Motion): 25–50 th percentile; low-to-medium motion with high temporal structure. • TI Group 3 (Unpredictable Dynamics): 50–75 th percentile; medium-to-high irregular motion (e.g., water, crowds) where motion vectors lack clear structure. • TI Group 4 (Global Motion): 75–100 th percentile; high-magnitude but structured motion, such as consistent camera pans. This stratification ensures a balanced evaluation across diverse motion characteristics. III-B Codecs and Compression Settings We evaluated four codecs representing different generations: H.264, HEVC, VP9, and AV1. VVC was left out, because restricting its bitrate, which is crucial for fair comparison, prevents it from using its strongest RDO and partitioning behavior. This is not its intended use. All encodings were performed using FFmpeg libraries with parameters optimized for perceptual quality while constraining rate control. A summary of the encoder configurations is provided in Table I . TABLE I: Codec Configurations and Encoder Settings Codec Encoder Key Parameters H.264 libx264 slow , 8-bit, faststart HEVC libx265 slow , 10-bit, aq-mode=3 VP9 libvpx-vp9 row-mt 1 AV1 libsvtav1 preset 4 , rc=1 Videos were encoded at 7 compression levels and the target bitrate was defined as \text{Bitrate}=L\times 1000~\text{kbps} , where L represents the scaling factor i.e. the compression level. The levels computed were: 1, 1.5, 2, 2.5, 3, 4 and 8. III-C Evaluation Metrics To quantify the impact of compression, we employed a comprehensive set of metrics: • Spatial Quality: PSNR, SSIM, and VMAF [ 1 ] . • Temporal Consistency: This study utilizes metrics that explicitly model inter-frame dynamics. ST-RRED [ 8 ] calculates the fluctuation of information content across space and time to detect instabilities missed by spatial-only assessments. The MOVIE Index evaluates quality along motion trajectories, identifying distortions like ”floating” textures by tracking how errors manifest along the path of moving objects. Additionally, T-SSIM and T-PSNR are used to measure structural and signal-level coherence between consecutive frames. • Generative Quality: Fréchet Video Distance (FVD) [ 11 ] was used to measure feature distribution discrepancies. • Rate-Distortion Efficiency: Bjøntegaard Delta (BD) Rate curves were computed to quantify the average percentage difference in bitrate required to achieve the same objective quality between the tested codecs and the anchor. IV Results IV-A Objective Performance Hierarchy The objective analysis confirms a clear generational performance hierarchy across all tested codecs. As illustrated in the BD-Rate comparisons (Fig. 1 ), AV1 consistently yields the highest Rate-Distortion (R-D) performance, offering the best quality for a given bitrate. HEVC follows closely, tracking AV1’s performance and significantly outperforming legacy standards. While VP9 generally provides superior efficiency compared to H.264 , the performance gap between them narrows at higher bitrates. Fig. 1: Average BD-Rate Scores - BVI-HD Dataset. The matrices compare the Bjøntegaard Delta Rate (BD-Rate) of tested codecs