Optimizing Audio Compression Through Entropy-Controlled Dithering

Ellison Murray, Morriel Kasher, and Predrag Spasojevic Rutgers University New Brunswick, NJ, USA [email protected] [email protected] [email protected] · 2025

Read Optimizing Audio Compression Through Entropy-Controlled Dithering by Ellison Murray, Morriel Kasher, and Predrag Spasojevic Rutgers University New Brunswick, NJ, USA [email protected] [email protected] [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02293.txt.

Introduction

Ellison Murray, Morriel Kasher, and Predrag Spasojevic study how to improve audio compression, in two thousand twenty-five. Their focus is dithering, a step that adds a tiny amount of noise before sound is reduced. Done well, the step can keep sound quality higher at small file sizes.

The team tested standard and changed forms of one dithering method, with noise shaping and a control for randomness. They tried varied music, with shifts in pitch, loudness, rhythm, and instruments. One dither type beat the other in most tests, though results shifted with the signal. The work also adds a studio plugin that lets users set the controls themselves.

Catalog record

CREATOREllison Murray, Morriel Kasher, and Predrag Spasojevic Rutgers University New Brunswick, NJ, USA [email protected] [email protected] [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-02293

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Optimizing Audio Compression Through Entropy-Controlled Dithering Ellison Murray, Morriel Kasher, and Predrag Spasojevic Rutgers University New Brunswick, NJ, USA [email protected] [email protected] [email protected] Abstract This paper explores entropy-controlled dithering techniques in audio compression, examining the application of both standard and modified TPDFs, combined with noise shaping and entropy-controlled parameters, across various audio contexts, including variations in pitch, loudness, rhythm, and instrumentation. Perceptual quality metrics such as VISQOL and STOI were used to evaluate performance. The results demonstrate that TPDF-based dithering consistently outperforms RPDF, particularly under optimal alpha conditions, while highlighting performance variability based on signal characteristics. These findings suggest the situational appropriateness of using various TPDF distributions. This work emphasizes the trade-off between entropy and perceptual fidelity, offering insights into the potential of entropy-controlled dithering as a foundation for enhanced audio compression algorithms. A practical implementation as a Digital Audio Workstation plugin introduces customizable dithering controls, laying the groundwork for future advancements in audio compression algorithms. 1 Introduction Achieving exceptional audio quality is a central pursuit across diverse communities, including audiophiles, musicians, film enthusiasts, and fans eager to experience their favorite artists’ latest releases in pristine fidelity. As a musician working extensively with digital audio workstations, I have continually sought methods to optimize output quality while managing storage constraints—a challenge that resonates with many professionals in the field. Currently, lossless audio compression formats such as Apple Lossless Audio Codec (ALAC) and FLAC deliver high-quality sound [ 1 ] . However, these formats demand significantly more storage than their lossy counterparts, posing practical limitations for applications like streaming and large-scale storage [ 2 ] . With the growing demand for premium audio quality, balancing quality and storage efficiency has become increasingly critical. Recent research has explored distortion-controlled dithering in image compression, focusing on optimizing the trade-off between signal distortion and perceptual quality. This work introduced various distortion measures, including MSE, MACE 2 , and MSCE, to establish a framework for designing distortion-controlled dithered quantization systems, demonstrating its application in uniform dithering for image compression [ 3 ] . While several studies have investigated dithered quantization in audio and speech applications [ 4 ] , [ 5 ] , they fall short of addressing optimal dithering strategies for compression and distortion. These studies often overlook the contexts where dithering is most appropriate, leaving a gap in understanding its full potential in audio compression. This paper explores entropy-controlled dithering in audio compression, specifically employing Triangular Probability Density Functions (TPDFs) over Uniform or Rectangular Probability Density Functions (RPDFs). TPDFs are preferred for their ability to effectively decouple noise, reducing the perceptual prominence of artifacts compared to RPDFs [ 6 ] . This paper aims to achieve near-lossless audio compression by leveraging this technique while preserving perceptual quality. The scope of this research extends beyond evaluating compressibility and quality trade-offs in processed audio files. It seeks to assess the contexts in which this approach is most effective, considering additional techniques such as noise shaping. This paper aims to advance audio compression methods by addressing these objectives, making high-quality audio more accessible without compromising fidelity. 2 Background Quantization is a process used to compress data files by reducing the storage space required [ 7 ] . However, this process comes with a significant drawback: the loss of data. In certain types of compression, such as audio, this loss also leads to a decline in perceptual quality. For this reason, quantization is classified as a lossy compression method. This paper focuses on perceptual quality loss during quantization, which manifests as artifacts such as ringing, rattling, graininess, and other unwanted distortion [ 8 ] , which are direct consequences of data loss during quantization. The mean squared error (MSE) is considered for this project; however, it is not the primary focus of optimization since it does not account for perceptual distortions, but rather measures the similarity between the processed and distorted signals [ 5 ] . MSE is calculated using Equation 1, where x is the original audio signal, and \hat{x} is the processed audio signal. While this metric is useful for evaluating how much of the original audio information is retained, it does not fully capture perceptual audio quality [ 9 ] . In practical applications, minimizing this error corresponds to maximizing the preservation of the original audio signal’s fidelity to its intended form. MSE=d(x,\hat{x})=(x-\hat{x})^{2} (1) With the quantization process, the size to which the audio file is truncated is controlled by the number of bits that the audio signal is quantized. The bits are what determines the number of quantization levels, as it’s a function of the bits, given 2^{b} . So, for 8-bit quantization, the number of quantization levels will be 256. The way that the truncation in quantization works is by approximating the continuous signal amplitude values to the discrete quantization level values (See Fig. 1 ). The quantization employed in this paper involved reducing audio files, originally stored as 8-bit integers, to 3-bit resolution, resulting in 8 quantization levels. Figure 1: Inputted sine wave with amplitude 1 (blue) overlaid by quantized sine wave to 2 bits (red). A technique called dithering is often employed to mitigate the loss of perceptual quality introduced through quantization. Dithering involves adding a small, random noise signal to the data before quantization [ 7 ] . This additional noise smooths the transitions between quantization levels, effectively reducing perceptual artifacts and making them less noticeable. The comparison below highlights the differences between dithered quantization and regular quantization. Although dither signals are perceptible, they are generally not considered disruptive or ”annoying” to listeners. However, they can still slightly affect perceptual quality. Noise shaping can be applied to further optimize the dithering process. Noise shaping shifts the dither signal into frequency ranges where it is less perceptible to the human ear, based on the equal-loudness contour, which reflects the human ear’s sensitivity to different frequencies [ 9 ] . This refinement enhances the effectiveness of dithering while maintaining high perceptual quality. Figure 2: Quantized sinusoidal wave without dither applied. Without dithering, quantization becomes rough, distorting the original shape and resulting in a loss of detail. This quantization error manifests as perceptual artifacts due to its high correlation with the audio signal (See Fig. 2 ). Applying dithering retains more of the sine wave’s original shape by preserving the statistical behavior of the noise. (See Fig. 3 ) This process not only breaks the correlation between the signal and quantization error but also converts distortion into broadband noise instead of structured artifacts. Consequently, the quantization error becomes less perceptible to the human ear or measurement systems [ 7 ] . Figure 3: Quantized sinusoidal wave with dither applied. On the other hand, data compression relies on identifying and exploiting redundancies within the data to reduce its size. When dithering is applied, the increased randomness within the signal reduces these redundancies, making the data harder to compress [ 10 ] . Balancing this trade-off between perceptual quality and compressibility requires careful consideration. The application of dithering introduces more randomness—or entropy—into the signal, directly impacting its perceived quality and compressibility. Equation 2 is used to calculate entropy in bits. H(x)=-\sum_{i=1}^{M}p_{i}\log_{b}p_{i} (2) The trade that is subject to this project’s exploration can be modeled through the

Read the complete text