Nonlocal Prior Mixture-Based Bayesian Wavelet Regression with Application to Noisy Imaging and Audio Data

Nilotpal Sanyal Department of Mathematical Sciences, University of Texas at El Paso, [email protected] · 2025

Read Nonlocal Prior Mixture-Based Bayesian Wavelet Regression with Application to Noisy Imaging and Audio Data by Nilotpal Sanyal Department of Mathematical Sciences, University of Texas at El Paso, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18134.txt.

Introduction

Nilotpal Sanyal builds a Bayesian wavelet method that treats small and large signal pieces with different priors. Wavelet coefficients in noisy data span many scales, so one prior shape fits poorly. The prior here mixes a spike at zero with two slabs: a moment prior for modest coefficients and an inverse moment prior with heavy tails for the big ones. Mixture weights and scales follow new decay recipes, tuned by empirical Bayes.

Simulations beat two-component wavelet rivals by clear margins. Fits to brain wave recordings and noisy audio show the method catching tangled signal structure. An R package, NLPwavelet, ships the implementation.

Catalog record

CREATORNilotpal Sanyal Department of Mathematical Sciences, University of Texas at El Paso, [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-18134

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nonlocal Prior Mixture-Based Bayesian Wavelet Regression with Application to Noisy Imaging and Audio Data Nilotpal Sanyal Department of Mathematical Sciences, University of Texas at El Paso, [email protected] Abstract Abstract We propose a novel Bayesian wavelet regression approach using a three-component spike-and-slab prior for wavelet coefficients, combining a point mass at zero, a moment (MOM) prior, and an inverse moment (IMOM) prior. This flexible prior supports small and large coefficients differently, offering advantages for highly dispersed data where wavelet coefficients span multiple scales. The IMOM prior’s heavy tails capture large coefficients, while the MOM prior is better suited for smaller non-zero coefficients. Further, our method introduces innovative hyperparameter specifications for mixture probabilities and scale parameters, including generalized logit, hyperbolic secant, and generalized normal decay for probabilities, and double exponential decay for scaling. Hyperparameters are estimated via an empirical Bayes approach, enabling posterior inference tailored to the data. Extensive simulations demonstrate significant performance gains over two-component wavelet methods. Applications to electroencephalography and noisy audio data illustrate the method’s utility in capturing complex signal characteristics. We implement our method in an R package, NLPwavelet ( \geq 1.1). Keywords: Three-component spike-and-slab prior; wavelet analysis; nonlocal prior; generalized logit decay; hyperbolic secant decay; generalized normal decay. 1 Introduction We focus on spike-and-slab mixture models for wavelet-based Bayesian nonparametric regression. There are several existing approaches that consider for the wavelet coefficients various spike-and-slab mixture models, such as mixtures of two Gaussian distributions with different standard deviations ( Chipman et al.,, 1997 ) , mixtures of a Gaussian and a point mass at zero ( Clyde et al.,, 1998 ; Abramovich et al.,, 1998 ; Sanyal and Ferreira,, 2012 ) , mixtures of a heavy-tailed distribution and a point mass at zero ( Clyde and George,, 2000 ; Johnstone and Silverman,, 2005 ) , mixtures of a logistic distribution and a point mass at zero ( dos Santos Sousa,, 2024 ) , and mixtures of a nonlocal prior and a point mass at zero ( Sanyal and Ferreira,, 2017 ) . Nonlocal priors ( Johnson and Rossell,, 2010 ) are a class of priors that assign zero probability density in a neighborhood of the null value (often zero) of the parameter, unlike local priors, which are positive everywhere. In contrast to the other works mentioned above that used traditionally used local priors for the wavelet coefficients, ref. Sanyal and Ferreira, (2017) pioneered the use of nonlocal priors for wavelet regression. Specifically, ref. Sanyal and Ferreira, (2017) used two different nonlocal priors, namely the moment prior (MOM) and the inverse moment (IMOM) prior, in their mixture model. In this work, we flexibly extend all the previous approaches by proposing a three-component spike-and-slab mixture model for the wavelet coefficients, where, along with a point mass for the spike part, a mixture of nonlocal priors is used to model the slab component. In addition, we introduce novel hyperparameter specifications that are shown to provide improved estimates in extensive simulation experiments with highly dispersed data. In the Bayesian paradigm, nonlocal priors have been shown to encourage model selection parsimony and selective shrinkage (unlike local priors) for spurious coefficients ( Johnson and Rossell,, 2012 ; Rossell and Telesca,, 2017 ) . They create a gap around zero, yielding harder exclusion and lower bias for sizable effects. In contrast, local shrinkage priors provide continuous shrinkage that is particularly suitable for estimation but less effective for variable selection unless combined with explicit selection rules. Previous work ( Sanyal et al.,, 2019 ) has observed, in the context of high-dimensional genomics data, that different nonlocal priors provide better support for large and small regression coefficients. In wavelet regression, the wavelet coefficients at multiple resolution levels capture both location and scale characteristics of the underlying function ( Mallat,, 2008 ) . If the underlying function is highly dispersed, its energy is spread across a wide range of location or scale components. For such a function, while most of the wavelet coefficients will likely be small or near zero, non-zero wavelet coefficients will span across multiple scales. In other words, no single scale will dominate the wavelet coefficients, as different scales will capture different portions of the signal’s energy. This will lead to significant coefficients at both coarse and fine scales. We conjecture that, if the underlying function is highly dispersed, a mixture of nonlocal priors will provide better support to the distribution of the wavelet coefficients compared to individual nonlocal priors. Specifically, in this work, we consider for the wavelet coefficients a prior that is a mixture of a point mass at zero, a MOM prior, and an IMOM prior. Our motivation for combining MOM and IMOM priors stems from the fact that they offer complementary strengths in sparse high-dimensional regression. The MOM prior places more mass around moderate non-zero values, thereby offering greater sensitivity to small but meaningful signals. On the other hand, the IMOM prior has heavier tails, allowing it to support large coefficients better. In the context of wavelet regression of highly dispersed data, a single prior, MOM or IMOM, may over-shrink large coefficients or over-allow small noise fluctuations. A mixture of MOM and IMOM provides adaptive flexibility, simultaneously supporting both ends of the coefficient spectrum. This idea echoes adaptive shrinkage principles in sparse Bayesian learning. From a signal processing perspective, the heterogeneous scaling behavior of wavelet coefficients for highly dispersed signals motivates a prior that can adaptively vary shrinkage across scales. This hybrid slab also enables the prior predictive distribution to cover a broader range of plausible signals, reducing prior-data conflict. While our empirical results support this mixture’s performance, the theoretical justification lies in its capacity to model heterogeneity in signal strengths, a feature not adequately captured by any one nonlocal prior alone. In Bayesian wavelet regression, the probability weights associated with different component distributions of a spike-and-slab mixture prior, henceforth called mixture probabilities , and the scaling parameters of the component distributions are often governed by multiple hyperparameters ( Abramovich et al.,, 1998 ; Clyde et al.,, 1998 ; Sanyal and Ferreira,, 2017 ) . For the mixture probabilities at different resolution levels, previous work considered exponential decay specification ( Abramovich et al.,, 1998 ) , Bernoulli distribution ( Clyde et al.,, 1998 ) , and logit specification ( Sanyal and Ferreira,, 2017 ) . Further, for the scaling parameters, exponential decay ( Abramovich et al.,, 1998 ) and polynomial decay specifications ( Sanyal and Ferreira,, 2017 ) have been considered. In this work, we propose several novel specifications that flexibly model the variations in the mixture probabilities and scaling components. For the mixture probabilities, we consider a generalized logit decay, a hyperbolic secant decay, and a generalized normal decay, whereas for the scaling parameter, we consider a double exponential decay. Each of these specifications is controlled by a few hyperparameters. Following an empirical Bayes approach, we estimate the hyperparameters from the data and develop a posterior inference conditional on the hyperparameter estimates. Through extensive simulation studies, we assess the performance gains of our approach under the different hyperparameter specifications, comparing it to two-component spike-and-slab prior-based wavelet methods. Finally, applications to real-world data, including electroencephalography (EEG) data from a meditation study and audio data from a noisy musical recording, illustrate the

Read the complete text