Precision spectral estimation at sub-Hz frequencies: closed-form posteriors and Bayesian noise projection
Lorenzo Sala 1,2 , Stefano Vitale 1 · 2025
Read Precision spectral estimation at sub-Hz frequencies: closed-form posteriors and Bayesian noise projection by Lorenzo Sala 1,2 , Stefano Vitale 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20846.txt.
Introduction
Lorenzo Sala and Stefano Vitale derived exact Bayesian formulas for low-rate spectral estimation in a 2025 paper. Below one hertz, tests like the LISA gravity-based wave observatory and its Pathfinder precursor cannot average many free-standing spectra. Gaussian approximations for noise estimates break down precisely where precision matters most. Their method works straight with periodograms and Wishart stats for multivariate Gaussian time series. It yields closed-form posterior distributions at each rate for single power spectra, pairwise and multiple coherence, and the full cross-spectral matrix.
For noise projection, they model one channel as filtered versions of others plus background. Posteriors for the filter responses and background spectrum are also closed form. Applied to LISA Pathfinder data, the method decorrelated heat level-induced disturbances effectively. Exact stats replace hopeful approximations in precision gravity-based tests.
Catalog record
| CREATOR | Lorenzo Sala 1,2 , Stefano Vitale 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-20846
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Precision spectral estimation at sub-Hz frequencies: closed-form posteriors and Bayesian noise projection PubID: pubid: Preprint July 28, 2025 Contact information: [email protected] , [email protected] Lorenzo Sala 1,2 , Stefano Vitale 1 Abstract We present a Bayesian method for estimating spectral quantities in multivariate Gaussian time series. The approach, based on periodograms and Wishart statistics, yields closed-form expressions at any given frequency for the marginal posterior distributions of the individual power spectral densities, the pairwise coherence, and the multiple coherence, as well as for the joint posterior distribution of the full cross-spectral density matrix. In the context of noise projection—where one series is modeled as a linear combination of filtered versions of the others, plus a background component—the method also provides closed-form posteriors for both the susceptibilities, i.e., the filter transfer functions, and the power spectral density of the background. Originally developed for the analysis of the data from the European Space Agency’s LISA Pathfinder mission, the method is particularly well-suited to very-low-frequency data, where long observation times preclude averaging over large sets of periodograms, which would otherwise allow these to be treated as approximately normally distributed. I Introduction Spectral analysis using Welch’s method [ 1 , 2 ] is the most common approach to noise characterization. This method estimates power spectral densities (PSD) and cross-spectral densities (CPSD) of multivariate noise time series from their properly normalized discrete Fourier transforms, known as periodograms. To enhance estimate precision and quantify uncertainty, Welch’s method divides the time series into M equal-length possibly overlapping segments, generating M periodogram samples. A common frequentist approach estimates the PSD and CPSD by averaging these samples, with uncertainty proportional to the standard deviation of the mean. This relies on the central limit theorem, assuming that averaging rapidly yields Gaussian statistics suitable for confidence level predictions. However, spectral resolution decreases with M , and in many applications, particularly those at very low frequency, M must remain small, sometimes even M=1 . As M decreases, the Gaussianity assumption becomes increasingly inaccurate, leading, for instance, to paradoxical outcomes such as non-negligible probabilities for negative PSD values. At M=1 , the frequentist approach becomes entirely infeasible. In such cases, Bayesian inference, free from these limitations, remains the only viable approach. We encountered this situation while analyzing data from the LISA Pathfinder mission [ 3 , 4 , 5 ] . The mission’s objective was to precisely measure the noise spectrum of force disturbances acting on two nominally freely falling test masses in space, reaching acceleration levels as low as a few \mathrm{fm} and frequencies down to approximately 20\text{\,}\mathrm{\SIUnitSymbolMicro Hz} . Unlike typical spectral estimation applications, where the goal is to extract a signal from a noisy stochastic process, LISA Pathfinder aimed to measure the noise itself with the highest possible accuracy, particularly at the lowest achievable frequencies. While reviewing the literature for a consistent and practical Bayesian approach suited to our needs, we found that the fundamental principles had long been established. However, we could not find a detailed, practical method applicable to our data processing, leading us to develop one independently. We applied this method to the data analysis of LISA Pathfinder in Refs. [ 3 , 6 ] , and briefly summarized its main features in the appendices of the second paper. Here, we provide a detailed description of the method, discussing its foundations, deriving key procedures rigorously, and presenting quantitative evidence of its validity through numerical simulations. The paper is organized as follows: in Section II we define the key experimental quantities of multi-variate time series and derive their likelihood under the Gaussian data hypothesis; in Section III we build the Bayesian posteriors for all the related spectral quantities; in Section IV we discuss the case of noise projection, that is the case where one series is modeled as a linear combination of filtered versions of the others, plus a background component of which one wants to estimate the spectrum; finally in Section V we give some concluding remarks. II Periodograms, key periodogram functions and their likelihood In this section, we recall a few basic concepts and results that we will use in our Bayesian inference method. We assume that data are Gaussian for the purpose of the our analysis, something we found to be quantitatively true in the case of LISA Pathfinder [ 3 ] . II-A Basic definitions and nomenclature In our approach, we assume that we have acquired, synchronously and with sampling time T , the time series of p real, stationary, Gaussian, zero-mean stochastic processes. We call x_{i}[n] , with 1\leq i\leq p , the sample of the i -th series taken at time t=nT . The joint statistics of these samples is fully contained in the mean values of their products \langle x_{i}[n]x_{j}[m]\rangle=\int_{-\infty}^{\infty}\Sigma_{i,j}(f)e^{i2\pi(m-n)fT}{d}f, (1) and then in the Hermitian positive definite matrix \bm{\Sigma}(f) , with elements \Sigma_{i,j}(f) , which, by definition, is the joint two-sided power cross-spectral density (CPSD) matrix of the p stochastic processes at frequency f . Note that the diagonal element \Sigma_{i,i}(f) is the power spectral density (PSD) of the process x_{i}(t) , while the off-diagonal \Sigma_{i,j}(f) is the pair CPSD of x_{i}(t) and x_{j}(t) . Our goal is to infer each element of \bm{\Sigma}(f) independently at each frequency, without assuming any functional dependence on f . The main tool for such an inference is the periodogram X_{i}[k] calculated over an N -long segment of the multivariate time series. X_{i}[k] is defined as: X_{i}[k]=\sqrt{\frac{T}{N}}\sum_{n=0}^{N-1}x_{i}[n]\,w[n]\,e^{-2\pi ikn/N} (2) with 0\leq k\leq N-1 an integer, and w[n] the coefficients of a suitable tapering window. Since x_{i}[N-k]=x_{i}^{*}[k] , only the first \lfloor N/2\rfloor+1 of these coefficient carry independent information. X_{i}[k] is Gaussian, complex, and zero-mean. Key for the inference are the complex mean values: \begin{split}&\langle X_{i}[k]X_{j}^{*}[k^{\prime}]\rangle=\frac{T}{N}\int_{-\infty}^{\infty}\Sigma_{i,j}(f)\times\\ &\times\tilde{w}\left(\frac{2\pi}{N}k-2\pi fT\right)\tilde{w}^{*}\left(\frac{2\pi}{N}k^{\prime}-2\pi fT\right)\,df\end{split} (3) with \tilde{w}(\phi)=\sum_{n=0}^{N-1}w[n]e^{-i\phi n} the Fourier sequence transform of the tapering window w[n] . If, ideally, one could choose w[n] such that \begin{split}\tilde{w}&\left(\frac{2\pi}{N}k-2\pi fT\right)\tilde{w}^{*}\left(\frac{2\pi}{N}k^{\prime}-2\pi fT\right)=\\ &=2\pi N\delta_{kk^{\prime}}\delta\left(\frac{2\pi}{N}k-2\pi fT\right),\end{split} (4) with \delta_{kk^{\prime}} the Kronecker delta of k and k^{\prime} , and \delta(\phi) the Dirac delta of \phi , then X_{i}[k]X_{j}^{*}[k] would be an unbiased estimator of \Sigma_{ij}\left(f=k/(NT)\right) , and X_{i}[k] would be independent of X_{j}^{*}[k^{\prime}] if k\neq k^{\prime} . In reality, \tilde{w}(\phi) is a 2\pi -periodic function with a central lobe at \phi=0 , and a sequence of strongly suppressed side lobes. We assume that the aliasing deriving from the periodicity of \tilde{w}(\phi) has been made negligible by properly choosing a short enough sampling time T . The width of the central lobe depends on the choice of the window, but is always of the form \pm m(2\pi/N) , with m a small integer. Thus, if \lvert k-k^{\prime}\rvert>m , then X_{i}[k] and X_{j}^{*}[k^{\prime}] may be treated as independent within a reasonable accuracy. Then from Equation 3 , \langle X_{i}[k]X_{j}^{*}[k]\rangle\simeq\int_{-\frac{1}{2T}}^{\frac{1}{2T}}\Sigma_{i,j}(f)G\left(f-\frac{k}{NT}\right)df (5) with G(f)=(T/N)\left\lvert\tilde{w}(2\pi fT)\right\rvert^{2} . Note that w[n] is always normalised such that \int_{-\frac{1}{2T}}^{\frac{1}{2T}}G\left(f-\frac{k}{NT}\right)df=1 . Thus, X_{i}[k]X_{j}^{*}[k] is an estimator of \Sigma_{i,j}(f) averaged over the band f=(k\pm 2\pi m)/(NT) . From now on, with \bm{\Sigma}(f) , unless otherwise specified, we indicate this averaged version of the CPSD matrix. As usual in statistics, the precision of the estimator can be increased by averaging over repeated measurements. To this aim, Welch’s method prescribes to split the available time series into M