Online Spectral Density Estimation
Shahriar Hasnat Kazi · 2025
Read Online Spectral Density Estimation by Shahriar Hasnat Kazi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-11296.txt.
Introduction
Shahriar Hasnat Kazi, Niall Adams, and Edward Cohen develop the first online methods for estimating the spectral density of a time series, the curve that shows how its variation splits across frequencies. Streaming inference must work with fixed memory, fixed cost per step, and the ability to adapt as the data source changes. Offline spectral tools assume a stored, stationary record, so they fail those tests.
Their method rests on forgetting factors, which let older data fade as new data arrive. A new online periodogram recovers the offline one's properties when the series is stationary, and a Whittle estimator built on it tunes its own forgetting from the data. Ocean drifter tests show real-time tracking.
Catalog record
| CREATOR | Shahriar Hasnat Kazi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-11296
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Online Spectral Density Estimation Shahriar Hasnat Kazi Abstract This paper develops the first online algorithms for estimating the spectral density function — a fundamental object of interest in time series analysis — that satisfies the three core requirements of streaming inference: fixed memory, fixed computational complexity, and temporal adaptivity. Our method builds on the concept of forgetting factors, allowing the estimator to adapt to gradual or abrupt changes in the data-generating process without prior knowledge of its dynamics. We introduce a novel online forgetting-factor periodogram and show that, under stationarity, it asymptotically recovers the properties of its offline counterpart. Leveraging this, we construct an online Whittle estimator, and further develop an adaptive online spectral estimator that dynamically tunes its forgetting factor using the Whittle likelihood as a loss. Through extensive simulation studies and an application to ocean drifter velocity data, we demonstrate the method’s ability to track time-varying spectral properties in real-time with strong empirical performance. Keywords: Spectral density function, online estimation, forgetting factors, time series analysis 1 Introduction With data being collected at unprecedented volumes and velocities, the analysis of dynamic, continuous data streams presents challenges that traditional offline algorithms cannot address. These algorithms rely on storing and preprocessing large datasets, resulting in prohibitive memory and time requirements that make them unsuitable for scenarios requiring real-time, up-to-date results. In contrast, online algorithms process data incrementally, as it arrives, operating under strict constraints of fixed memory and computational complexity while avoiding the need to revisit past data ( 5 , 35 , 55 ) . Beyond the challenges of scale and speed, data streams are also inherently dynamic, as the processes generating the data often evolve over time. This evolving nature introduces a fundamental challenge that online algorithms must also address. For example, if the algorithm is estimating a target quantity of interest from the data, that target may itself be changing over time. Concept drift refers to changes in time of the data-generating process, which can occur gradually or abruptly. If not addressed, such changes can significantly degrade the performance of estimation algorithms that rely on the assumption of strict or weak stationarity (in the probabilistic sense). To handle this, temporal adaptivity becomes essential— the ability of an algorithm to adjust to concept drift while maintaining performance. Importantly, temporal adaptivity must not compromise accuracy and precision when the data-generating process remains stable; under such conditions, the algorithm’s performance should approach that of a stationary estimator. Along with fixed memory and computational efficiency, temporal adaptivity is a core requirement for online algorithms, enabling real-time analysis of dynamic systems. In this paper, our target of interest is the spectral density function (SDF), a fundamental concept in time series analysis (see 42 for a comprehensive theoretical and methodological overview). Defined as the Fourier transform of the autocovariance sequence of a weakly stationary process, the SDF provides an information-rich representation of a process’s second-order structure in the frequency domain, revealing periodic behaviour and the dominant frequencies driving its variability. This frequency-domain representation is often preferred over its time-domain counterpart, particularly when a process’s variability is linked to underlying physical phenomena or periodic components. As a result, the SDF has been widely used in fields such as astronomy ( 57 ) , cognitive science ( 46 ) , earth sciences ( 39 , 40 ) , electrical engineering ( 18 ) , and finance ( 54 ) . Its estimation remains a topic of significant interest ( 62 , 38 , 10 , 56 ) , and its use is expanding to new domains ( 17 , 30 ) . While the SDF is defined with respect to stationary processes, in reality, data rarely conforms to this assumption; the spectral properties of the data generating process may gradually drift or undergo abrupt changes. This reality motivated the now mature field of time-frequency analysis, both in the formulation of time series models that emit a time-varying spectrum and in computational methods, including the short-time Fourier transform ( 21 , 63 , 28 ) and the widely celebrated discovery of wavelets ( 31 , 33 ) . However, these and subsequent approaches remain offline and are unsuitable for modern applications in which real-time tracking is needed as new data points arrive. We address this shortfall by developing the first online algorithm for the estimation of the SDF that adheres to the requirements of fixed memory, fixed complexity and temporal adaptivity. To do so, we take the forgetting factors approach, popularised in areas such as change-point detection ( 6 , 44 ) , classification ( 2 , 43 ) , clustering ( 11 , 25 ) , density estimation ( 53 ) , pattern mining ( 4 , 15 ) and model validation ( 27 ) . Forgetting factors are a sequence of scalars taking values in (0,1] , controlling the rate at which past data is forgotten. Forgetting factors provide a continuous analogue to hard forgetting approaches, where each data point contributes equally, or not at all, to the estimator ( 3 ) . The most immediate alternative to forgetting factors is a sliding window. However, specifying the size of the window is non-trivial. In fact, a commonality between the approaches to ensure temporal adaptivity introduced in the literature is the requirement of specifying control parameters. The selection of suitable values for these parameters is a non-trivial task and frequently requires prior knowledge of the system, making these approaches unsuitable when no such information is available. This selection task is at the core of the adaptive streaming estimation literature. Of particular relevance to this paper are adaptive forgetting factors ( 7 , 44 ) , which we incorporate into our algorithms so that the online spectral estimator can learn a local optima for the forgetting factor based on the present behaviour of the data stream it is analysing. The periodogram remains the most widely used approach to estimating the SDF and sits at the centre of most other estimation schemes that set about to improve upon its bias and variance properties. This includes direct spectral estimators, in which a data taper is used to control bias. In Section 2, after reviewing these in the traditional offline setting, we present a novel online forgetting-factor periodogram. Although the idea of a sequential algorithm for the estimation of the spectral density of a process has found some development in the literature ( 14 ) , our method differs in its approach, since we tackle the problem from a tapering angle. Importantly, we show that under the assumption of stationarity it asymptotically approaches the same distribution as its offline counterpart, while retaining fixed and finite complexity, with each data point only used once, upon arrival. To simplify the exposition, we present the forgetting-factor periodogram for a process with a known and constant mean; without loss of generality, this can be assumed to be zero. We then show how the forgetting factor periodogram can be readily extended to processes with an unknown and potentially time varying mean. In the offline setting, the Whittle estimator has been studied and applied extensively ( 50 , 41 , 36 ) for parameteric spectral estimation. The asymptotic distribution of the periodogram is used as a