Deep learning estimation of the spectral density of functional time series on large domains
Neda Mohammadi, Soham Sarkar, Piotr Kokoszka · 2026
Read Deep learning estimation of the spectral density of functional time series on large domains by Neda Mohammadi, Soham Sarkar, Piotr Kokoszka (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00284.txt.
Introduction
Neda Mohammadi, Soham Sarkar, and Piotr Kokoszka estimate the spectral density of a time series whose values are whole functions. Climate model output and brain scans produce such data. Each function sits on a huge grid of points. Older estimators build giant autocovariance matrices from that grid. At a hundred thousand grid points, the cost can become impossible.
Their estimator is a multilayer neural network instead. Spectral functional components guide its design. The authors prove it can approximate the true density under broad limits. Training skips the autocovariance kernels entirely. The work also splits across machines in parallel. Estimates then arrive much faster than before. Simulations check the method against known truth. A brain imaging application shows real data use. Large domain functional data gain a workable spectral tool.
Catalog record
| CREATOR | Neda Mohammadi, Soham Sarkar, Piotr Kokoszka |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-00284
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deep learning estimation of the spectral density of functional time series on large domains Neda Mohammadi, Soham Sarkar, Piotr Kokoszka Abstract We derive an estimator of the spectral density of a functional time series that is the output of a multilayer perceptron neural network. The estimator is motivated by difficulties with the computation of existing spectral density estimators for time series of functions defined on very large grids that arise, for example, in climate compute models and medical scans. Existing estimators use autocovariance kernels represented as large G × G G\times G matrices, where G G is the number of grid points on which the functions are evaluated. In many recent applications, functions are defined on 2D and 3D domains, and G G can be of the order G ∼ 10 5 G\sim 10^{5} , making the evaluation of the autocovariance kernels computationally intensive or even impossible. We use the theory of spectral functional principal components to derive our deep learning estimator and prove that it is a universal approximator to the spectral density under general assumptions. Our estimator can be trained without computing the autocovariance kernels and it can be parallelized to provide the estimates much faster than existing approaches. We validate its performance by simulations and an application to fMRI images. Key Words: Functional time series; Multilayer perceptron; Spatial domain; Spectral density. 1 Introduction Research on applications and improvements of deep learning has exploded in volume. The overwhelming majority of contributions focus on new applications, architectures, modes of training and similar issues that can be best resolved by experimentation and extensive numerical studies. General mathematical foundations of deep learning were developed already in the 1990s, including various universal approximation and algorithm convergence results, but there are still relatively few contribution studying deep learning in the framework of mathematical statistics. We propose a deep learning estimator of the spectral density of functional time series and provide a justification for its application under general assumptions. Scalar second order stationary time series are described by the mean and all autocovariances, unlike an iid sample whose second order parameters are the mean and the variance. In the case of scalar stationary observations X_{t} , the spectral density is the Fourier transform of the autocovariance sequence, i.e. it is defined by f(\theta)=\frac{1}{2\pi}\sum_{h=-\infty}^{\infty}c_{h}e^{-\mathrm{i}h\theta},\ \ \ \theta\in[-\pi,\pi], where c_{h}=\hbox{\rm Cov}(X_{t},X_{t+h}) . The spectral density contains all information about the second order dependence structure because the autocovariances can be obtained by the inverse Fourier transform. A key motivation for this research is that high resolution fMRI scans are produced on 3D grids with 10^{4} - 10^{5} points, so even estimating covariances becomes difficult, as it requires operations on 10^{8} - 10^{10} pairs of points. Our deep network is trained directly on the grid values, no sample autocovariances are required. Computer climate models produce functional time series on very large spatial domains, e.g. the continent of North America and the surrounding ocean. For instance, the average temperature surface can be modeled at monthly resolution at a grid with a few kilometers resolution, corresponding to about 10^{5} points. This paper makes a contribution at the nexus of deep learning and the analysis of functional time series. There have been an increasing number of papers on deep learning based inference, mostly for iid samples of functions. We review them later in this section. Our chief contribution is the derivation of neural networks that estimate the spectral density of a functional time series. We justify the application of such networks under weak conditions on the decay of autocovariance operators through several universal approximation results in metrics relevant to the context we consider. Our approach is based on the frequency domain principal components analysis of functional time series developed independently by [ 2013b ] and [ 2015 ] . Estimation approaches presented in those papers require computation of the autocovariance functions at many lags, which may not be feasible if the domain on which the functions are defined consists of hundreds of thousands of dense grid points. Any separable L^{2}({\mathcal{Q}}) space is isomorphic to L^{2}([0,1]) , but in practice a very large domain {\mathcal{Q}} makes the estimation of even the covariance kernel computationally challenging, as explained in [ 2022 ] . The data we consider are functions on {\mathcal{Q}} whose values are observed on a dense grid. In applications that motivate this work, there may be tens or hundreds of thousands of grid points, so the estimation of the spectral density based on weighted sums of autocovariances is computationally challenging or even not feasible at present. We show how to overcome this difficulty. A chief contribution of our paper is to show how to combine the frequency domain principal components analysis of functional time series with deep learning by constructing suitable output layers. In numerical work, we use specific architectures for the deep layers, those proposed by [ 2022 ] , but they could be modified in many ways without affecting our theory. We develop a theoretical framework based on linear filters and Fourier transforms of networks to show that our method is applicable under very general assumptions. In addition to [ 2013b ] , [ 2015 ] and [ 2022 ] , other closely related papers are [ 2013a ] , who derive a mathematical framework for spectral analysis of functional time series, and [ 2023 ] who focus on the estimation of the spectral density of a continuous domain stationary process in a Hilbert space. [ 2023 ] obtain convergence rates and limit distributions for data observed on a grid, which is the setting we consider in our numerical work. We conclude this section with a brief review of recent work on the application of deep learning to Functional Data Analysis. Our goal is to give a general idea rather than list all important contributions. [ 2024 ] provide an informative review. In most current applications, functions are converted to vectors by means of basis expansions. Expansion coefficients form vectors that can be used as inputs to a learning network. Vector outputs can be converted back into functions, or used directly for other purposes, like classification or clustering. Some useful advancements to this approach have been made. [ 2021 ] show how to construct and imbed in a larger architecture and micro neural network that learns a basis adaptively to the task. The context is of scalar responses y_{i} depending on functional regressors x_{i}(u) , u\in[0,1] . Training is done on a sample of iid realizations (x_{i},y_{i}) . [ 2023 ] study a model with multiple functional and scalar covariates. Other contributions to advancing functional regression by application of deep learning methods include Rao and Reimherr ( ? , ? ) and [ 2023 ] . [ 2024 ] consider the problem of reconstructing latent trajectories x_{i}(u) , u\in[0,1] , from noisy, sparsely observed realization x(u_{ij})+\varepsilon_{ij} , j=1,\ldots,n_{i} , i=1,\ldots,n . They develop GeLU-activated transformers with augmented modules, basically custom-designed, additional output layers that produce differentiable functions x_{i} . Representation of functional data, including multivariate functions, is considered by [ 2024 ] and [ 2024 ] . The above papers consider iid functions defined on a compact interval with about 10^{2} grid points. Regarding applications to time series of