Spectral Differential Network Analysis for High-Dimensional Time Series
Michael Hellstern, Byol Kim, Zaid Harchaoui, Ali Shojaie · 2024
Read Spectral Differential Network Analysis for High-Dimensional Time Series by Michael Hellstern, Byol Kim, Zaid Harchaoui, Ali Shojaie (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07905.txt.
Introduction
Michael Hellstern, Byol Kim, Zaid Harchaoui, and Ali Shojaie wrote a 2024 statistics paper on comparing networks built from time-based data. Many fields record signals over time from many sources at once, from brain scans to Earth sensors. From such data, researchers build networks showing which signals move together at each rhythm. A common question is how the network changes between two states.
One example is epilepsy: doctors want to see how brain links shift as a seizure begins. The usual route builds each network on its own and then subtracts. That can fail when each network is dense but the change between them is small and sparse. The authors build a method that estimates the change directly, favoring sparse answers. They prove the method is reliable under that one condition. Tests on made-up data and on real brain recordings show how it works.
Catalog record
| CREATOR | Michael Hellstern, Byol Kim, Zaid Harchaoui, Ali Shojaie |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-07905
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Spectral Differential Network Analysis for High-Dimensional Time Series Michael Hellstern, Byol Kim, Zaid Harchaoui, Ali Shojaie Abstract Spectral networks derived from multivariate time series data arise in many domains, from brain science to Earth science. Often, it is of interest to study how these networks change under different conditions. For instance, to better understand epilepsy, it would be interesting to capture the changes in the brain connectivity network as a patient experiences a seizure, using electroencephalography data. A common approach relies on estimating the networks in each condition and calculating their difference. Such estimates may behave poorly in high dimensions as the networks themselves may not be sparse in structure while their difference may be. We build upon this observation to develop an estimator of the difference in inverse spectral densities across two conditions. Using an ℓ 1 \ell_{1} penalty on the difference, consistency is established by only requiring the difference to be sparse. We illustrate the method on synthetic data experiments and on experiments with electroencephalography data. 1 INTRODUCTION Spectral network analysis of multivariate time series plays a key role in fields ranging from oceanography and seismology to neuroscience ( Laurindo et al., 2019 ; James et al., 2017 ; Bloch et al., 2022 ) . We use the inverse spectral density matrix as our choice of network as the i,j entry more directly encodes the dependence between nodes i and j compared to other networks in the spectral domain such as coherence Dahlhaus (2000) . Studying individual networks can provide insights into how features interact; however, it is often of interest to study how networks change across conditions or in response to an external intervention ( Shojaie, 2021 ) . In neuroscience, for example, many neurodegenerative disorders are associated with abnormal brain connectivity networks ( Bloch et al., 2022 ) . Spectral features are regularly used to interpret many types of neuroscientific data, from electroencephalography to magnetoencephalography data ( Gnassounou et al., 2023 ; Richard et al., 2020 ; Dupré la Tour et al., 2018 ) . Coherence, the frequency domain analog to correlation, is a common choice for investigating interactions in multivariate time series analysis. This notion is especially appealing in neuroscience applications, where activities captured at different frequencies better reveal brain oscillations in sensory-cognitive processes. Therefore, despite the availability of nonlinear association measures, such as mutual information ( Belghazi et al., 2018 ) and transfer entropy ( Ursino et al., 2020 ) , coherence is commonly used by neuroscientists to define brain functional connectivity networks. Similar to correlation, coherence includes the indirect effects of other nodes in the network. Thus, coherence may not be an informative measure of the dependence between nodes. The inverse spectral density is a more direct measure of dependence between nodes as the inverse spectral density between nodes i and j is a rescaling of the coherence after removing the linear effects of all other nodes \{k\neq i,j\} ( Dahlhaus, 2000 ) . Therefore, the inverse spectral density better resembles the effective connectivity between brain regions ( Friston, 2011 ) , providing an initial understanding of how two regions may be causally related. Modern data collection methods have facilitated the collection of data, where the dimensionality is much greater than the number of data points. This setting is often referred to as high-dimensional ( p\gg n ). When analyzing high-dimensional time series data, regularization techniques, such as the LASSO, are needed to make the problem computationally and statistically tractable ( Banerjee et al., 2008 ) . In the frequency domain, regularization can allow for better numerical stability and better performance ( Böhm and von Sachs, 2009 ) . While several methods exist to directly estimate the difference in inverse covariance matrices (see Tsai et al. (2022) and references therein), no such methods exist for the difference in inverse spectral densities. Naïvely, to estimate the difference in inverse spectral densities, one could first estimate the inverse spectral density in each condition and then take their difference. In high-dimensions, consistency of the resulting estimate requires both networks to be sparse ( Deb et al., 2024 ) . This assumption may be unrealistic due to the presence of hub nodes ( Wang et al., 2021 ) and thereby lead to degraded statistical performance. In this paper, we propose Spectral D-trace Difference (SDD), a direct estimator of the difference in inverse spectral densities, which, to our knowledge, is the first method to directly target a differential network in the spectral domain. By leveraging advances in analysis of time series data, our direct estimator only requires sparsity of the difference, which is a more realistic assumption in many settings ( Wang et al., 2021 ) . For instance, despite identifying many nonzero coherence values in resting state and stimulation states, Bloch et al. (2022) found many coherence changes to be near zero. These small differences are likely due to noise in the estimation procedure, corresponding to no underlying change in coherence. Assuming sparsity of the difference, and only under a geometrically decaying time dependence condition, we show that our direct difference estimator consistently estimates the true difference. Performance of our estimator is studied in a variety of simulation settings, as well as a real data application. Notation. We use \|A\|_{1} , \|A\|_{F} , \|A\|_{\infty} , \|A\|_{0} to denote the \ell_{1} , Frobenius, infinity, and \ell_{0} norms of a matrix A , respectively. The element-wise absolute value of a matrix A is denoted as |A| . The conjugate transpose of a matrix or vector will be denoted as A^{H} . We denote the inner product between two matrices A and B as \langle A,B\rangle=\mathrm{Tr}(AB^{T}) and use A\otimes B to represent their Kronecker product. 2 METHOD Figure 1 provides a visual explanation of our method, SDD, and each step (A)–(E) is elaborated upon in this section. Figure 1: SDD Method. (A) Inputs: Time series datasets are observed for two conditions. (B) Computing the Spectral Densities: We then compute the spectral densities in each condition using the smoothed periodogram. (C) Expanding to Real Space: These spectral densities are expanded to the real space. (D) Direct Estimation of the Difference in Inverse Spectral Densities: Using the expanded spectral densities we directly compute the difference estimator. (E) Output: We form the difference in inverse spectral densitites by taking the (1,1) and (2,1) blocks of \hat{\Delta} . (A) Inputs. Suppose we have mean-zero piecewise stationary data in two conditions, denoted as 1 and 2. In condition 1, there are n_{1} observations of p covariates, while condition 2 has n_{2} observations. It is worth noting that the assumption of piecewise stationarity only requires stationarity within each condition and not stationarity across conditions. This may be satisfied in many neuroscience applications where experimental factors affecting the brain state are known from the experimental design. For example, in Bloch et al. (2022) , conditions 1 and 2 might represent pre- and post-stimulation, respectively and stimulation times are known. (B) Computing the Spectral Densities. The spectral density in condition l\in\{1,2\} at frequency \lambda , f_{l}(\lambda) , is defined as the Fourier transform of the autocovariance matrix. Intuitively, the spectral density represents the portion of the covariance of the signal that can be attributed to the specific frequency