SpinSVAR: Estimating Structural Vector Autoregression Assuming Sparse Input

Panagiotis Misiakos, Markus Püschel · 2025

Read SpinSVAR: Estimating Structural Vector Autoregression Assuming Sparse Input by Panagiotis Misiakos, Markus Püschel (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-03130.txt.

Introduction

Panagiotis Misiakos and Markus Püschel bring in SpinSVAR, a way to gauge a form of time chain that feeds back on its self, from time data when inputs are sparse. In place of Gauss type noise, they model the drive input as Laplace type terms that stand free of each. That pick gives a best chance gauge based on least gross flaw fits.

The team proves the gauge holds true in the long run when soft rules hold. The way uses GPU speed and scales to counts in the thousands. On made up data it beats top ways on both truth and run time. Used on S&P 500 data, it groups stocks by trade type. It finds big shocks tied to chief price moves. That backs the sparse input thought in use.

Catalog record

CREATORPanagiotis Misiakos, Markus Püschel
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE117 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-03130

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SpinSVAR: Estimating Structural Vector Autoregression Assuming Sparse Input Panagiotis Misiakos, Markus Püschel Abstract We introduce SpinSVAR, a novel method for estimating a structural vector autoregression (SVAR) from time-series data under sparse input assumption. Unlike prior approaches using Gaussian noise, we model the input as independent Laplacian variables, enforcing sparsity and yielding a maximum likelihood estimator (MLE) based on least absolute error regression. We provide theoretical consistency guarantees for the MLE under mild assumptions. SpinSVAR is efficient: it can leverage GPU acceleration to scale to thousands of nodes. On synthetic data with Laplacian or Bernoulli-uniform inputs, SpinSVAR outperforms state-of-the-art methods in accuracy and runtime. When applied to S&P 500 data, it clusters stocks by sectors and identifies significant structural shocks linked to major price movements, demonstrating the viability of our sparse input assumption. 1]Computer Science Dept. ETH Zurich Zürich, Switzerland 1 Introduction Time series arise in numerous applications where multi-dimensional observations are recorded at regular intervals, such as meteorology [ Yang et al., 2022 ] , finance [ Kleinberg, 2013 , Jiang and Shimizu, 2023 ] , and brain imaging [ Smith et al., 2011 ] . A fundamental challenge in analyzing time series is causal discovery, which seeks to uncover causal dependencies over time [ Assaad et al., 2022b , Hasan et al., 2023 ] . If causal effects occur faster than the data’s temporal resolution, they appear instantaneous and can be modeled with a linear structural equation model (SEM) [ Peters et al., 2017 ] . When the resolution is higher, they appear as lagged effects, typically captured by vector autoregression (VAR) [ Kilian, 2013 ] . Regardless of the model, recovering true causal relationships requires additional assumptions, such as the absence of latent confounders, identifiability conditions, or access to interventions [ Vowels et al., 2021 ] , which rarely hold in real-world settings. For instance, in financial markets, it is nearly impossible to observe all hidden confounders or directly intervene in stock prices. Instead of identifying true causal effects, we focus on learning instantaneous and lagged dependencies through a structural vector autoregression (SVAR), which unifies a linear SEM and a VAR [ Hyvärinen et al., 2010 ] . Structural vector autoregression Originally introduced by Sims [1980] , SVAR has been widely applied in econometrics [ Lütkepohl, 2005 , Kilian, 2013 ] and serves as a foundation for causal discovery in time-series data [ Pamfil et al., 2020 ] . SVAR models linear dependencies between variables, distinguishing between instantaneous effects (occurring within the same time step) and lagged effects (propagating over time). The model naturally associates time-series data with a directed acyclic graph (DAG), which encodes how each time step is generated from previous ones. These relationships collectively form the window graph, a DAG that uniquely determines the SVAR parameters. SVAR further assumes stationarity, meaning that the dependencies remain constant over time. Challenges and Limitations Even when abstracting away the need for true causal effects, DAG learning from time-series data remains computationally challenging due to the complexity of temporal dependencies and the high dimensionality of real-world datasets. Theoretically, it generalizes DAG learning from static data, which is already an NP-hard problem [ Chickering et al., 2004 ] . Several methods have been proposed to estimate the weighted window graph from time-series data, including approaches specifically tailored for SVAR [ Hyvärinen et al., 2010 ] . However, many existing methods suffer from critical limitations. Some approaches, such as Granger causality-based methods, learn the summary graph that fails to incorporate time lags [ Bussmann et al., 2021 ] , while others do not account for instantaneous dependencies [ Khanna and Tan, 2019 ] . Most methods face computational challenges when applied to large DAGs, making them impractical for graphs with thousands of nodes [ Cheng et al., 2024 ] . Structural shocks, i.e., the input variables of an SVAR [ Lanne et al., 2017 ] at each node, are often interpreted merely as noise variables in prior work [ Hyvärinen et al., 2010 , Pamfil et al., 2020 ] , limiting their interpretability and potential insights into the underlying causal mechanisms. To address these challenges, we introduce a novel, efficient method that enforces sparsity in the input of the SVAR. SpinSVAR: Sparse Input SVAR Hyvärinen et al. [2010] model SVAR under a non-Gaussian noise assumption for the inputs. We extend this by enforcing sparsity in the input, following Misiakos et al. [2023] , and model it as independent Laplacian random variables. The Laplace distribution naturally promotes sparsity [ Jing et al., 2015 ] due to its sharp peak at zero and heavy tails. Intuitively, this means a few significant independent events drive the observed data through the SVAR structure. This contrasts with prior work, which typically assumes zero-mean Gaussian input, either explicitly [ Lachapelle et al., 2019 ] or implicitly via mean square error-based optimization objectives [ Pamfil et al., 2020 , Sun et al., 2023 , Tank et al., 2021 ] . By incorporating this Laplacian input model, we derive a maximum likelihood estimator (MLE) based on least absolute error regression, leading to SpinSVAR, a new method for efficient SVAR estimation from time-series data. This framework provides both theoretical and empirical advantages. Contributions Our main contributions are: • We model sparse SVAR input as independent zero-mean Laplacian variables, yielding an MLE formulation for estimating SVAR parameters. • We prove the consistency of this MLE under mild assumptions on the window graph weights. • We introduce SpinSVAR, a regularized MLE framework enabling fast, and accurate SVAR estimation from time-series data. • In synthetic experiments with sparse SVAR input, generated via Laplacian or Bernoulli-uniform distribution as in [ Misiakos et al., 2023 ] , SpinSVAR can learn an associated DAG with up to several thousands of nodes and outperforms various state-of-the-art methods. • On real-world financial data from the S&P 500 index, we show that the sparse input assumption allows to cluster stocks by sector and identify structural shocks reflecting significant changes in the stock prices. 2 SVAR with Sparse Input We introduce notation, the needed background on SVARs, the motivation for sparsity assumption in the input and its statistical modeling using the Laplace distribution. Time-series data A multi-dimensional data vector {\bm{x}}_{t} , measured at time point t\in{0,1,\dots,T-1}=[T] , is written as {\bm{x}}_{t}=(x_{t,1},x_{t,2},\dots,x_{t,d})\in\mathbb{R}^{1\times d} . A time series consists of a sequence of such data vectors {\bm{x}}_{0},\dots,{\bm{x}}_{T-1} recorded at consecutive time points. We assume these vectors are stacked as rows in a matrix, representing the entire time series, denoted as {\bm{X}}\in\mathbb{R}^{T\times d} . When multiple realizations of {\bm{X}} are available, they are collected as slices of a tensor {\bm{\mathsfit{X}}}\in\mathbb{R}^{N\times T\times d} . These can obtained by dividing a long time series into smaller segments of length T . Example: stock market We consider an example of time-series data from the stock market. We collect daily stock values {\bm{x}}_{t} for a particular stock index (e.g., S&P 500 ) for, say, 20 years. A time series for one year is denoted with the matrix {\bm{X}} and 20 years yield the data tensor {\bm{\mathsfit{X}}} . Model Demonstration We impose a graph-based model on the generation of time-series data and first illustrate it with a simple example. Suppose that the vector {\bm{x}}_{t} at time t is

Read the complete text