An Efficient and Interpretable Autoregressive Model for High-Dimensional Tensor-Valued Time Series

Yuxi Cai, Lan Li, Yize Wang, and Guodong Li Department of Statistics and Actuarial Science, University of Hong Kong · 2025

Read An Efficient and Interpretable Autoregressive Model for High-Dimensional Tensor-Valued Time Series by Yuxi Cai, Lan Li, Yize Wang, and Guodong Li Department of Statistics and Actuarial Science, University of Hong Kong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-01658.txt.

Introduction

Yuxi Cai and co-authors propose a leaner model for forecasting data that arrive as tensors over time, in a statistics paper from 2025. Tensor data stack many dimensions at once, like readings across places, types, and times. Standard factor tricks either lose clarity as dimensions grow or stay fast but hard to interpret.

Their method first splits the response and the inputs with a fast decomposition, then links the two sets of features. A sparse extra term soaks up signals that the low-rank core misses. The authors prove error bounds for their estimates and give a fitting algorithm. Simulations backed the theory, and a study of the El Niño climate pattern showed gains in both forecast skill and clarity.

Catalog record

CREATORYuxi Cai, Lan Li, Yize Wang, and Guodong Li Department of Statistics and Actuarial Science, University of Hong Kong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE186 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-01658

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An Efficient and Interpretable Autoregressive Model for High-Dimensional Tensor-Valued Time Series Yuxi Cai, Lan Li, Yize Wang, and Guodong Li Department of Statistics and Actuarial Science, University of Hong Kong Abstract In autoregressive modeling for tensor-valued time series, Tucker decomposition, when applied to the coefficient tensor, provides a clear interpretation of supervised factor modeling but loses its efficiency rapidly with increasing tensor order. Conversely, canonical polyadic (CP) decomposition maintains efficiency but lacks a precise statistical interpretation. To attain both interpretability and powerful dimension reduction, this paper proposes a novel approach under the supervised factor modeling paradigm, which first uses CP decomposition to extract response and covariate features separately and then regresses response features on covariate ones. This leads to a new CP-based low-rank structure for the coefficient tensor. Furthermore, to address heterogeneous signals or potential model misspecifications arising from stringent low-rank assumptions, a low-rank plus sparse model is introduced by incorporating an additional sparse coefficient tensor. Nonasymptotic properties are established for the ordinary least squares estimators, and an alternating least squares algorithm is introduced for optimization. Theoretical properties of the proposed methodology are validated by simulation studies, and its enhanced prediction performance and interpretability are demonstrated by the El Ni n ~ \tilde{\text{n}} o-Southern Oscillation example. Keywords : autoregression, high-dimensional time series, nonasymptotic properties, sparsity, tensor decomposition 1 Introduction With the rapid advancement of information technology, multi-dimensional or tensor-valued data are now ubiquitous, and particularly, many of them are time-dependent. Examples can be found in various fields, such as neuroscience ( Zhou et al., 2013 ; Li and Zhang, 2021 ) , digital marketing ( Bi et al., 2018 ; Hao et al., 2021 ) , economics and finance ( Chen et al., 2022 ; Wang et al., 2024 ) and climatology ( Bahadori et al., 2014 ; Xu et al., 2018 ) . It is arguably the most important task to conduct supervised learning on these data, say tensor autoregression ( Li and Xiao, 2021 ; Wang et al., 2022 ) or more general tensor-on-tensor regression ( Lock, 2018 ; Raskutti et al., 2019 ) . However, the corresponding responses and covariates may both be tensors with high order and high dimension. This ends up with scenarios where the number of parameters to estimate is substantially larger than the available sample size. Meanwhile, these data often possess hidden low-dimensional structures that can be leveraged to improve model interpretability and estimation efficiency at the same time. As an illustrative example, a few oceanic variables from specific regions are found to be closely associated with the El Ni \tilde{\text{n}} o-Southern Oscillation (ENSO), the most prominent phenomenon of contemporary natural climate variability ( Sarachik and Cane, 2010 ; Zhou and Zhang, 2023 ) . The data, which include seven-layer ocean temperature anomalies in the upper 150 meters, are observed over time, forming a three-way tensor-valued time series with dimensions 51 ( longitude ) \times 41 ( latitude ) \times 7 ( variables ). The high dimensionality of the data makes its direct modeling and forecasting formidable since even a simple autoregressive model of order one would involve (51\times 41\times 7)^{2}=14637^{2} parameters, an overwhelming number that far exceeds the observed time points. On the other hand, research indicates that climate conditions of the so-called “El Ni \tilde{\text{n}} o basin” region affect, and are affected by, those of other regions in different ways, especially before the onset of an El Ni \tilde{\text{n}} o event ( Ludescher et al., 2013 ) . The El Ni \tilde{\text{n}} o basin is approximately around the equatorial Pacific corridor; see Figure 1 for an illustration. Yet, the literature has not reached a consensus on its precise location. It is crucial for a successful inference tool to correctly identify the low-dimensional structure, and this can be achieved by low-rankness-induced approaches in a coherent way ( Zhou et al., 2013 ; Feng et al., 2021 ) . Figure 1: The grid points represent the geographical locations where ocean temperature data are being considered. One possible boundary of the El Ni \tilde{\text{n}} o basin is delineated by dashed lines, with grid points within this region highlighted in red. There are two extensively used methods in the literature for adding low-rank constraints to tensors: Tucker and canonical polyadic (CP) decomposition; see Kolda and Bader, 2009 . Tucker decomposition ( Tucker, 1966 ) has been widely applied to various tensor regression settings, including scalar-on-tensor and tensor-on-tensor models, due to its numerical stability ( Yu and Liu, 2016 ; Li and Zhang, 2017 ; Li et al., 2018 ; Gahrooei et al., 2021 ; Han et al., 2022 ) . Wang et al., 2024 considered Tucker decomposition to tensor autoregressive time series models, leading to a nice interpretation of supervised factor modeling; see also Wang et al., 2022 and Huang et al., 2025 . Specifically, they first assume coefficient tensors to have a high-order singular value decomposition (HOSVD), a special Tucker decomposition. Some loading matrices can then be moved to the left-hand side of autoregression or regression to summarize responses into low-dimensional factors or features, and the others will summarize covariates into another few features. The response features capture all the predictable components, while the covariate ones encapsulate all the driving forces, thereby facilitating model explanations. The above physical interpretation can help us study the ENSO example. However, Tucker decomposition will lose its efficiency in compressing tensors very quickly as the order of tensors increases, say greater than four or five ( Oseledets, 2011 ; Cai et al., 2022 ) . This issue is particularly prominent when dealing with autoregression for tensor-valued time series, where the coefficient tensor has a minimum order of six. In the meanwhile, CP decomposition ( Harshman, 1970 ) has been well recognized for its efficiency in dimension reduction ( Kolda and Bader, 2009 ) . Guo et al., 2012 and Zhou et al., 2013 considered CP decomposition for scalar-on-tensor regression problems, followed by many others ( Guhaniyogi et al., 2017 ; Zhang et al., 2019 ; Hao et al., 2021 ; Feng et al., 2021 ) . A nice interpretation can be achieved since CP decomposition can extract principal components or features from covariates ( Cai et al., 2022 ) . For instance, in the application to neuroimaging analysis, the model can identify the relevant brain regions to a clinical response ( Zhou et al., 2013 ) . Besides, CP decomposition has also been employed to effectively reduce the parameter dimension of tensor-on-tensor regression models ( Lock, 2018 ; Llosa-Vite and Maitra, 2023 ; Billio et al., 2024 ) , however, its statistical interpretation becomes vague. In contrast to Tucker decomposition, the loading matrices of CP decomposition are generally not orthogonal ( Han et al., 2024 ) . This makes it difficult to move some of them to the left-hand side of regression to extract features from tensor-valued responses. Consequently, the resulting model lacks the interpretation of feature extraction from both responses and covariates. The limitation of CP decomposition in the settings of tensor-on-tensor regression, and hence tensor autoregression, suggests a pressing need to develop a suitable model that is not only more interpretable but can also dramatically compress parameter dimension. Beyond Tucker and CP decompositions, several works have explored

Read the complete text