StoTAM: Stochastic Alternating Minimization for Tucker-Structured Tensor Sensing

Shuang Li · 2026

Read StoTAM: Stochastic Alternating Minimization for Tucker-Structured Tensor Sensing by Shuang Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13522.txt.

Introduction

Shuang Li speeds up low rank tensor sense for Tucker forms by a chance based step swap rule. Tensor sense works back a big multi way array from few reads. Low Tucker rank forms are prized since they hold multi mode plans in small room. Past tools project the full array at dear cost, or split it yet still sum full gradients.

Their rule is called StoTAM. It swaps steps in a round and uses chance picks in place of full sums. Each step then works on a part of the task, not the whole. For signal and learn teams with huge arrays, a cheaper step can be the gap of a run that ends and one that times out.

Catalog record

CREATORShuang Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-13522

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

StoTAM: Stochastic Alternating Minimization for Tucker-Structured Tensor Sensing Shuang Li Abstract Low-rank tensor sensing is a fundamental problem with broad applications in signal processing and machine learning. Among various tensor models, low-Tucker-rank tensors are particularly attractive for capturing multi-mode subspace structures in high-dimensional data. Existing recovery methods either operate on the full tensor variable with expensive tensor projections, or adopt factorized formulations that still rely on full-gradient computations, while most stochastic factorized approaches are restricted to tensor decomposition settings. In this work, we propose a stochastic alternating minimization algorithm that operates directly on the core tensor and factor matrices under a Tucker factorization. The proposed method avoids repeated tensor projections and enables efficient mini-batch updates on low-dimensional tensor factors. Numerical experiments on synthetic tensor sensing demonstrate that the proposed algorithm exhibits favorable convergence behavior in wall-clock time compared with representative stochastic tensor recovery baselines. I Introduction Tensors are higher-order extensions of vectors and matrices. They provide a natural and powerful framework for representing and analyzing multi-dimensional data across a wide range of applications in signal processing and machine learning, including hyperspectral imaging [ 1 , 2 ] , phase imaging [ 3 , 4 ] , video processing [ 5 , 6 ] , wireless communications [ 7 , 8 ] , deep networks [ 9 , 10 ] , and quantum state tomography [ 11 , 12 ] . However, the extremely high dimensionality of tensor data poses significant challenges in storage, computation, and learning. Tensor decomposition offers an effective tool to exploit the intrinsic low-dimensional structure underlying high-dimensional tensors. Among various models, the CANDECOMP/PARAFAC (CP), Tucker, and tensor train (TT) decompositions are the three most widely used approaches, enabling compact representations and efficient processing of large-scale tensor data [ 13 , 14 , 15 ] . In recent years, low-rank tensor recovery from incomplete and linear measurements has attracted significant attention. To address these problems, a variety of recovery algorithms have been proposed from different perspectives. One representative class of methods is based on tensor nuclear norm minimization [ 16 , 17 , 18 , 19 ] . Unlike low-rank matrix recovery, where nuclear norm minimization provides a tractable convex surrogate for rank minimization, computing the nuclear norm of high-order tensors is known to be NP-hard [ 20 , 21 ] . Another important class of methods is tensor iterative hard thresholding (TIHT) and its variants [ 22 , 23 , 24 , 25 , 26 ] . These approaches formulate the recovery problem directly over the full tensor variable and typically require an expensive tensor projection step, whose computational complexity grows rapidly with the tensor dimension. To alleviate these limitations, a third class of methods adopts a factorized formulation and directly optimizes over tensor factors. By representing the target tensor in terms of low-dimensional tensor factors, these approaches significantly reduce the number of optimization variables and avoid explicit tensor projections, leading to improved computational efficiency [ 27 , 28 , 29 , 30 , 31 ] . However, a critical limitation remains: computing full gradients or processing all measurements in each iteration becomes prohibitively expensive for large-scale problems. Stochastic and mini-batch optimization techniques therefore provide a natural way to improve scalability. In particular, stochastic optimization has been extensively studied for tensor decompositions from complete data, especially under CP and Tucker factorized models [ 32 , 33 , 34 , 35 , 36 , 37 , 38 ] . On the other hand, existing stochastic methods for low-rank tensor recovery, such as stochastic TIHT (StoTIHT) [ 25 ] , still operate on the full tensor variable and require expensive tensor projection steps at each iteration, which significantly limits their practical efficiency. While CP factorization provides a compact representation, Tucker models offer greater flexibility in capturing multi-mode subspace structures and have been widely adopted in tensor sensing and recovery problems. Motivated by these observations, we focus on low-Tucker-rank tensor recovery and investigate whether stochastic optimization can be effectively integrated with Tucker factorization to achieve efficient, projection-free, and scalable recovery from linear measurements. In this work, we propose a stochastic Tucker alternating minimization (StoTAM) algorithm for Tucker-structured tensor sensing. By explicitly exploiting the Tucker factorization, StoTAM optimizes over the core tensor and factor matrices in an alternating minimization framework. The core tensor is updated via a closed-form least-squares solution, while the factor matrices are updated using mini-batch stochastic gradients followed by QR-based retractions. Compared with the existing StoTIHT method, StoTAM directly optimizes over the tensor factors and avoids repeated tensor projections, which significantly reduces memory and computational costs, making it suitable for large-scale tensor recovery problems. Numerical experiments demonstrate that StoTAM consistently achieves faster convergence in wall-clock time than the StoTIHT baseline. The remainder of this paper is organized as follows. In Section II , we introduce some basic tensor preliminaries used throughout the paper. In Section III , we formulate the tensor recovery problem and review the StoTIHT baseline. We present the proposed StoTAM algorithm in Section IV and provide numerical simulation results to demonstrate the effectiveness of the proposed method in Section V . Finally, we conclude the paper and discuss some future directions in Section VI . Notation: Scalars, vectors, matrices, and tensors are denoted by regular letters (e.g., x ), bold lowercase letters (e.g., \mathbf{x} ), bold uppercase letters (e.g., \mathbf{X} ), and bold calligraphic letters (e.g., \bm{\mathcal{X}} ), respectively. We define [m]\triangleq\{1,2,\ldots,m\} . The operator \vec{(}\cdot) denotes the vectorization of a matrix or tensor obtained by stacking all its entries into a column vector. The Kronecker product is denoted by \otimes . For a vector or matrix, the superscript “ ⊤ ” denotes its transpose. We use \mathbf{X}^{\dagger} to denote the Moore-Penrose pseudoinverse of a matrix \mathbf{X} . The identity matrix of size r is denoted by {\mathbf{I}}_{r} . The Stiefel manifold \operatorname{St}\left(n,r\right) is defined as the set of all n\times r matrices with orthonormal columns, i.e., \operatorname{St}\left(n,r\right)=\left\{\mathbf{U}\in{\mathbb{R}}^{n\times r}:\mathbf{U}^{\top}\mathbf{U}={\mathbf{I}}_{r}\right\}. II Preliminaries In this section, we briefly review the fundamental concepts and notations from tensor analysis that will be used throughout the paper. Although we focus on third-order tensors for notational simplicity, all developments can be directly extended to higher-order tensors. For a third-order tensor \bm{\mathcal{X}}\in{\mathbb{R}}^{n_{1}\times n_{2}\times n_{3}} , we use \mathcal{X}(i_{1},i_{2},i_{3}) to denote its (i_{1},i_{2},i_{3}) -th entry. The inner product between two tensors \bm{\mathcal{X}},\bm{\mathcal{Y}}\in{\mathbb{R}}^{n_{1}\times n_{2}\times n_{3}} is defined as \langle\bm{\mathcal{X}},\bm{\mathcal{Y}}\rangle\triangleq\sum_{i_{1}=1}^{n_{1}}\sum_{i_{2}=1}^{n_{2}}\sum_{i_{3}=1}^{n_{3}}\mathcal{X}(i_{1},i_{2},i_{3})\mathcal{Y}(i_{1},i_{2},i_{3}). The induced Frobenius norm is then defined as \|\bm{\mathcal{X}}\|_{F}\triangleq\sqrt{\langle\bm{\mathcal{X}},\bm{\mathcal{X}}\rangle} . These definitions extend the standard inner product and Frobenius norm for vectors and matrices. Denote \mathbf{X}^{(k)} as the mode- k matricization/unfolding of a tensor \bm{\mathcal{X}}\in{\mathbb{R}}^{n_{1}\times n_{2}\times n_{3}} . We say a third-order tensor \bm{\mathcal{X}}\in{\mathbb{R}}^{n_{1}\times n_{2}\times n_{3}} admits a Tucker decomposition with multilinear \operatorname{rank}\mathbf{r}=\left(r_{1},r_{2},r_{3}\right) if it can be written as \bm{\mathcal{X}}=\bm{\mathcal{S}}\times_{1}\mathbf{U}_{1}\times_{2}\mathbf{U}_{2}\times_{3}\mathbf{U}_{3}, where \bm{\mathcal{S}}\in\mathbb{R}^{r_{1}\times r_{2}\times r_{3}} with r_{k}=\operatorname{rank}(\mathbf{X}^{(k)}) is the core tensor, and the factor matrices \mathbf{U}_{k}\in\mathbb{R}^{n_{k}\times r_{k}} have orthonormal columns. The product \times_{k} denotes the mode- k product of a tensor with a matrix. We use \operatorname{rank}(\bm{\mathcal{X}})\preceq\mathbf{r} to indicate \operatorname{rank}(\mathbf{X}^{(k)})\leq r_{k} for all k=1,2,3 . III Problem Formulation Consider the recovery of a third-order tensor \bm{\mathcal{X}}^{\star}\in{\mathbb{R}}^{n_{1}\times n_{2}\times n_{3}} from a set of linear measurements \mathbf{y}=\mathcal{A}(\bm{\mathcal{X}}^{\star})\in{\mathbb{R}}^{m} . Here, the linear operator \mathcal{A}:{\mathbb{R}}^{n_{1}\times n_{2}\times n_{3}}\rightarrow{\mathbb{R}}^{m} is defined by [\mathcal{A}(\bm{\mathcal{X}})]_{i}=\langle\bm{\mathcal{A}}_{i},\bm{\mathcal{X}}\rangle,\quad i\in[m], where \bm{\mathcal{A}}_{i}\in{\mathbb{R}}^{n_{1}\times n_{2}\times n_{3}} denotes the i -th

Read the complete text