Data-Adaptive Transformed Bilateral Tensor Low-Rank Representation for Clustering
Hui Chen, Xinjie Wang, Xianchao Xiu · 2025
Read Data-Adaptive Transformed Bilateral Tensor Low-Rank Representation for Clustering by Hui Chen, Xinjie Wang, Xianchao Xiu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20077.txt.
Introduction
Hui Chen and three co-authors propose a new tensor low-rank representation model for image clustering that adapts to its data. Earlier methods in this family rely on fixed transforms and handle noise poorly. Their model, called TBTLRR, learns its own unitary transforms, which lets it capture global correlations in the data more effectively.
The bilateral structure of the latent tensor also lets the model use local links between image samples and features at the same time. Added regularization terms help it cope with complex noise found in real images. An efficient solver based on the alternating direction method comes with a convergence guarantee, and experiments show gains over leading clustering methods.
Catalog record
| CREATOR | Hui Chen, Xinjie Wang, Xianchao Xiu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20077
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Data-Adaptive Transformed Bilateral Tensor Low-Rank Representation for Clustering Thanks: This work was supported in part by the Natural Science Foundation of Shanghai under Grant 24ZR1425700, the National Natural Science Foundation of China under Grant 12371306, and the Project of the State Administration of Foreign Experts under Grant H20240974. ( Corresponding author: Xianchao Xiu. ) Thanks: H. Chen and X. Wang are with the School of Automation Engineering, Shanghai University of Electric Power, Shanghai 200090, China (e-mail: [email protected]; [email protected]). Thanks: X. Xiu is with the School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China (e-mail: [email protected]). Thanks: W. Liu is with the School of Intelligent Systems Engineering, Sun Yat-sen University, Guangzhou 510275, China (e-mail: [email protected]). Hui Chen, Xinjie Wang, Xianchao Xiu Abstract Tensor low-rank representation (TLRR) has demonstrated significant success in image clustering. However, most existing methods rely on fixed transformations and suffer from poor robustness to noise. In this paper, we propose a novel transformed bilateral tensor low-rank representation model called TBTLRR, which introduces a data-adaptive tensor nuclear norm by learning arbitrary unitary transforms, allowing for more effective capture of global correlations. In addition, by leveraging the bilateral structure of latent tensor data, TBTLRR is able to exploit local correlations between image samples and features. Furthermore, TBTLRR integrates the ℓ 1 / 2 \ell_{1/2} -norm and Frobenius norm regularization terms for better dealing with complex noise in real-world scenarios. To solve the proposed nonconvex model, we develop an efficient optimization algorithm inspired by the alternating direction method of multipliers (ADMM) and provide theoretical convergence. Extensive experiments validate its superiority over the state-of-the-art methods in clustering. The code will be available at https://github.com/xianchaoxiu/TBTLRR . I Introduction High-dimensional data not only increases computational complexity but also degrades the performance of image processing and video analysis [ 1 ] . Extensive studies have shown that such data often resides in low-dimensional subspaces and can be represented as a union of multiple unknown subspaces [ 2 ] . Therefore, identifying low-dimensional subspaces that effectively capture the essential characteristics of the data is a critical issue [ 3 , 4 ] . Over the past few decades, low-rank representation (LRR) [ 5 ] has emerged as a representative subspace dimensionality reduction method, with broad applications in image denoising, face recognition, and hyperspectral analysis, see, e.g., [ 6 , 7 , 8 , 9 ] . The core of LRR is to decompose the observed data into a low-rank component that captures global correlations and a residual term that describes noise or outliers, thereby enabling accurate characterization of the global subspace structure [ 10 ] . However, when the number of available samples is insufficient, the performance of LRR will degrade significantly [ 11 ] . To address this issue, Liu et al. [ 12 ] proposed latent LRR (LLRR), which introduces latent variables to better characterize the intrinsic structure. However, the nuclear norm minimization in LLRR treats all singular values equally, which may result in a rank estimate that deviates from the actual rank. To this end, Liu et al. [ 13 ] developed an iterative reweighted Frobenius norm regularized LLRR (IRFLLRR) method that assigns adaptive weights to singular values, thereby removing sparse noise and redundancy while preserving the desired structural information. Furthermore, Hu et al. [ 14 ] proposed a LLRR variant with transformed Schatten-1 penalty called TS1-LLRR, which directly adopts a nonconvex transformed function and imposes penalties on the singular values to more accurately preserve the dominant components. In addition, Qiao et al. [ 15 ] constructed efficient subspace clustering and feature extraction (ESCFE), which reduced the computational complexity of LLRR by using the \ell_{2,1} -norm and \ell_{1,2} -norm as convex relaxations of the nuclear norm. Although matrix-based methods have shown promising performance in low-rank modeling, many real-world datasets exhibit inherently high-order structures [ 16 ] . For example, videos and color images can be represented as third-order tensors [ 17 , 18 ] . Flattening such data into matrices often destroys the spatiotemporal correlations, leading to degraded performance in clustering [ 19 ] . In this regard, Fu et al. [ 20 ] incorporated Tucker decomposition and sparse coding into LRR. However, each sample still needs to be flattened, and this may suffer from scalability limitations. Furthermore, Lu et al. [ 21 ] proposed tensor robust principal component analysis (TRPCA) based on the tensor singular value decomposition (T-SVD), which preserves multi-dimensional structures and achieves good results in video recovery. Recently, Zhou et al. [ 22 ] successfully extended LRR to tensor LRR (TLRR) and provided theoretical guarantees. Case studies confirmed that TLRR has better robustness than TRPCA. Later, Du et al. [ 23 ] regularized the \ell_{1} -norm and \ell_{2,1} -norm terms to improve robustness to complex noise, which is called enhanced TLRR (ETLRR). More recently, Ding et al. [ 24 ] generalized LLRR to bilateral tensor LRR (BTLRR), which can alleviate the potential performance degradation of TLRR under insufficient sampling. Fig. 1: Overview of the proposed TBTLRR. Firstly, TRPCA is used to remove noise from the input data. Secondly, two dictionary tensors are constructed via the T-TSVD. Thirdly, the proposed TBTLRR decomposes the data into low-rank, sparse, and Gaussian noise tensors. Finally, clustering is performed on the coefficient tensor to obtain the final results. Note that the above TLRR and BTLRR rely on the T-SVD framework and handle the tensor nuclear norm (TNN) in the Fourier domain, which assumes that the data has an optimal representation in the frequency domain. This assumption may fail to capture global structural features when correlations are stronger in other transform domains [ 25 ] . Furthermore, although the \ell_{1} -norm is widely used to characterize sparse noise, its robustness is significantly reduced when faced with mixed noise (e.g., the coexistence of sparse and Gaussian noise) [ 26 ] . Of course, noise can also affect the construction of the affinity matrix, causing weak diagonal dominance and lower clustering accuracy [ 27 ] . Although LRR-based deep learning methods have achieved impressive results in many vision tasks, they require large amounts of labeled data and high computational resources [ 28 , 29 , 30 ] . Therefore, an important question comes to us: whether it is possible to develop a novel tensor LRR framework that can adapt to different transform domains, deal with mixed noise, and improve clustering stability. Motivated by these observations, we propose a data-adaptive transformed bilateral tensor LRR (TBTLRR) method to enhance the robustness in high-dimensional data clustering, as shown in Fig. 1 . Compared to existing work, this study offers the following four key contributions. • We construct an efficient tensor representation framework by applying a data-adaptive unitary transform along the third mode and introducing the transformed TNN, thus capturing global correlations and structural dependencies more effectively than conventional FFT-based methods. • We design an enhanced denoising strategy that combines the \ell_{1/2} -norm for removing sparse noise and Frobenius norm for filtering out Gaussian noise, thereby improving the robustness under complex noise conditions. • In algorithms, we develop an alternating direction method of multipliers (ADMM)-based scheme that incorporates low-rank subspace projections to reduce computational complexity, achieving a favorable trade-off between accuracy and efficiency. • For the task of clustering, we