Robust Tensor-on-Tensor Regression
Mehdi Hirari, Fabio Centofanti, Mia Hubert, Stefan Van Aelst · 2026
Read Robust Tensor-on-Tensor Regression by Mehdi Hirari, Fabio Centofanti, Mia Hubert, Stefan Van Aelst (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25911.txt.
Introduction
Hirari and co-authors build a regression method for tensor data that resists outliers. Tensor-on-tensor regression predicts response tensors from predictor tensors. Standard fits break when outliers strike whole cases or single cells. Their method, ROTOT, handles both kinds at once and copes with missing values. One loss function limits the pull of bad cells in the response. A robust component analysis cleans the predictors. New plots help users see which outliers were found. Tests include simulations and a face dataset used to predict facial traits.
Catalog record
| CREATOR | Mehdi Hirari, Fabio Centofanti, Mia Hubert, Stefan Van Aelst |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59793 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.25911
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Robust Tensor-on-Tensor Regression Mehdi Hirari, Fabio Centofanti, Mia Hubert, Stefan Van Aelst Abstract Tensor-on-tensor (TOT) regression is an important tool for the analysis of tensor data, aiming to predict a set of response tensors from a corresponding set of predictor tensors. However, standard TOT regression is sensitive to outliers, which may be present in both the response and the predictor. It can be affected by casewise outliers, which are observations that deviate from the bulk of the data, as well as by cellwise outliers, which are individual anomalous cells within the tensors. The latter are particularly common due to the typically large number of cells in tensor data. This paper introduces a novel robust TOT regression method, named ROTOT, that can handle both types of outliers simultaneously, and can cope with missing values as well. This method uses a single loss function to reduce the influence of both casewise and cellwise outliers in the response. The outliers in the predictor are handled using a robust Multilinear Principal Component Analysis method. Graphical diagnostic tools are also proposed to identify the different types of outliers detected. The performance of ROTOT is evaluated through extensive simulations and further illustrated using the Labeled Faces in the Wild dataset, where ROTOT is applied to predict facial attributes. Keywords: Tensor data; Tensor regression; Robust statistics; Casewise outliers; Cellwise outliers; Anomaly detection. 1 Introduction In many practical applications, data arise in the form of tensors which are multiway arrays in which each mode corresponds to a particular feature or characteristic of the data objects. For instance, collections of facial images can naturally be viewed as third-order tensors where the first two modes encode pixel positions, while the third mode captures the color information for each pixel. An example of such data is provided by the Labeled Faces in the Wild data discussed in Section 5 . A widely used strategy for analyzing tensor data is to reshape or vectorize them so that conventional matrix-based techniques can be employed. Yet, this transformation often disrupts the inherent multi-dimensional structure and inter-mode correlations, thereby discarding higher-order dependencies that may be crucial. As a result, potentially more compact and informative representations present in the original tensor form may be lost ( 33 ) . In contrast, multilinear tensor methods preserve and exploit this structure, allowing tensor models to capture these dependencies more effectively and thus yield improved interpretability and accuracy ( 4 ) . An essential component of multilinear data analysis is tensor regression, which aims to model relationships between multiway predictors and responses. Tensor regression includes a variety of modeling frameworks depending on the structure of the inputs and outputs. Scalar-on-tensor regression models ( 35 ; 8 ) estimate a scalar response from a tensor-valued predictor, whereas tensor-on-scalar approaches ( 32 ) use sets of scalar predictors to estimate a tensor response. A natural extension of these frameworks is tensor-on-tensor (TOT) regression, which aims to predict a tensor-valued response using one or more tensor-valued predictors ( 22 ; 11 ; 21 ; 31 ) . As the number of parameters in the coefficient tensor increases rapidly with its dimensionality, a low-rank structure is typically assumed to substantially reduce the number of parameters to be estimated. This reduction is commonly achieved using the CANDECOMP/PARAFAC (CP) decomposition ( 6 ; 13 ) . TOT regression has been applied across several domains, including attribute prediction from images ( 22 ) and electroencephalography prediction from functional magnetic resonance imaging ( 19 ; 31 ) . As for other data types, tensor data may also be affected by the presence of outliers. Robust statistical methods tackle this problem by producing estimates that are only marginally influenced by outliers ( 16 ; 25 ) . Using these robust fits, outliers can then be detected through their departures from the fitted model. Since the 1960s, robust statistics has primarily concentrated on casewise outliers, namely observations that deviate entirely from the bulk of the data. However, with the rise of high-dimensional settings attention has increasingly shifted toward cellwise outliers ( 1 ) , where the focus is on individual cells of observations that are anomalous. Cellwise robust procedures seek to diminish their influence while retaining the useful information contained in the remaining components of the affected observations. An effective robust method should be capable of addressing both cellwise and casewise contamination at the same time. As classical regression methods are not robust, several approaches have been developed to ensure robustness in the presence of casewise outliers, both in the response and in the predictors ( 30 ; 34 ; 26 ) . Additional methods have also been introduced to address cellwise outliers occurring in both the response and the predictors ( 27 ; 9 ) . The presence of missing values in regression settings is also a common issue encountered in practice. Various methods have been proposed to address this problem, either by discarding observations that contain missing values or by proposing an imputation scheme for the missing entries ( 3 ; 20 ) . From an applied perspective, missing values can be viewed as similar to cellwise outliers, with the distinction that their positions are known. This makes the problem particularly interesting, as imputation strategies can be developed similarly to those used for handling cellwise outliers ( 7 ) . Analogously, classical tensor regression is sensitive to both casewise and cellwise outliers. As an illustration, consider the problem of estimating a collection of facial attributes from the face image of a person who exhibits various characteristics, such as different facial expressions, ethnicity, and other traits. This analysis will be presented in Section 5 using data from the Labeled Faces in the Wild dataset ( 18 ) . The attribute values for a given individual, which form the response tensor in this context, may contain unusually large values. These are examples of cellwise outliers, where only specific attributes are affected. In some cases, most of the attribute values for an individual may be corrupted, indicating the presence of a casewise outlier. Outliers may also arise in the predictor tensor, which corresponds to the face image itself. Figure 1 compares three face images. The left panel shows a regular image, the middle panel shows an image with cellwise outliers, and the right panel shows a casewise outlier. Figure 1: Face images without contamination (left), with cellwise contamination (middle), and a casewise outlier (right). Robust methods using M-estimation have been proposed for scalar-on-tensor regression to handle casewise outliers in the response ( 28 ; 17 ) . 19 introduced a robust adaptation of TOT regression that can handle cellwise outliers in the response tensor. However, no existing TOT regression method can simultaneously handle both types of outliers and missing values in the response and predictor tensors. We therefore introduce a robust TOT regression method, termed ROTOT, that addresses both types of contamination while accommodating missing values in the response and predictor tensors. ROTOT accounts for outliers in the predictors through a robust tensor decomposition, ROMPCA ( 14 ) , yielding imputations for cellwise outliers, and casewise weights. Outliers in the response are addressing by minimizing a bounded loss function. Section 2 introduces basic multilinear concepts and our newly proposed ROTOT