Cellwise Outliers
Mia Hubert, Jakob Raymaekers, Peter J. Rousseeuw · 2026
Read Cellwise Outliers by Mia Hubert, Jakob Raymaekers, Peter J. Rousseeuw (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14182.txt.
Introduction
Hubert, Raymaekers, and Rousseeuw review cellwise outliers, single stray values inside a data matrix, as opposed to whole rogue cases. Even a small share of bad cells can taint over half the rows, defeating methods that drop or downweight entire cases. Detecting such cells and building methods robust to them needs different tools, including giving up some familiar equivariance properties. The review covers location and covariance estimation, regression, principal components, tensor data, and other settings, noting the cellwise approach now leads for high-dimensional data and handles missing values.
Catalog record
| CREATOR | Mia Hubert, Jakob Raymaekers, Peter J. Rousseeuw |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63298 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.14182
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cellwise Outliers Mia Hubert, Jakob Raymaekers, Peter J. Rousseeuw Abstract In statistics and machine learning, the traditional meaning of the terms ‘outlier’ and ‘anomaly’ is a case in the dataset that behaves differently from the bulk of the data. This raises suspicion that it may belong to a different population. But nowadays increasing attention is being paid to so-called cellwise outliers. These are individual values somewhere in the data matrix (or data tensor). Depending on the dimension, even a relatively small proportion of outlying cells can contaminate over half the cases, which is a problem for existing casewise methods. It turns out that detecting cellwise outliers as well as constructing cellwise robust methods requires techniques that are quite different from the casewise setting. For instance, one has to let go of some intuitive equivariance properties. The problem is difficult, but the past decade has seen substantial progress. For high-dimensional data the cellwise approach is becoming dominant, and typically can deal with missing values as well. We review developments in the estimation of location and covariance matrices as well as regression methods, principal component analysis, methods for tensor data, and various other settings. Keywords: Anomaly detection; Breakdown value; Multivariate statistics; Robustness; Tensor data. 1 INTRODUCTION Real-world data often contains elements that do not follow the pattern suggested by the majority of the data. Such outliers may be gross errors with the potential to severely distort a statistical analysis, but they may also be valuable pieces of information that warrant further inspection. But whatever their cause, we need to be able to detect them. The approach of robust statistics, as formalized by e.g. Huber 1964 and Hampel et al. 1986 has been to first obtain a robust fit, i.e. a model that fits the majority of the data well, and then to look for cases that deviate from that fit. An important assumption underlying this approach is that of casewise contamination, in which a case is either an outlier or free of any contamination. (This is sometimes called rowwise contamination, because cases are often encoded as rows of the data matrix, but the name casewise is more general.) Different formalizations of casewise contamination exist, but the most common one is to assume that the observed data was generated from a clean distribution F with probability 1-\varepsilon>0.5 and from an arbitrary distribution H with probability \varepsilon<0.5 . This is known as the Tukey-Huber contamination model . A commonly used formulation is X_{\varepsilon}\sim F_{\varepsilon}\coloneqq(1-\varepsilon)F+\varepsilon H . The goal is to estimate the characteristics of F given that we only observe F_{\varepsilon} and, importantly, we don’t assume anything about H . The casewise contamination model can equivalently be written as X_{\varepsilon}=A^{\text{\scriptsize{case}}}\odot X+(\bm{1}_{d}-A^{\text{\scriptsize{case}}})\odot Z (1) where the Hadamard product \odot multiplies vectors (and matrices) entry by entry, and \bm{1}_{d} is a column vector with all d components equal to 1 . We assume that X , A^{\text{\scriptsize{case}}} and Z are mutually independent, with X\sim F and Z\sim H . The d -variate variable A^{\text{\scriptsize{case}}} has Bernoulli distributed marginals A_{j}^{\text{\scriptsize{case}}} for j=1,\ldots,d with success parameter 1-\varepsilon^{\text{\scriptsize{case}}} , that are fully dependent in the sense that P(A_{1}^{\text{\scriptsize{case}}}=\ldots=A_{d}^{\text{\scriptsize{case}}})=1 . Alqallaf et al. 2009 call this the fully dependent contamination model . It implies that on average, (1-\varepsilon^{\text{\scriptsize{case}}})100\% of the cases are clean. The left panel of Figure 1 visualizes this setting for a toy data set with 15 cases and 10 variables. Here 3 out of the 15 cases (20%) are casewise outliers. Figure 1: Illustration of the casewise, cellwise, and mixed contamination models. Black means outlying, and white cells are missing. Casewise robust methods require that at least half of the cases are entirely uncontaminated. This assumption is often realistic in low-dimensional datasets, but less so in high dimensions because then there are many variables in which something can go wrong. Moreover, casewise robust methods work by downweighting or deleting all variables of the outlying cases, whereas their outlying behavior might occur in only a few measurements. This has motivated the study of cellwise outliers . These are deviating measurements (cells) that can occur anywhere in the data matrix. The cellwise contamination model assumes that the data are generated according to X_{\varepsilon}=A^{\mbox{\scriptsize{cell}}}\odot X+(\bm{1}_{d}-A^{\mbox{\scriptsize{cell}}})\odot Z (2) with X and Z as in ( 1 ). The d -variate variable A^{\mbox{\scriptsize{cell}}} has Bernoulli components A_{j}^{\mbox{\scriptsize{cell}}} with success probability 1-\varepsilon^{\mbox{\scriptsize{cell}}}_{j} . If the components of A^{\mbox{\scriptsize{cell}}} are independent , we obtain the fully independent contamination model of Alqallaf et al. 2009 . Then on average each variable has (1-\varepsilon^{\mbox{\scriptsize{cell}}}_{j})100\% clean values, but even a relatively small proportion of outlying cells can contaminate over half the cases, which may cause casewise robust methods to fail. The middle panel of Figure 1 illustrates how a dataset with 22/150\approx 15\% of outlying cells yields only 4/15\approx 27\% entirely uncontaminated cases. It also illustrates that a case can have zero, one, a few, or many outlying cells. In general, the probability that a case contains at least one outlying cell is 1-(1-\varepsilon^{\mbox{\scriptsize{cell}}})^{d} which grows quickly with the dimension d . For instance, when \varepsilon^{\mbox{\scriptsize{cell}}}=0.05 and d=14 this probability is 51%. It increases to 97% when d=70 , thus impacting the vast majority of cases. In real data, both types of outliers can occur simultaneously, and some values might be missing. The mixed contaminated and partially observed model of Centofanti et al. 2026 says that X_{\varepsilon}=A\odot X+(\bm{1}_{d}-A)\odot Z (3) where A=A^{\text{\scriptsize{case}}}\odot A^{\mbox{\scriptsize{cell}}}\odot A^{\mbox{\scriptsize{obs}}} , the variable A^{\text{\scriptsize{case}}} is defined as in formula ( 1 ), and A^{\mbox{\scriptsize{cell}}} as in ( 2 ). The entries A_{j}^{\mbox{\scriptsize{obs}}} in A^{\mbox{\scriptsize{obs}}} are binary variables with possible outcomes 1 and NA, and P(A_{j}^{\mbox{\scriptsize{obs}}}=1)=1-\varepsilon^{\mbox{\scriptsize{obs}}}_{j} . The right panel of Figure 1 shows a toy example. Different assumptions on the dependence structure of X , Z , A^{\text{\scriptsize{case}}} , A^{\mbox{\scriptsize{cell}}} and A^{\mbox{\scriptsize{obs}}} lead to different contamination models. For instance, when A^{\mbox{\scriptsize{obs}}} is independent of the other variables, the values in the dataset are missing completely at random. Long before the notion of cellwise outliers appeared in print in Alqallaf et al. 2009 , it was discussed informally by some. One of us remembers clearly that the topic was brought up in the early eighties in seminar talks by Alfio Marazzi and Werner Stahel at ETH Zürich. It was presented as an open problem, with the formula 1-(1-\varepsilon^{\mbox{\scriptsize{cell}}})^{d} . At that time the available tools appeared insufficient to address this challenge. The remainder of the paper is organized as follows. Section 2 gives an overview of methods to detect outlying cells. Section 3 surveys the work on cellwise robust estimation of multivariate location and covariance matrices, and Section 4 reviews the work on regression. Section 5 looks at methods specifically designed for high-dimensional data, and tensors are treated in Section 6 . Section 7 summarizes work in other statistical settings, and Section 8 concludes. 2 DETECTING CELLWISE OUTLIERS The detection of cellwise outliers is not easy. A natural approach is to look at each individual variable, and identify marginal outliers through, for example, robust z-scores. A more refined version of this principle is the filter introduced by Gervini and Yohai 2002 . When variables are asymmetric, we can first apply the robust transformation towards symmetry constructed by Raymaekers and Rousseeuw 2024b . Detecting cellwise