Cellwise Robust Discriminant Analysis
Fabio Centofanti, Can Hakan Dağıdır, Mia Hubert, Peter J. Rousseeuw · 2026
Read Cellwise Robust Discriminant Analysis by Fabio Centofanti, Can Hakan Dağıdır, Mia Hubert, Peter J. Rousseeuw (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30178.txt.
Introduction
Fabio Centofanti and three co-authors propose discriminant analysis robust to cellwise outliers, single unexpected entries in a data matrix, not whole outlying cases. Classical methods rely on class means and covariances sensitive to outliers, and dropping a case for one bad cell wastes information. Their method estimates each class location and covariance with cellwise and casewise robust estimators, and derives a robust discriminant function by penalized maximum likelihood. The cellQDA and cellLDA variants cover quadratic and linear analysis and perform well in simulation, illustrated on real data.
Catalog record
| CREATOR | Fabio Centofanti, Can Hakan Dağıdır, Mia Hubert, Peter J. Rousseeuw |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57383 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30178
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cellwise Robust Discriminant Analysis Fabio Centofanti, Can Hakan Dağıdır, Mia Hubert, Peter J. Rousseeuw Abstract Classical discriminant analysis (DA) is based on the mean and empirical covariance matrix of each class, both of which are sensitive to outliers in the data. In the past the focus was on casewise outliers, that is, datapoints that lie far away. But nowadays there is increasing interest in cellwise outliers, that are unexpected entries in the data matrix. Removing an entire case because it has one or a few outlying cells would lose much information. Cellwise robust methods aim to detect the outlying cells and to preserve the information in the other cells. We propose a DA method that is trained by estimating the location and covariance of each class by cellwise and casewise robust estimators, that can also handle NA’s. The main novelty of our approach is in the prediction on test data, that may contain outlying cells and NA’s themselves. The new robust discriminant function is derived from a novel statistical model by penalized maximum likelihood. We focus on quadratic DA, but also cover the setting of linear DA. The new cellQDA and cellLDA methods perform well in simulation. The approach is illustrated on real data, and the results are interpreted with the help of graphical displays. Keywords: Cellwise outliers, Linear discriminant analysis, Quadratic discriminant analysis, Robust statistics, Supervised classification. 1 Introduction Discriminant analysis (DA) is a supervised classification method for multivariate data. Classical Linear Discriminant Analysis (LDA) and Classical Quadratic Discriminant Analysis (QDA) are derived under the assumption of multivariate normal classes. In this setting, the center of a class is estimated by its arithmetic mean, and its scatter matrix is estimated by its empirical covariance matrix. However, both of these estimators are sensitive to outliers. The presence of outliers can therefore hurt the classification accuracy. The search for robust DA methods has traditionally focused on casewise outliers, that is, cases that lie far from the majority of their class. Substantial progress has been made in this area by inserting robust estimates of the center and scatter matrix of each class, as done by He and Fung 2000 , Croux and Dehon 2001 , Hubert and Van Driessen 2004 , Filzmoser et al. 2012 , Pinheiro et al. 2025 , and Becquart et al. 2026 . Casewise robust methods downweight or discard entire rows of the data matrix, which is appropriate when the outlying cases are members of a different population. But in recent times people have become aware that there is also another common type of contamination, the so-called cellwise outliers. In that setting only a few cells (entries) of a case may be suspect, while the remaining entries still contain valuable information. Even a relatively small percentage of outlying cells in the data matrix can pollute over half of the cases. When that happens, casewise robust estimators may be ineffective. Moreover, an outlying cell may be difficult to detect, as it does not have to be a marginal outlier: it suffices that its value differs markedly from what would be expected based on the relations between the variables. For instance, a child’s weight may be unremarkable by itself, but incompatible with its age and height. Therefore there is a growing need for methods to detect outlying cells and/or provide robust estimates when they occur. In particular, cellwise robust discriminant analysis has received limited attention in the literature, in spite of the practical importance of this problem. A notable exception is Aerts and Wilms 2017 , who estimated the scatter matrix of each class by the cellwise robust method of Croux and Öllerer 2016 . This approach yielded a robustly trained DA model. However, it did not yet provide a robust out-of-sample prediction method. Such a mechanism would be very useful when dealing with test data that themselves contain outlying cells. To illustrate this issue, Figure 1 shows a toy example with three classes. Suppose that the training data was clean, so that the centers and covariance matrices of the classes are accurate. They yield the tolerance ellipses in the plot, and the quadratic boundaries of QDA shown as curved lines. The points in the figure are out-of-sample new data. Point a of class 2 has an outlying cell in its second variable so it ends up higher, in the decision region of class 1. Therefore the usual discriminant rule would assign it to class 1, even though it is far away from that class as well. Similarly, point b of class 3 would be assigned to class 2 due to its outlying cell in the first variable. Our task is to come up with an approach to assign points with outlying cells to the right class, also in higher dimensions where visual inspection would not suffice. We will revisit this example later. Figure 1: Illustrative example with 3 classes and their QDA boundaries. The out-of-sample points a and b each contain an outlying cell. The usual discriminant rule would misclassify them. In this paper we propose a new cellwise robust approach to both LDA and QDA, that we will call cellLDA and cellQDA. Our methodology addresses both stages of the classification pipeline. In the training phase, we use the recent cellwise MCD estimator of Raymaekers and Rousseeuw 2024 to obtain a location and scatter matrix of each class. The main novelty of our work is in the second stage, where our out-of-sample prediction method can handle outlying cells in the test data. For this purpose it adopts a new statistical model that extends the existing cellwise contamination model. After fitting this model on the training data, it is applied out-of-sample by flagging outlying cells in new cases, and using a new robust discriminant function. It is worth noting that all the components of this approach, from the estimation of the centers and the covariance matrices in training, to the flagging of outlying cells out-of-sample, and the derivation of the new discriminant function, are all based on the same penalized maximum likelihood. Due to this unification, the approach also handles missing values in a natural way. To enhance interpretability, we also provide a graphical display that enables users to visually distinguish between clean cases, cases that are classified correctly despite some outlying cells, and casewise outliers. The remainder of the paper is organized as follows. Section 2 describes the proposed methodology for in-sample and out-of-sample data. Section 3 evaluates the performance of cellLDA and cellQDA through simulation, under various contamination scenarios. Section 4 illustrates the approach on a real dataset of nutritional values. Section 5 concludes. 2 Methodology Suppose we have training data with G classes g=1,\ldots,G . Each class contains d -variate points \bm{x}_{g,i} for i=1,\ldots,n_{g} , and n=\sum_{g=1}^{G}n_{g} . The goal of discriminant analysis (DA) is to construct a classification rule based on the training data, that generalizes well to new data. 2.1 Classical discriminant analysis The classical framework assumes that each class g contains d -variate points that were generated by a multivariate normal distribution. Formally, it assumes that the random vector \mathcal{X} follows the generative model \mathcal{X}\bm{|}(\mathcal{G}=g)\sim\mathcal{N}(\bm{\mu}_{g},\bm{\Sigma}_{g})\quad\mbox{with}\quad P(\mathcal{G}=g)=\pi_{g} where \bm{\mu}_{g} and \bm{\Sigma}_{g} are the class-specific location vector and scatter matrix. This is called a normal mixture