Conformal Anomaly Detection for Functional Data with Elastic Distance Metrics
Jason Adams [email protected], Brandon Berman [email protected] · 2025
Read Conformal Anomaly Detection for Functional Data with Elastic Distance Metrics by Jason Adams [email protected], Brandon Berman [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-01172.txt.
Introduction
Jason Adams and Brandon Berman, with co-authors, hunt outliers among curves by respecting their shape. Their 2025 paper works in functional data analysis, where each observation is a whole curve rather than a number. Shape outliers, curves with the wrong form rather than the wrong size, are the hard case for standard detectors.
Their method wraps an elastic distance, one that can stretch and align curves before comparing them, inside a conformal detection scheme with controlled error rates. Simulations compare it with rival conformal methods, and two real data sets show it at work. The authors report success at catching both size and shape anomalies.
Catalog record
| CREATOR | Jason Adams [email protected], Brandon Berman [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-01172
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Conformal Anomaly Detection for Functional Data with Elastic Distance Metrics Jason Adams [email protected], Brandon Berman [email protected] Abstract This paper considers the problem of outlier detection in functional data analysis focusing particularly on the more difficult case of shape outliers. We present an inductive conformal anomaly detection method based on elastic functional distance metrics. This method is evaluated and compared to similar conformal anomaly detection methods for functional data using simulation experiments. The method is also used in the analysis of two real exemplar data sets that show its utility in practical applications. The results demonstrate the efficacy of the proposed method for detecting both magnitude and shape outliers in two distinct outlier detection scenarios. † † shortheadings: Functional Conformal Anomaly Detection / Adams, Berman, Michalenko, and Tucker † † firstpage: 1 keywords Anomaly detection, conformal prediction, elastic functional data analysis, elastic distance, functional data 1 Introduction Functional data are prevalent in many applications across a wide range of scientific domains ( Ullah and Finch, 2013 ) . As such, methods enabling the principled statistical analysis of functional data are important. The development and application of such methods have been rich areas of research for many years, and functional data analysis (FDA) is now a well-established branch of statistics ( Ramsay and Silverman, 2005 ; Srivastava and Klassen, 2016 ; Kokoszka and Reimherr, 2017 ) . This paper introduces a novel approach to detecting anomalous functional data. Our method leverages both the conformal prediction (CP) framework ( Vovk et al., 2005 ) and the elastic functional data analysis (EFDA) framework ( Srivastava and Klassen, 2016 ) . Technical details necessary for understanding these frameworks and why they are useful for anomaly detection are provided in Section 2 . Functional data vary continuously over some independent variable or variables. In this work, we only consider univariate functional data where all functions are observed over a single independent variable. Within a given set of n observed functions, we assume that each function is observed over the same values of the independent variable. While this assumption is often not satisfied in practice, smoothing and interpolation methods can be used to adjust the observed data for this purpose. Although this is far from a trivial process, such methods for preprocessing functional data are outside the scope of this paper. We refer readers to Ramsay and Silverman (2005) as a starting point for smoothing and interpolation methods. Throughout this paper, the terms anomaly and outlier are used interchangeably to describe an observation that does not fit well within a distribution. This is in line with the definition used by Aggarwal (2016) which says that “[a]n outlier is a data point that is significantly different from the remaining data.” Within this definition, there are two distinct situations we consider. In the first scenario, a representative, outlier-free data set is available and potentially suspect observations from an external source are compared to the pristine data. In the second scenario, we seek to identify the most outlying observations within a single data set. While the method we introduce is most appropriately used in the first scenario, both scenarios are considered in the simulation experiments and analysis of exemplar data sets in Sections 4 and 5 . 1.1 Related Work Much previous work has been done in both functional outlier detection and conformal anomaly detection. This section reviews some of the most relevant methods and compares them to the present work. 1.1.1 Functional Outlier Detection Numerous methods for functional outlier detection have been proposed in the literature. Many papers distinguish between magnitude and shape outliers. As described by Hyndman and Shang (2010) , magnitude outliers “lie outside the range of the vast majority of the data” while shape outliers “may be within the range of the rest of the data but have a very different shape from other curves.” Visualization methods are often sufficient to identify magnitude outliers, but shape outliers are typically much more difficult to identify. Several approaches to functional outlier detection depend on visualization, aiming to extend standard univariate and multivariate techniques, such as boxplots or bagplots ( Rousseeuw et al., 1999 ) , to the functional case. The primary challenge with such an extension is to determine a reasonable method for ordering functional data. A robust principal component (PC) analysis is used by Hyndman and Shang (2010) to reduce the dimensionality of the functional data. Using the first two PCs, depth and density measures are used to order the PC scores. From these orderings, three functional visualization tools — the rainbow plot, the bagplot, and the boxplot - are constructed and used to detect both magnitude and shape outliers. Similarly, Sun and Genton (2011) use the concept of band depth from López-Pintado and Romo (2009) to construct functional boxplots, and Huang and Sun (2019) introduce the notion of total variation depth to order functional data and construct visualizations for detecting both magnitude and shape outliers. Arribas-Gil and Romo (2014) propose visualization tools called outliergrams, which are constructed based on metrics from López-Pintado and Romo (2011) . Noting that magnitude outliers are much easier to detect than shape outliers, Dai et al. (2020) apply several transformations to functional data so that shape outliers can be detected as magnitude outliers. Other methods of functional outlier detection do not rely on visualization. Sawant et al. (2012) develop a robust principal component method and apply a multivariate outlier detection method from Hubert et al. (2005) to the PC scores. Similarly, Yu et al. (2017) represent functional data with a B-spline basis ( Ramsay and Silverman, 2005 ) and use the minimum covariance determinant method ( Rousseeuw and Driessen, 1999 ) on the basis coefficients to detect outliers. Both of these methods can be viewed as using standard outlier detection methods on a reduced number of features extracted algorithmically from a set of functional data. In a different approach by Azcorra et al. (2018) , three features are selected to measure the degree of outlyingness in terms of magnitude, shape, and amplitude respectively (note that this paper further divides what other papers call shape outliers into both shape and amplitude outliers). Thresholds are then set on these features to identify outliers. Additionally, several methods for functional outlier detection within the EFDA framework have also been proposed. In the method proposed by Xie et al. (2017) , elastic distance metrics (discussed in more detail in Section 2 in the present work) are used to construct functional boxplots. Measures of elastic depths are introduced by Harris et al. (2021) and used to identify shape outliers. While not explicitly presented as an outlier detection method, Tucker et al. (2020) introduced functional tolerance bounds that are constructed by bootstrapping and using the EFDA boxplots of Xie et al. (2017) , and these tolerance bounds can be used to identify outliers. While the present work does make use of the EFDA framework and can be used for detecting both magnitude and shape outliers, it differs from the above-mentioned methods in its reliance on the conformal prediction framework, which none of the others use. It also does not rely on either visualization or dimension reduction/featuriziation techniques. 1.1.2 Conformal Anomaly Detection Within the conformal prediction literature, a number