Area-based epigraph and hypograph indices for functional outlier detection.

Belén Pulido, Alba M. Franco-Pereira, Rosa E. Lillo, Fabian Scheipl · 2025

Read Area-based epigraph and hypograph indices for functional outlier detection. by Belén Pulido, Alba M. Franco-Pereira, Rosa E. Lillo, Fabian Scheipl (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05701.txt.

Introduction

Belén Pulido, Alba Franco-Pereira, Rosa Lillo, and Fabian Scheipl build better tools for spotting outlying curves in functional data. A curve can stray from the pack in shape, in size, or in both. Older ranking indices compare how often one curve lies above another, which catches shape oddities but misses curves that are simply too big or too small.

The new indices measure the area between curves instead, so size and shape both count. The team applies them to each curve and its first two derivatives, then hands the resulting numbers to standard multivariate outlier detectors, a procedure they call EHyOut. In simulations it stayed steady under many kinds of contamination and often beat established methods. Tests on Spanish weather curves and world population curves showed it flags sensible cases.

Catalog record

CREATORBelén Pulido, Alba M. Franco-Pereira, Rosa E. Lillo, Fabian Scheipl
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05701

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Area-based epigraph and hypograph indices for functional outlier detection. Belén Pulido, Alba M. Franco-Pereira, Rosa E. Lillo, Fabian Scheipl Abstract Detecting outliers in Functional Data Analysis is challenging because curves can stray from the majority in many different ways. The Modified Epigraph Index (MEI) and Modified Hypograph Index (MHI) rank functions by the fraction of the domain on which one curve lies above or below another. While effective for spotting shape anomalies, their construction limits their ability to flag magnitude outliers. This paper introduces two new metrics, the Area-Based Epigraph Index (ABEI) and Area-Based Hypograph Index (ABHI) that quantify the area between curves, enabling simultaneous sensitivity to both magnitude and shape deviations. Building on these indices, we present EHyOut, a robust procedure that recasts functional outlier detection as a multivariate problem: for every curve, and for its first and second derivatives, we compute ABEI and ABHI and then apply multivariate outlier-detection techniques to the resulting feature vectors. Extensive simulations show that EHyOut remains stable across a wide range of contamination settings and often outperforms established benchmark methods. Moreover, applications to Spanish weather data and United Nations world population data further illustrate the practical utility and meaningfulness of this methodology. keywords Epigraph , Hypograph , Outliers , Functional data † † orcid: 0000-0003-2105-959X , , and 1 Introduction The analysis of data where observations can be considered as functions, has become a cornerstone of modern statistics. This field of study is called Functional Data Analysis (FDA) and provides tools to explore patterns and variability in phenomena that evolve over a continuum. A complete overview of FDA can be found in Ramsay and Silverman 2005 , and Ferraty and Vieu 2006 , while some interesting reviews of functional data can be found in Horváth and Kokoszka 2012 , Hsing and Eubank 2015 , and Wang, Chiou and Müller 2016 . This paradigm has become important in several areas, such as medicine, finance and environmental sciences, where grasping the structures and tendencies in data leads to more informed decisions and innovative advancements. Despite extensive research, there is no universally accepted definition of what an outlier is. Hawkins 1980 defined an outlier as “an observation which deviates so much from the other observations as to arouse suspicions that it was generated by a different mechanism.” Barnett et al. 1994 described an outlier as “an observation (or subset of observations) which appears to be inconsistent with the remainder of that set of data”. These definitions highlight that outliers are often identified by their inconsistency with the rest of the data, which may not always be precise or mathematically defined. Defining and identifying outliers in FDA continues to be a significant problem. If undetected, such outliers can greatly distort statistical conclusions and how well models work. Conversely, they might also highlight specific data of interest that require closer examination. Functional outliers can manifest in multiple ways, including deviations in magnitude, shape, phase, or a combination of all of these types. This variety presents a significant challenge to the development of general-purpose outlier detection methods. See the discussion in Herrmann and Scheipl 2021 . A significant body of research on functional outlier detection leverages the concept of statistical depth, which provides a center-outward ordering of observations (see Vardi and Zhang 2000 ; Fraiman and Muniz 2001 ; López-Pintado and Romo 2009 , e.g.) . For example, the functional boxplot ( Sun and Genton 2011 ) applies band depth notions to flag outlying curves. Moreover, depth measures continue to be an active area of investigation for outlier detection with recent works such as Jiménez-Varón, Harrou and Sun 2024 . A different approach for ordering functions from top to bottom, or vice-versa is using the the epigraph and hypograph indices, first proposed by Franco-Pereira, Lillo and Romo 2011 . They were proposed to characterize extremality of functions but have been also considered for outlier detection in the functional data literature. Some examples are the outliergram ( Arribas-Gil and Romo 2014 ) and the functional boxplot based on epigraphs and hypographs ( Martin-Barragan, Lillo and Romo 2016 ) . However, the utility of these indices for general-purpose outlier detection is limited by their design, relying on the Lebesgue measure, which quantifies the proportion of the domain of dominance but remains unaffected by the magnitude of the vertical distance between curves. To address this limitation, this paper introduces improved versions of these indices: the Area-Based Epigraph and Hypograph indices, ABEI and ABHI, respectively. These new approaches take into account the area between different curves. The paper then defines and evaluates EHyOut, a novel approach for outlier detection in functional data which aims to identify outlying curves regardless of outlier type, using ABEI and ABHI. This paper is organized as follows. Section 2 reviews the definition of the epigraph and hypograph indices, and proposes the alternative definitions based on areas. In Section 3 , the EHyOut methodology for outlier detection in functional data based on the proposed indices is defined. The section also describes a large-scale simulation set-up used for deciding algorithm details based on simulations and for evaluating and comparing the performance of our proposal. Section 4 evaluates EHyOut by comparing its performance with benchmark methodologies on simulated datasets, and Section 5 applies EHyOut to two real-world datasets: the Spanish weather dataset and the World population dataset from the United Nations. Finally, Section 6 concludes with final remarks and avenues for future research. 2 Epigraph and hypograph indices The epigraph and hypograph indices were first introduced by Franco-Pereira, Lillo and Romo 2011 as a measure of the “extremality” of a given curve with respect to a reference set of curves. These indices provide an ordering of the curves in the sample, ranking them from top to bottom or vice-versa as an alternative to statistical functional depth functions, which provide a center-outward ranking of curves. Various proposals for statistical (functional) depths can be found in Vardi and Zhang 2000 , Fraiman and Muniz 2001 , Cuevas, Febrero and Fraiman 2006 , Cuesta-Albertos and Nieto-Reyes 2008 , López-Pintado and Romo 2009 , López-Pintado and Romo 2011 , and Sguera, Galeano and Lillo 2014 . The epigraph and hypograph indices have been applied in different contexts, including the outliergram proposed in Arribas-Gil and Romo 2014 , the functional boxplot in Martin-Barragan, Lillo and Romo 2016 , the homogeneity test from Franco-Pereira and Lillo 2020 , or the clustering methodology introduced in Pulido, Franco-Pereira and Lillo 2023 ; Pulido, Franco-Pereira and Lillo 2025 . To formally define these indices, consider the space of real continuous functions C(\mathcal{I},\mathbb{R}) over a compact interval \mathcal{I} to \mathbb{R} . Let X\colon\mathcal{I}\longrightarrow\mathbb{R} be a stochastic process with probability distribution P_{X} . The graph of a function x in C(\mathcal{I},\mathbb{R}) is denoted as G(x)=\{(t,x(t)):\ t\in\mathcal{I}\}. Given a set of curves \{x_{1}(t),...,x_{n}(t)\} , the modified epigraph and the hypograph indices of a curve x , denoted as \mathrm{MEI}_{n}(x) and \mathrm{MHI}_{n}(x) respectively, are defined as follows: \mathrm{MEI}_{n}(x)=1-\sum_{i=1}^{n}{\frac{\lambda(\{t\in\mathcal{I}:x_{i}(t)\geq x(t)\})}{n\lambda(\mathcal{I})}}, (1) where \lambda stands for Lebesgue’s measure on \mathbb{R} . The modified hypograph index (MHI) is obtained by considering the inequality in the opposite direction: \mathrm{MHI}_{n}(x)=\sum_{i=1}^{n}{\frac{\lambda(\{t\in\mathcal{I}:x_{i}(t)\leq x(t)\})}{n\lambda(\mathcal{I})}}. (2) These definitions offer an interpretation of the indices as the proportion of time (when \mathcal{I} is treated

Read the complete text