Evaluating Simplification Algorithms for Interpretability of Time Series Classification
Brigt Håvardstun, Félix Martí-Perez, Cèsar Ferri, Jan Arne Telle · 2025
Read Evaluating Simplification Algorithms for Interpretability of Time Series Classification by Brigt Håvardstun, Félix Martí-Perez, Cèsar Ferri, Jan Arne Telle (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08846.txt.
Introduction
Brigt Håvardstun, Félix Martí-Perez, Cèsar Ferri, and Jan Arne Telle evaluate ways of simplifying time series so classifiers become easier to interpret, in a two thousand twenty-five paper. Time series data, unlike text or images, are hard for people to read directly.
The authors propose metrics covering the complexity of a simplification and its loyalty to the original classification. Simplifications that keep a subset of the original points tend to score high Shapley values. They test four simplification algorithms across several classifiers and dataset types, then confirm the metrics' usefulness in a human study. A decision framework summarizes when simplifications help.
Catalog record
| CREATOR | Brigt Håvardstun, Félix Martí-Perez, Cèsar Ferri, Jan Arne Telle |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08846
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating Simplification Algorithms for Interpretability of Time Series Classification Brigt Håvardstun, Félix Martí-Perez, Cèsar Ferri, Jan Arne Telle Abstract In this work, we introduce metrics to evaluate the use of simplified time series in the context of interpretability of a TSC - a Time Series Classifier. Such simplifications are important because time series data, in contrast to text and image data, are not intuitively understandable to humans. These metrics are related to the complexity of the simplifications - how many segments they contain - and to their loyalty - how likely they are to maintain the classification of the original time series. We focus on simplifications that select a subset of the original data points, and show that these typically have high Shapley value, thereby aiding interpretability. We employ these metrics to experimentally evaluate four distinct simplification algorithms, across several TSC algorithms and across datasets of varying characteristics, from seasonal or stationary to short or long. We subsequently perform a human-grounded evaluation with forward simulation, that confirms also the practical utility of the introduced metrics to evaluate the use of simplifications in the context of interpretability of TSC. Our findings are summarized in a framework for deciding, for a given TSC, if the various simplifications are likely to aid in its interpretability. keywords Interpretability, Time Series Classification, Simplifications, User Evaluations 1 Introduction Temporal data is encountered in many real-world applications ranging from patient data in healthcare ( Rajkomar et al., 2018 ) to the field of cyber security ( Susto et al., 2018 ) . Deep learning methods have been successful for TSC - Time Series Classification - ( Ismail Fawaz et al., 2019 ; Rajkomar et al., 2018 ; Susto et al., 2018 ) but such methods are not easily interpretable, and often viewed as black boxes, which limits their applications when user trust in the decision process is crucial. To enable the analysis of these black-box models we revert to post-hoc interpretability. Recent research has focused on adapting existing methods to time series, where we can find specific methods like SHAP-LIME ( Guillemé et al., 2019 ) , Saliency Methods ( Ismail et al., 2020 ) , and Counterfactuals ( Delaney et al., 2021 ) , and also combinations of these ( Schlegel et al., 2019 ) . As humans learn and reason by forming mental representations of concepts based on examples, and any machine learning model has been trained on data, then we believe that data e.g. in the form of prototypes and counterfactuals is indeed the natural common language between the user and this model. However, the basic problem is that compared to images and text, time series data are not intuitively understandable to humans ( Siddiqui et al., 2019 ) . This makes interpretability of time series extra demanding, both when it comes to understanding how users will react to the provided explanations and to predict what explanatory tools are best. For example, in ( Håvardstun et al., 2024 ) a tool was given for explainability of a TSC, that allowed model inspection so the user could form their own mental model of the classifier. However, a user evaluation showed that non-expert end-users were not able to make use of this freedom, supporting the notion that time-series are particularly non-intuitive for humans. In ( Theissler et al., 2022 ) , authors give an intriguing taxonomy of XAI for TSC, divided into those focused on (i) Time-points (e.g. SHAP and LIME) or (ii) Subsequences (e.g. Shapelets) or (iii) Instances (Prototypes, CF, Feature-based). Explaining a classifier by instances like prototypes has a definite appeal, but it is a challenge how to highlight features important for the classification, while at the same time simplifying the instance to mitigate the non-intuitive aspects of this domain. In ( Theissler et al., 2022 ) the authors also review the literature on XAI for TSC and of the 9 papers they discuss on Instance-based explanations using Prototypes or Features, it is remarkable that not a single one is specialised for Local explanations, rather they are all Global. The algorithms we evaluate in this paper fill this gap, as they are ways of simplifying a time series by straight-line segments 1 1 1 Piecing together several such local explanations, say for prototypes of each class, this can still form a global explanation of the given TSC. . We focus on Piecewise-linear sketches since they keep every retained point on the true time-and-value axes, so users can read magnitudes and slopes directly, without translating bins or symbols. This matches the canonical line-chart format that dashboards and decades of perception studies show that people understand quickly and accurately ( Cleveland and McGill, 1984 ; Heer and Bostock, 2010 ) . We introduce metrics to evaluate the use of algorithms computing simplified time series in the context of interpretability of a TSC. This addresses the key challenge that time series data, in contrast to text and image data, are not intuitively understandable to humans. These metrics are related to the complexity of the simplifications produced by the algorithms - how many data points they maintain as a percentage of the original - and to their loyalty - how likely they are to maintain the classification of the original time series. We first employ these metrics to theoretically and experimentally evaluate four distinct simplification algorithms, across several TSC algorithms and across datasets of varying characteristics, from seasonal or stationary to short or long. We also employ the metrics in a practical setting, doing a quantitative user evaluation, thereby meeting a demand from the XAI research community ( Delaney et al., 2021 ; Theissler et al., 2022 ; Wang et al., 2023 ) , to measure how simplifications increases the understanding that the user has of the black box classification. Using the taxonomy of interpretability evaluation from ( Doshi-Velez and Kim, 2017 ) , what we do is a Human-Grounded Evaluation with Forward Simulation, to evaluate if simplifications are better than full time series, when using prototypes to teach the classification used by a TSC. Our findings suggest that using simplifications for interpretability of TSC is in some cases much better than using the original time series. However, we discover various cases where the trade-off between complexity and loyalty, or some other characteristics of the given dataset and TSC, are such that simplifications are not very useful. This happens for example when the original time series have several data points lying on an almost straight line, in which case the human eye seems to perform the simplification automatically, and the user interprets the TSC equally well from original time series as from loyal simplifications. In short, our findings suggest that simplifications can be useful when i) the TSC is not itself easily interpretable on the original domain, ii) the simplifications are loyal but not complex and dissimilar to the original, and moreover iii) the simplified domain is understandable under labels from TSC on the original domain. In the rest of this paper we first discuss related work and cover some standard definitions before presenting the metrics we will use, the four simplification algorithms we will evaluate, the TSCs we will employ and the 40 UCR datasets we use