M-CELS: Counterfactual Explanation for Multivariate Time Series Data Guided by Learned Saliency Maps
Peiyu Li, Omar Bahri, Soukaïna Filali Boubrahimi, Shah Muhammad Hamdi · 2024
Read M-CELS: Counterfactual Explanation for Multivariate Time Series Data Guided by Learned Saliency Maps by Peiyu Li, Omar Bahri, Soukaïna Filali Boubrahimi, Shah Muhammad Hamdi (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02649.txt.
Description
Abstract Over the past decade, multivariate time series classification has received great attention. Machine learning (ML) models for multivariate time series classification have made significant strides and achieved impressive success in a wide range of applications and tasks. The challenge of many state-of-the-art ML models is a lack of transparency and interpretability.
Catalog record
| CREATOR | Peiyu Li, Omar Bahri, Soukaïna Filali Boubrahimi, Shah Muhammad Hamdi |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-02649
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
M-CELS: Counterfactual Explanation for Multivariate Time Series Data Guided by Learned Saliency Maps Peiyu Li, Omar Bahri, Soukaïna Filali Boubrahimi, Shah Muhammad Hamdi Abstract Over the past decade, multivariate time series classification has received great attention. Machine learning (ML) models for multivariate time series classification have made significant strides and achieved impressive success in a wide range of applications and tasks. The challenge of many state-of-the-art ML models is a lack of transparency and interpretability. In this work, we introduce M-CELS, a counterfactual explanation model designed to enhance interpretability in multidimensional time series classification tasks. Our experimental validation involves comparing M-CELS with leading state-of-the-art baselines, utilizing seven real-world time-series datasets from the UEA repository. The results demonstrate the superior performance of M-CELS in terms of validity, proximity, and sparsity, reinforcing its effectiveness in providing transparent insights into the decisions of machine learning models applied to multivariate time series data. Emails: {peiyu.li, omar.bahri, soukaina.boubrahimi, s.hamdi}@usu.edu I Introduction In recent years, there has been widespread adoption of time series classification methods across various domains [ 1 ] , [ 2 ] . The success of data-driven time series classification methods is largely attributed to the availability of large-scale data, which has facilitated the development of highly accurate models for real-world applications. However, most of the time series model development efforts, especially deep learning models [ 3 ] , consider accuracy as their foremost priority without necessarily providing a tracing mechanism of the model’s decision-making process which limits their interpretability. This lack of interpretability poses a challenge, as scientific communities often require explanations to support their trust in the models. Therefore, the establishment of trust between humans and decision-making systems has become critically important. This can be achieved by incorporating interpretable explanations during the model development phase or by developing post-hoc explanation solutions. By doing so, we can enhance transparency and foster trust in decision-making processes, particularly in critical domains where human judgment and accountability are paramount. To address concerns regarding the lack of transparency in machine learning models, experts from different domains are proposing EXplainable Artificial Intelligence (XAI) methods to provide trustworthy explanations of the decision-making processes of machine learning models [ 4 ] . XAI methods aim to provide reliable explanations for the decision-making processes of these models while maintaining high levels of performance. There are two dominant paradigms of XAI: intrinsic interpretable and post-hoc explanation methods for opaque models [ 5 ] . Examples of intrinsic interpretable models include logistic regression and decision tree-based induction, which can provide an intrinsic explanation by their simple structure models. On the other hand, post-hoc explanation methods can be further categorized into feature attribution methods and counterfactual explanation methods. Feature attribution methods aim to explain the rationale behind a model’s decision, while counterfactual explanation methods identify the smallest input modifications that would result in a different decision. In this paper, we focus only on post-hoc XAI methods, which have gained significant attention in the field. These methods play a crucial role in enhancing the interpretability of opaque models, enabling stakeholders to gain a better understanding of the factors driving the models’ predictions. In recent years, significant research advancements have been accomplished on explainability in the computer vision and natural language processing (NLP) domains, but there are still many challenges to be addressed to provide interpretability for the time series domain [ 6 ] . A lot of efforts have been made to provide post-hoc XAI for image [ 7 ] , vector-represented data [ 8 ] and univariate time series data [ 9 ] , [ 10 ] , while significantly less attention has been paid to multivariate time series data [ 11 ] . In this work, we aim to fill this gap by introducing M-CELS, a novel extension of counterfactual explanations via learned saliency maps on univariate time series to enhance transparency in multivariate time series classification models. To the best of our knowledge, this is the first effort to learn a saliency map specifically for the purpose of producing high-quality counterfactual explanations for multivariate time series data. II Related work In the post-hoc interpretability paradigm, the wCF method by Wachter et al. [ 12 ] stands as a prominent approach that first introduced the counterfactual explanation. wCF generates counterfactuals by minimizing a loss function to alter decision outcomes while preserving the minimum Manhattan distance from the original input instance. Extensions like TimeX [ 13 ] and SG-CF [ 14 ] have augmented counterfactual quality by integrating extra terms into the loss function. TimeX introduces a Dynamic Barycenter Average Loss term for a more contiguous counterfactual, while SG-CF leverages previously mined shapelets for better interpretability. Nonetheless, these methods are primarily designed for univariate time series data, posing challenges for direct application to multivariate time series. NG-CF employs Dynamic Barycenter (DBA) averaging of the query time series and its nearest unlike neighbor for counterfactual generation. Recent methods like those employing mined shapelets, temporal rules or Matrix Profile [ 10 , 15 , 16 , 17 ] aim to enhance interpretability. However, they often encounter limitations of extensive processing time for shapelet or rule extraction. CoMTE [ 11 ] , proposed by Ates et al., targets generating counterfactuals for multivariate time series by evaluating the impact of turning off one variable at a time. However, CoMTE tends to generate low sparsity as it modifies the entire time series data [ 16 ] . Another approach, AB-CF proposed by [ 18 ] , underscores minimum discriminative contiguous segment replacement for sparser and higher-validity counterfactuals. Nonetheless, it presupposes the presence of discriminative segments across all dimensions within the same time-step interval. In addressing these challenges, our work introduces optimization techniques tailored to multivariate time series, guiding perturbations through saliency maps. Our contributions are summarized below: 1. Optimization Techniques for Multivariate Time Series : We introduce novel optimization methods specifically tailored to the complexities of multivariate time series data. These techniques guide the generation of counterfactuals, ensuring they are both meaningful and interpretable across multiple dimensions. 2. Use of Saliency Maps for Enhanced Sparsity : By leveraging saliency maps, our approach identifies and targets the most influential features within the time series data. This focused perturbation promotes higher sparsity. As a result, fewer changes are made to the original time series, making the counterfactuals more actionable for users. 3. Improved Interpretability in Time Series Classification : The combination of targeted perturbations and enhanced sparsity directly contributes to better interpretability in time series classification tasks. Users can more easily discern the rationale behind model decisions and the influence of different variables over time. III Background Works: CELS Recently, the CELS model [ 19 ] introduced the concept of generating counterfactual explanations for univariate time series classification using learned saliency maps. Building on this approach, we present M-CELS, an extension of CELS, to generate high-sparsity and high-validity counterfactual explanations for multivariate time series data. Our methodology adapts the principles of CELS to handle the added complexity of multivariate datasets, ensuring meaningful and interpretable counterfactuals across multiple dimensions. In this section, we briefly describe the CELS background and the main components we utilized in M-CELS. III-A Problem definition for CELS CELS [ 19 ] is a novel counterfactual explanation method