Explainable Evidential Clustering

Victor F. Lopes de Souza, Karima Bakhti, Sofiane Ramdani, Denis Mottet, Abdelhak Imoussaten · 2025

Read Explainable Evidential Clustering by Victor F. Lopes de Souza, Karima Bakhti, Sofiane Ramdani, Denis Mottet, Abdelhak Imoussaten (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12192.txt.

Introduction

Victor F Lopes de Souza and co-authors present a 2025 arXiv paper on explaining evidential clustering. This clustering style, built on Dempster-Shafer theory, handles uncertain and imprecise data that standard methods treat poorly. Explanations matter most in high-stakes fields like healthcare, yet how to explain such clusters was barely studied.

The authors show that a trait called representativity decides when decision trees can serve as sound explainers. They extend the idea to partial labeling with utility functions that price tolerable mistakes. Their algorithm then builds cautious, readable tree explanations. On test data, the explanations satisfied the decision maker's stated preferences up to 93 percent of the time.

Catalog record

CREATORVictor F. Lopes de Souza, Karima Bakhti, Sofiane Ramdani, Denis Mottet, Abdelhak Imoussaten
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-12192

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Explainable Evidential Clustering Victor F. Lopes de Souza, Karima Bakhti, Sofiane Ramdani, Denis Mottet, Abdelhak Imoussaten Abstract Unsupervised classification is a fundamental machine learning problem. Real-world data often contain imperfections, characterized by uncertainty and imprecision, which are not well handled by traditional methods. Evidential clustering, based on Dempster-Shafer theory, addresses these challenges. This paper explores the underexplored problem of explaining evidential clustering results, which is crucial for high-stakes domains such as healthcare. Our analysis shows that, in the general case, representativity is a necessary and sufficient condition for decision trees to serve as abductive explainers. Building on the concept of representativity, we generalize this idea to accommodate partial labeling through utility functions. These functions enable the representation of "tolerable" mistakes, leading to the definition of evidential mistakeness as explanation cost and the construction of explainers tailored to evidential classifiers. Finally, we propose the Iterative Evidential Mistake Minimization (IEMM) algorithm, which provides interpretable and cautious decision tree explanations for evidential clustering functions. We validate the proposed algorithm on synthetic and real-world data. Taking into account the decision-maker’s preferences, we were able to provide an explanation that was satisfactory up to 93% of the time. 1 Introduction Clustering is a fundamental machine learning problem [ 27 ] that aims to group similar objects while distinguishing different ones [ 15 ] . As a core data analysis task, it reveals patterns and enables applications such as data compression, summarization, visualization, and anomaly detection [ 46 ] . Regarding clustering, two major challenges persist: imperfection of input data [ 11 ] and interpretability [ 10 ] . Real-world scenarios with imperfect data require cautiousness [ 9 , 3 , 21 , 19 , 31 ] , defined as decision-makers’ awareness of model limitations and resulting risk-aversion. Effective cautiousness depends on properly characterizing these imperfections, primarily uncertainty and imprecision [ 11 ] . Approaches addressing these issues include imprecise probability theory [ 45 ] , possibility theory [ 12 ] , rough sets [ 34 ] , fuzzy sets [ 47 ] , and Dempster-Shafer belief functions [ 40 ] . These foundations have given rise to various clustering methods, including fuzzy [ 39 ] , possibilistic [ 24 ] , rough [ 25 ] , and evidential clustering [ 28 ] . Regarding the latter, while classical hard clustering [ 16 ] assigns each point to exactly one cluster, evidential clustering induces a credal partition [ 28 ] that represents both uncertainty and imprecision through partial membership across multiple cluster combinations. Interpreting clustering results is equally critical. Without proper interpretation, clustering outcomes often lack practical utility, which has led to significant research in developing explainable clustering methods [ 29 , 6 , 8 , 14 , 44 , 13 ] . Explainability represents a rapidly growing field in machine learning, referring to a model’s ability to provide details and justifications for its behavior in a manner that is clear and understandable to specific audiences [ 7 ] . Explainable systems are particularly valuable as they enable users to comprehend, critique, and improve models. While substantial research has focused on explaining black-box models [ 36 , 26 ] , with some researchers criticizing this emphasis [ 38 ] , increased attention is now directed toward systems that are explainable by design [ 29 ] . There are multiple approaches to address explainability. A common objective is to find methods that can provide explanations for the behavior of existing models without requiring additional information about the model’s structure. These are called model-agnostic techniques for post-hoc explainability [ 10 ] . They fall into two main categories [ 7 ] : feature relevance techniques that describe black-box model behavior by ranking or quantifying the influence of each feature on predictions [ 26 , 5 ] , which have been applied to clustering [ 1 , 14 , 13 ] . As they provide no direct insights into the underlying dataset [ 29 ] , this have drawn criticism in high-stakes scenarios [ 38 ] ; and simplification techniques that find more interpretable models approximating black-box classifiers, facing trade-offs between interpretability and accuracy, with approaches like LIME [ 36 ] restricting simplification to neighborhoods but potentially leading to incoherent explanations across different regions [ 2 ] . High-stakes domains like healthcare particularly require both explainability and cautiousness. However, explaining cautious clustering remains relatively unexplored despite its importance. As noted in some works [ 48 ] , the development of explainability clustering methods over uncertain/imprecise data is worth exploring, especially for cautious and explainable approaches over imperfect data sources. The main objectives of this paper are: 1. To conduct a comprehensive investigation of decision trees as explainers for hard clustering functions, establishing conditions that define effective explanations. 2. To develop a theoretical framework that extends these conditions to encompass uncertainty and imprecision, particularly within the evidential clustering paradigm. 3. To introduce an innovative Explainable Evidential Clustering method through a novel algorithm grounded in these theoretical foundations. Our key contributions include: 1. Building upon utility functions, we introduce the concept of Representativeness , which quantifies decision-makers’ preferences regarding errors committed by an explainer. This advancement enables systematic evaluation of cautious explanations. 2. We propose the Evidential Mistakeness function and develop the Iterative Evidential Mistake Minimization (IEMM) algorithm. This novel approach, inspired by the IMM algorithm [ 29 ] , generates decision trees that effectively explain evidential clustering functions. 3. We implement and validate this algorithm on both synthetic and real-world datasets, demonstrating how to select utility parameters that represent different decision attitudes. The remainder of this paper is structured as follows. Section 2 presents the theoretical foundations, encompassing belief functions, evidential clustering, and explainability. Section 3 introduces utility functions, representativeness, evidential mistakeness, and the IEMM algorithm. We provide formal analysis of these concepts along with illustrative examples. We also make available the complete code for all experiments at (OMITTED TO AVOID IDENTIFICATION). 2 Background Let X represent a set of observations in a known feature space \mathbb{X} . We assume X=\{x_{1},...,x_{N}\}\subset\mathbb{X}=\mathcal{A}_{1}\times\ldots\times\mathcal{A}_{D} , where each element of \mathcal{D}=\{\mathcal{A}_{1},\ldots,\mathcal{A}_{D}\} is called an attribute . We assume all attributes are finite 1 1 1 This finite attribute assumption is crucial for decision tree operations. We may occasionally refer to \mathbb{X} as \mathbb{R}^{D} for simplicity, though this is an abuse of notation. When working with continuous attributes, we implicitly discretize the space (for example, with a dataset X\subset\mathbb{R}^{D} , we typically consider binary attributes \mathcal{A}_{d,\theta}=\{True,False\} for each dimension d\in\{1,...,D\} and threshold \theta\in\{x_{d}:x\in X\} , where x_{\mathcal{A}_{d,\theta}}=True if and only if x_{d}\geq\theta ). . In essence, X is a set of D measurements for each of N objects, while \mathbb{X} encompasses all possible measurements. A classification problem is the task of assigning each observation in X to an outcome from a finite set \Omega=\{\omega_{1},...,\omega_{C}\} , which we call the frame of discernment . A function that performs this assignment is called a classifier . When a set of training examples is available, we refer to the problem of constructing such function as supervised classification . In contrast, if no training examples are available and the goal is to group observations based on their similarity—without prior knowledge of the classes or labels—the task is called unsupervised

Read the complete text