This looks like what? Challenges and Future Research Directions for Part-Prototype Models
Khawla Elhadri, Tomasz Michalski, Adam Wróbel, Jörg Schlötterer, Bartosz Zieliński, Christin Seifert · 2025
Read This looks like what? Challenges and Future Research Directions for Part-Prototype Models by Khawla Elhadri, Tomasz Michalski, Adam Wróbel, Jörg Schlötterer, Bartosz Zieliński, Christin Seifert (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09340.txt.
Introduction
Khawla Elhadri and five co-authors survey part prototype models, a kind of image tool that explains itself. These models class a new image by matching its parts to learned sample parts. Their plain pitch is that a part looks like a known part.
Despite the clear style, the models still trail black box tools in use. The survey sorts pains from a few years of work. Sample quality and count lead the list, with weak spread to new tasks and loose test rules close behind. Five paths for fix work are laid out for builders.
Catalog record
| CREATOR | Khawla Elhadri, Tomasz Michalski, Adam Wróbel, Jörg Schlötterer, Bartosz Zieliński, Christin Seifert |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-09340
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
This looks like what? Challenges and Future Research Directions for Part-Prototype Models Khawla Elhadri, Tomasz Michalski, Adam Wróbel, Jörg Schlötterer, Bartosz Zieliński, Christin Seifert Abstract The growing interest in eXplainable Artificial Intelligence (XAI) has prompted research into models with built-in interpretability, the most prominent of which are part-prototype models. Part-Prototype Models (PPMs) make decisions by comparing an input image to a set of learned prototypes, providing human-understandable explanations in the form of “this looks like that”. Despite their inherent interpretability, PPMs are not yet considered a valuable alternative to post-hoc models. In this survey, we investigate the reasons for this and provide directions for future research. We analyze papers from 2019 to 2024, and derive a taxonomy of the challenges that current PPMs face. Our analysis shows that the open challenges are quite diverse. The main concern is the quality and quantity of prototypes. Other concerns are the lack of generalization to a variety of tasks and contexts, and general methodological issues, including non-standardized evaluation. We provide ideas for future research in five broad directions: improving predictive performance, developing novel architectures grounded in theory, establishing frameworks for human-AI collaboration, aligning models with humans, and establishing metrics and benchmarks for evaluation. We hope that this survey will stimulate research and promote intrinsically interpretable models for application domains. Our list of surveyed papers is available at https://github.com/aix-group/ppm-survey . 1 Introduction Machine learning systems are increasingly adopted in high-stake domains, from autonomous vehicles (e.g., Liao et al. 2024 ), to finance (e.g., Zhou et al. 2024 ), and healthcare (e.g., Eisemann et al. 2025 ). Operating in areas where trustworthiness is expected ( Li et al. 2023 ) , these systems are required to provide explanations for their decisions. This need for transparency has motivated the rise of eXplainable Artificial Intelligence (XAI). Initially, the focus of XAI has been on building post-hoc methods that explain the reasoning process of already built (black box) models. However, post-hoc methods only approximate the model’s predictions without ever reaching perfect faithfulness ( Rudin 2019 ) . Thus, a new category of models has emerged that are interpretable by design and transparent about their decision-making process. A prominent class of such ante-hoc models are part-prototype models ( PPMs ). To make their predictions, PPMs compare the input data to prototypical parts learned during training. Subsequently, the decision is made based on how similar the prototypical parts are to parts of the input. A schematic of the decision process is shown in Figure 1 , top row. Despite their intrinsic interpretability, PPMs are not yet widely adopted, and often secondary to black box models ( Rudin 2019 ) . To understand the reasons for this situation, we analyzed recent work (including methods and analysis papers) on PPMs and analyzed open problems and challenges mentioned by the authors. We systematically collected papers from 17 premier venues, published between 2019 and 2024. An in-depth analysis of these 45 papers resulted in a taxonomy of challenges with four main categories: i) issues with the quality and amount of prototypes 1 1 1 A prototype corresponds to the entire object, while prototypical parts and part-prototypes are synonyms and refer to a part of the whole input. For brevity, and following most papers on PPMs we use the term ‘prototypes‘ in the remainder of this paper. (category: Prototypes), ii) lack of theoretical foundation and evaluation standards, and limitations in training and inference performance (category: Methodology), iii) limited variety of machine learning tasks and reliance on strong assumptions (category: Generalization), and iv) limitations that prevent safe use in practice (category: Safety and Use in Practice). In the second part of this survey, we synthesize the identified challenges and suggest ways to address them. We identify five main research directions and provide more detailed ideas on how to make a significant contribution to the successful application of PPMs in practice. Figure 1: Overview of the reasoning process of part-prototype models (top) and selected challenges (bottom). Part-prototype models first find occurrences of learned prototypes (different types of birds’ beaks, breasts and heads) in an input image (prototype matching) by calculating the similarity of input patches and each prototype. The decision layer is a simple scoring sheet, integrating these similarities and learned weights to classes. There are multiple open challenges: It can be unclear why an image patch is matched to a certain prototype (a), the spatial alignment of the matching is not optimal (b), prototypes are learned, which have no meaning to humans (c) or should be irrelevant for the task (d). Additionally, the number of prototypes is too high (e) or redundant prototypes are learned (f). Further, there is a lack in clarity about what a prototype is in modalities other than images, e.g., for sensor data or text (g). Best viewed in color. Relation to other Surveys. To the best of our knowledge, there is no survey that focuses specifically on PPMs . Five surveys in the XAI domain include PPMs and touch on their challenges in terms of the interpretability-accuracy tradeoff ( Ibrahim and Shafiq 2023 ) , evaluation metrics ( Nauta et al. 2023b ; Nauta and Seifert 2023 ) , or from the point of view of specific application areas ( Alpherts et al. 2024 ; Patrício et al. 2023 ) . However, neither of these surveys systematically analyses open challenges for PPMs , nor includes PPMs designed for modalities other than vision in their analysis. To address this gap, we focus specifically on PPMs , provide an in-depth analysis of open challenges, and outline directions for further research and application in practice. Our survey is organized as follows: Figure 1 and Section 2 provide an introduction to part-prototype models ( PPMs ). Our survey method is explained in Section 3 . Figure 3 and Section 4 detail our taxonomy of open challenges. We describe promising research directions in Section 5 with an overview in Figure 4 and conclude in Section 6 . 2 Background on Part-Prototype Models We introduce part-prototype models ( PPMs ) using the seminal work on ProtoPNet Chen et al. 2019 as example. In ProtoPNet, the decision-making process follows the principle of “this looks like that,” where the input image is compared to learned prototypes and the final decision is based on the prototypes only (cf. Figure 1 , top row). ProtoPNet. ProtoPNet consists of a convolutional neural network (CNN) to encode the input, a prototype layer to match the input with the prototypes, and a fully connected layer to compute the final decision. The CNN is trained to map the input image onto a latent space of dimensionality W\times H\times D . The prototype layer acts as a bottleneck and consists of K prototype representations, each of dimensionality 1\times 1\times D . The representations of all K prototypes are compared to the representations at each of the W\times H locations of the CNN’s latent grid. These latent grid locations can be mapped back to pixel regions (patches) in the input image. Thus, the prototype layer outputs similarity scores that reflect the similarity of all input patches to all prototypes. The highest similarity score per prototype (corresponding to a particular input patch) is passed to the final layer,