Towards Robust and Accurate Stability Estimation of Local Surrogate Models in Text-based Explainable AI
Christopher Burger, Charles Walter, Thai Le, Lingwei Chen · 2025
Read Towards Robust and Accurate Stability Estimation of Local Surrogate Models in Text-based Explainable AI by Christopher Burger, Charles Walter, Thai Le, Lingwei Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02042.txt.
Introduction
Christopher Burger, Charles Walter, Thai Le, and Lingwei Chen study how to judge whether an AI explanation is stable, in a research paper from 2025. Explanation tools show why a text model made a call. Attackers can tweak the input slightly so the explanation changes while the model's call stays much the same.
How an attack looks depends on how two explanations are compared. The team tests many ways to compare ranked word lists. Several common measures prove too touchy and give a false picture of weakness. Their fix weighs words by how close their meanings are. That gives a truer estimate of how fragile an explanation method really is.
Catalog record
| CREATOR | Christopher Burger, Charles Walter, Thai Le, Lingwei Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-02042
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Robust and Accurate Stability Estimation of Local Surrogate Models in Text-based Explainable AI Christopher Burger, Charles Walter, Thai Le, Lingwei Chen Abstract Recent work has investigated the concept of adversarial attacks on explainable AI (XAI) in the NLP domain with a focus on examining the vulnerability of local surrogate methods such as Lime to adversarial perturbations or small changes on the input of a machine learning (ML) model. In such attacks, the generated explanation is manipulated while the meaning and structure of the original input remain similar under the ML model. Such attacks are especially alarming when XAI is used as a basis for decision making (e.g., prescribing drugs based on AI medical predictors) or for legal action (e.g., legal dispute involving AI software). Although weaknesses across many XAI methods have been shown to exist, the reasons behind why remain little explored. Central to this XAI manipulation is the similarity measure used to calculate how one explanation differs from another. A poor choice of similarity measure can lead to erroneous conclusions about the stability or adversarial robustness of an XAI method. Therefore, this work investigates a variety of similarity measures designed for text-based ranked lists referenced in related work to determine their comparative suitability for use. We find that many measures are overly sensitive, resulting in erroneous estimates of stability. We then propose a weighting scheme for text-based data that incorporates the synonymity between the features within an explanation, providing more accurate estimates of the actual weakness of XAI methods to adversarial examples. Source codes will be made publicly available. 1 Introduction Continuous advancements in AI/ML have enabled the proliferation of powerful, yet complex, models in many aspects of our daily lives ( Dong et al., 2021 ) . Although these models are deployed across a wide range of fields, disciplines like medicine or finance, where the consequences of failure are especially high, must be particularly cautious about model errors. When such a failure occurs, understanding its nature and type becomes critical. For example, a model built for bird classification that misidentifies a pine warbler as a yellow-throated vireo may cause little more than embarrassment. However, a collision detection system that interprets a pedestrian in a crosswalk as background noise could lead to catastrophic failure. In any case, it is essential for its stakeholders to be informed of why such failure happens. With ever-increasing model complexity, their inner workings often become impenetrable black boxes. To address this challenge, the discipline of explanatory AI (XAI) ( Tjoa and Guan, 2020 ; Dwivedi et al., 2023 ) has emerged to develop tools that allow both developers and users of models to understand why a model works the way it does. A common method in XAI is to generate a simplified, inherently interpretable model, often a constrained regression or decision tree, as an approximation of the complex model ( Guidotti et al., 2018 ) . These approximations, known as surrogate models, are then used to gain insight into why the original model has made certain predictions. Among surrogate models, global surrogates attempt to explain the model as a whole, but if they were sufficiently accurate, they could be used directly over the complex model. In contrast, local surrogates ( Garreau and Luxburg, 2020 ) are widely preferred due to their increased fidelity, as they focus on explaining an individual prediction (or at most a small subset). Nevertheless, surrogate models are algorithms themselves, and may be subject to the same issues as the models they are designed to explain ( Ghorbani et al., 2019 ) . XAI Stability. One such issue is stability or robustness, where an insignificant change in input should result in a correspondingly insignificant change in output ( Alvarez-Melis and Jaakkola, 2018 ) . This property is leveraged in adversarial attacks, where a model that is unstable can return obviously erroneous results, given small changes to the input. Local surrogate models have been shown to lack stability in many types of data, including image, tabular, and text ( Slack et al., 2020 ; Ivankay et al., 2022 ; Burger et al., 2023 ) . That is, the explanation of the complex model can be appreciably different given an insignificant change in the input. If an XAI model cannot produce consistent explanations across very similar documents when the output of the complex model itself remains similar, then the explanations from the XAI method become suspect. Suspect explanations cannot be trusted , so the original complex model remains opaque and can be prevented from use due to legal or social ramifications despite superior efficacy over other models. This will seriously slow the advance of AI and its adoption in practice. Similarity Measures in XAI. Previous work on XAI stability, such as ( Ghorbani et al., 2019 ; Slack et al., 2020 ; Ivankay et al., 2022 ) has focused on the existence of instability given some fixed maximum amount of change applied to the input. This contrasts to standard adversarial attacks on classification models. These attacks often also have some perturbation limit, but the process has a clearly defined end point, which is a change in the predicted class. Previous work in XAI stability generally uses a similar approach to that of standard adversarial attacks, but lacks this clearly defined metric of success, and instead terminates at search exhaustion or perturbation limit ( Burger et al., 2023 ) . As the existence of instability has already been demonstrated, we seek to refine this knowledge by asking “what is the importance of the similarity measure used to guide the adversarial search process?” . The similarity measure is the engine for selection of appropriate perturbations in the search process and directly controls the acceptance of perturbations and the overall determination of success or failure of the algorithm. In particular we ask: Are certain similarity measures superior to others in providing quality adversarial explanations or accurate results in terms of XAI robustness? If so, under what conditions? Specifically, how do different measures compare in terms of sensitivity , or the propensity to show a difference in similarity with respect to another measure. Table 1 provides an illustration. It shows a perturbed explanation with 75% similarity to the original calculated using measure RBO 0.5 (to be defined in Section 3.2 ) is compared with eight other measures, resulting in up to 65% lower similarity between documents solely from choosing a new measure. Original Explanation Perturbed Explanation Feature Weight Feature Weight 1 heartburn 1.77 1 heartburn 2.16 2 eat 0.59 2 choking 0.35 3 vomit 0.35 3 puked 0.34 4 choking 0.26 4 eat 0.33 5 feel 0.17 5 like 0.11 6 lot 0.15 6 pain 0.09 … … Comparative Similarities RBO 0.7 RBO 0.9 Jaccard Jaccard w 0.69 0.74 0.72 0.90 Kendall Kendall w Spearman Spearman w 0.10 0.48 0.50 0.50 Table 1: Explanation changes under similarity measure RBO 0.5 with final similarity of 0.75 (out of maximum 1.0) only from a few text perturbations: “I have a lot of heartburn and I feel like I’m choking when I eat. I also have a lot of stomach pain and I vomit a lot.” \rightarrow “I have a lots of heartburn and I feel like I’m choking