LIME-LLM: Probing Models with Fluent Counterfactuals, Not Broken Text

George Mihaila, Suleyman Olcay Polat, Poli Nemkova, Himanshu Sharma, Namratha V. Urs, Mark V. Albert · 2026

Read LIME-LLM: Probing Models with Fluent Counterfactuals, Not Broken Text by George Mihaila, Suleyman Olcay Polat, Poli Nemkova, Himanshu Sharma, Namratha V. Urs, Mark V. Albert (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11746.txt.

Introduction

George Mihaila, Suleyman Olcay Polat, Poli Nemkova, Himanshu Sharma, Namratha V. Urs, and Mark V. Albert seek better ways to explain model choices in text tasks. A well known tool, LIME, tests a model by hiding words at random. Those tests can make broken text that no one would write.

Broken text can mislead the small stand-in model that LIME fits. New tools that write fresh text try to fix this flaw. The team's method, named in the title, tests models with smooth, fluent counter cases in place of broken text. Fluent tests should give a more true view of why a model chose its output.

Catalog record

CREATORGeorge Mihaila, Suleyman Olcay Polat, Poli Nemkova, Himanshu Sharma, Namratha V. Urs, Mark V. Albert
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-11746

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LIME-LLM: Probing Models with Fluent Counterfactuals, Not Broken Text George Mihaila, Suleyman Olcay Polat, Poli Nemkova, Himanshu Sharma, Namratha V. Urs, Mark V. Albert Abstract Local explanation methods such as LIME Ribeiro et al. 2016 remain fundamental to trustworthy AI, yet their application to NLP is limited by a reliance on random token masking. These heuristic perturbations frequently generate semantically invalid, out-of-distribution inputs that weaken the fidelity of local surrogate models. While recent generative approaches such as LLiMe Angiulli et al. 2025b attempt to mitigate this by employing Large Language Models for neighborhood generation, they rely on unconstrained paraphrasing that introduces confounding variables, making it difficult to isolate specific feature contributions. We introduce LIME-LLM, a framework that replaces random noise with hypothesis-driven, controlled perturbations. By enforcing a strict "Single Mask–Single Sample" protocol and employing distinct neutral infill and boundary infill strategies, LIME-LLM constructs fluent, on-manifold neighborhoods that rigorously isolate feature effects. We evaluate our method against established baselines (LIME, SHAP, Integrated Gradients) and the generative LLiMe baseline across three diverse benchmarks: CoLA, SST-2, and HateXplain using human-annotated rationales as ground truth. Empirical results demonstrate that LIME-LLM establishes a new benchmark for black-box NLP explainability, achieving significant improvements in local explanation fidelity compared to both traditional perturbation-based methods and recent generative alternatives. 1 Introduction “The problem is not that machines think like humans, but that humans think machines think like humans.” — Herbert A. Simon As large language models (LLMs) and transformer-based classifiers have become central to NLP, the need for transparent and trustworthy explanations has grown accordingly ( Doshi-Velez and Kim 2017 ; Narayanan et al. 2018 ) . Among model-agnostic methods, LIME Ribeiro et al. 2016 remains widely used due to its simplicity and generality. Figure 1: Overview of the proposed LIME-LLM framework. LIME-LLM constructs local neighborhoods using hypothesis-driven, on-manifold LLM infilling, generating one fluent sample per binary mask via label-preserving neutral or counterfactual boundary strategies. The resulting semantic neighborhood enables faithful local surrogate explanations. However, in textual settings, LIME constructs local neighborhoods via random token masking, often producing ungrammatical and semantically implausible perturbations that lie far from the data manifold, a limitation repeatedly documented in diagnostic studies ( Atanasova et al. 2020 ; Jacovi and Goldberg 2020 ) . Such “broken” inputs lead to unstable explanations and misleading feature attributions ( Yeh et al. 2019 ; Slack et al. 2020 ) . The issue is particularly acute for tasks where meaning depends on multi-token interactions, including toxicity detection Mathew et al. 2021 , socially nuanced language Nemkova et al. 2023 , and linguistic acceptability, where masking individual tokens often destroys the semantic structure required for reliable local surrogate modeling. Prior work has sought to improve perturbation-based explanations through phrase-level masking Zhou et al. 2025a and syntactic constraints Amara et al. 2024 . While these approaches improve robustness in specific settings, they typically require additional linguistic resources and remain confined to token-deletion–based perturbation spaces. In parallel, recent work has begun incorporating LLMs into local surrogate frameworks to generate fluent, on-manifold neighborhoods. Notably, LLiMe Angiulli et al. 2025a employs LLM-based paraphrasing to construct perturbations. However, unconstrained paraphrasing often alters multiple linguistic factors - syntax, lexical choice, and tone - simultaneously, introducing confounding variables that hinder precise feature attribution. Other directions include game-theoretic attribution Lundberg and Lee 2017a , rule-based anchoring Ribeiro et al. 2018a , and latent-space generation Lampridis et al. 2022b , each with distinct tradeoffs between fidelity, coherence, and computational cost. In this work, we introduce LIME-LLM, a framework that addresses the tension between semantic validity and feature isolation (Figure 1 ). LIME-LLM enforces a strict Single Mask–Single Sample protocol, decoupling hypothesis specification from text generation. For each fixed binary feature mask, the LLM is used strictly as a semantic infiller, generating exactly one controlled perturbation per hypothesis. We evaluate LIME-LLM against standard model-agnostic baselines, including LIME Ribeiro et al. 2016 and SHAP , as well as the recent generative baseline LLiMe Angiulli et al. 2025a . Across global and local evaluation criteria, we show that controlled, hypothesis-driven infilling yields more stable and plausible explanations than either random perturbation or unconstrained generation. Our results demonstrate that semantic neighborhood construction is a central bottleneck in perturbation-based NLP explainability and that LLM-guided perturbations offer a practical, model-agnostic solution. Empirically, LIME-LLM outperforms standard LIME by 34–135% in ROC-AUC across tasks and frequently exceeds even white-box Integrated Gradients, despite requiring no access to model internals. By improving explanation faithfulness and stability without sacrificing deployment flexibility, LIME-LLM advances the reliability of local explanations for modern NLP models. To facilitate reproducibility and community adoption, we release our implementation as an open-source Python package. 1 1 1 The repository URL will be provided upon acceptance. 2 Related Work Our work builds on extensive research in post-hoc explainability for NLP, broadly categorized into gradient-based, perturbation-based, and generative model-based methods, which differ in model access assumptions, explanation fidelity, and robustness. Gradient-based approaches assign token-level importance via model gradients. Methods such as SignedGI Du and Xu 2021 and Integrated Gradients Sundararajan et al. 2017 provide high-fidelity explanations for Transformer classifiers Zheng and Pamuksuz 2024 when model internals are accessible, but are inapplicable in black-box or proprietary settings Jacovi and Goldberg 2020 . Perturbation-based methods infer importance by modifying inputs and observing prediction changes. LIME Ribeiro et al. 2016 remains the canonical example, with extensions such as PR-LIME Zhou et al. 2025b , XPROB Cai et al. 2024 , and MExGen Paes et al. 2024 improving phrase coherence, stability, or applicability to generative models. Nonetheless, many still generate semantically implausible neighborhoods, especially for longer or compositional texts. A parallel line of work addresses the instability of LIME-style explanations, which are sensitive to sampling, kernel width, and surrogate fitting Yeh et al. 2019 ; Slack et al. 2020 . Proposed stabilizations include deterministic or clustered neighborhoods DLIME Zafar and Khan 2019 , hypothesis-testing-based methods S-LIME Zhou et al. 2021 , Bayesian surrogates BayLIME Zhao et al. 2021 , and revised sampling or weighting schemes GLIME Tan et al. 2023 , OptiLIME Visani et al. 2020 ), all aiming to reduce variance Angiulli et al. 2025a . However, these methods typically retain token-masking perturbations and thus inherit LIME’s semantic limitations. Syntax-aware methods explicitly incorporate linguistic structure. SyntaxShap Amara et al. 2024 constrains Shapley coalitions using dependency parses, yielding more coherent explanations for autoregressive models such as GPT-2 and Mistral-7B, but typically relies on external parsers and structured representations. Related work also includes SIDU-TXT Jahromi et al. 2024 , which adapts visual explanation techniques to text, and rule-based grouping approaches such as Anchors Ribeiro et al. 2018b . Generative model-based approaches aim to produce more realistic neighborhoods by sampling from learned latent spaces. Examples include xspells Lampridis et al. 2022a , which uses variational autoencoders to generate exemplars and counter-exemplars, and XPROA Cai et al. 2023 , which applies generative interpolation to approximate local decision boundaries. These methods improve coherence but often require additional training or architectural assumptions. Most recently, LLM-generated neighborhoods have emerged as a promising alternative. LLiMe Angiulli et al. 2025a replaces token masking with classifier-driven LLM generation to produce semantically coherent perturbations. While LLiMe mitigates the out-of-distribution problem, it relies on unconstrained paraphrasing that alters multiple linguistic factors simultaneously,

Read the complete text