Towards Verified and Targeted Explanations through Formal Methods DOI: 10.1613/jair.1.xxxxx Volume: 4 111 5
Hanchen David Wang, Diego Manzanas Lopez, Preston K. Robinette, Ipek Oguz, Taylor T. Johnson, Meiyi Ma · 2026
Read Towards Verified and Targeted Explanations through Formal Methods DOI: 10.1613/jair.1.xxxxx Volume: 4 111 5 by Hanchen David Wang, Diego Manzanas Lopez, Preston K. Robinette, Ipek Oguz, Taylor T. Johnson, Meiyi Ma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14209.txt.
Introduction
Wang and five colleagues introduce ViTaX, a formal framework that explains neural network decisions with mathematical guarantees. Standard attribution tools flag influential features but certify nothing about decision boundaries, while formal checks verify robustness without targeting the risks that matter. For an input class and a user-named critical alternative, ViTaX finds the smallest feature set most sensitive to flipping between them and proves that small perturbations cannot force the flip. Tests on MNIST, GTSRB, EMNIST, and TaxiNet show fidelity gains above 30 percent with minimal explanation size.
Catalog record
| CREATOR | Hanchen David Wang, Diego Manzanas Lopez, Preston K. Robinette, Ipek Oguz, Taylor T. Johnson, Meiyi Ma |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 117795 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.14209
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Verified and Targeted Explanations through Formal Methods DOI: 10.1613/jair.1.xxxxx Volume: 4 111 5 Hanchen David Wang, Diego Manzanas Lopez, Preston K. Robinette, Ipek Oguz, Taylor T. Johnson, Meiyi Ma Abstract . As deep neural networks are deployed in safety-critical domains such as autonomous driving and medical diagnosis, stakeholders need explanations of model behavior that are not only interpretable but also trustworthy with formal guarantees. Existing XAI methods fall short of this requirement: heuristic attribution techniques (e.g., LIME, Integrated Gradients) highlight influential features for individual predictions but offer no mathematical guarantees about decision boundaries, while formal explanation methods verify robustness properties yet remain untargeted, analyzing the nearest boundary regardless of whether it represents a critical risk. In safety-critical systems, however, not all misclassifications carry equal consequences; confusing a “Stop” sign for a “60 kph” sign is far more dangerous than confusing it with a “No Passing” sign. Practitioners therefore lack a principled way to answer a fundamental safety question: how resilient is a model’s classification against a specific, high-risk alternative? We introduce ViTaX (Verified and Targeted Explanations), a formal XAI framework that addresses this gap by generating targeted semifactual explanations with mathematical guarantees. For a given input (class y y ) and a user-specified critical alternative (class t t ), ViTaX performs two key steps: (1) it identifies the minimal feature subset most sensitive to the y → t y\to t transition using class-specific sensitivity heuristics, and (2) it applies formal reachability analysis to guarantee that perturbing these features by ϵ \epsilon is insufficient to flip the classification to t t . This guarantee constitutes a verified semifactual: “even if these critical features change by ϵ \epsilon , classification y y persists against t t .” We formalize this reasoning through Targeted ϵ \epsilon -Robustness , a formal property that certifies whether an identified feature subset remains robust under perturbation toward a specific target class. By unifying semifactual explanations, class-specific targeting, and formal verification, ViTaX is the first method to provide formally guaranteed explanations of a model’s resilience against specific, user-identified alternatives. Our evaluations on image classification (MNIST, GTSRB, EMNIST) and regression (TaxiNet) demonstrate that ViTaX achieves significantly higher fidelity (e.g., over 30% improvement) and minimal explanation cardinality compared to existing methods. These results establish ViTaX as a scalable and trustworthy foundation for verifiable, targeted XAI 1 1 1 Our code is publicly available at https://github.com/AICPS-Lab/formal-xai . . \JAIRAE Eleonora Giunchiglia \JAIRTrack Integration of Logical Constraints in Deep Learning 1. Introduction The deployment of Deep Neural Networks in safety-critical domains, such as autonomous driving and medical diagnosis, demands more than high accuracy; it requires trustworthiness. When failures occur, the consequences can be severe, necessitating rigorous methods to understand and verify model behavior. Formal methods in eXplainable AI (Formal XAI) have emerged to address this need, moving beyond heuristic estimations (e.g., LIME ( Ribeiro et al. 2016a ) , Integrated Gradients ( Sundararajan et al. 2017 ) ) to provide mathematical guarantees about model decisions ( Marques-Silva and Ignatiev 2022 ; Jiang et al. 2023 ) . More broadly, formal specifications such as temporal logic have been integrated into neural networks to enforce properties in sequential prediction ( Ma et al. 2020 ) , federated settings ( An et al. 2024 ) , and predictive monitoring of cyber-physical systems ( Ma et al. 2021 ) . However, existing Formal XAI approaches face a critical limitation: they often ignore the asymmetric nature of real-world risk. In safety-critical systems, not all misclassifications are equal. For instance, confusing one speed limit sign for another might be minor, but confusing a ‘Stop’ sign for a ‘60 kph’ sign is catastrophic. Furthermore, formal verification is computationally expensive. It is therefore crucial to allocate these limited resources effectively, prioritizing the decision boundaries that matter most. Many current formal explanation methods are inherently constrained by the nearest decision boundary in the model’s feature space, regardless of whether that boundary represents a critical risk. This limitation is illustrated in Figure 1 (A). A traffic sign recognition model correctly identifies a ‘Stop’ sign (Class 14). The nearest boundary is ‘No Passing’ (Class 10), a low risk. The critical boundary is ‘60 kph’ (Class 5), a high risk. When applying existing formal methods, the analysis often defaults to the nearest boundary. Methods providing instance-level explanations, such as robust semifactuals and counterfactuals for Human-Neural Multi-Agent Systems (HNMAS) (Figure 1 (B)) ( Leofante and Lomuscio 2023 ) , generate modified inputs but lack fine-grained feature insights and drift towards the nearest boundary (Class 10). Untargeted formal explanation methods, such as VeriX (Figure 1 (C)) ( Wu et al. 2023 ) , aim to verify robustness against any alternative class. Constrained by Class 10, VeriX produces a broad explanation, offering no insight into the resilience against the catastrophic Class 5. These methods fail to answer the crucial question for safety-critical deployment: “How resilient is the model’s decision against a specific, high-risk alternative?” To address this issue, we must distinguish between explanations of fragility and explanations of resilience . Counterfactual Explanations (CFEs) explain fragility by answering “if-only” questions: “If only these features changed, the decision would flip” ( Guidotti 2024 ) . We focus instead on semifactual explanations, which explain resilience by answering “even-if” questions: “Even if these features change, the decision persists” ( Aryal and Keane 2023 ; Kenny and Huang 2023 ) . We introduce ViTaX (Verified Targeted Explanations), a novel framework that provides formally verified, targeted semifactual explanations. ViTaX addresses the limitations of existing methods by prioritizing verification resources on user-specified, critical decision boundaries. For a given input (class y ) and a user-specified critical alternative (class t ), ViTaX performs two key steps: (1) It identifies the minimal feature subset A that is most sensitive to the specific y\to t transition. (2) It uses formal reachability analysis to guarantee that perturbing these sensitive features by a magnitude \epsilon is insufficient to flip the classification to t . As shown in Figure 1 (D), ViTaX ignores the nearest boundary (Class 10) and focuses analysis on the critical boundary (Class 5). The resulting explanation is precise, highlighting only the features relevant to the Stop \to 60 kph transition. The perturbed logits confirm that the analysis is focused on Class 5. This provides a formal guarantee of resilience (“even-if”) at the specific boundary that matters most. Figure 1 . The Necessity of Targeted Verification: Prioritizing Critical Boundaries over Nearest Boundaries. All methods use the same base model (GTSRB CNN). Formal verification is expensive and must be deployed strategically. (A) Scenario: A model correctly classifies ’Stop’ (Class 14). The decision space has asymmetric risks: Class 10 (‘No Pass’) is the nearest boundary (low risk), while Class 5 (‘60 kph’) is the critical boundary (high risk). Risk levels are defined by the application domain (e.g., traffic safety regulations) and provided by the user; ViTaX then directs verification resources toward the user-specified critical boundary. (B) HNMAS (Formal Instance-level) ( Leofante and Lomuscio 2023 ) : Provides instance-level semifactual explanations via robustness for multi-agent systems. The analysis is constrained by local geometry, and the evaluation drifts (arrow) towards the nearest boundary (Class 10). (C) VeriX (Untargeted Formal) ( Wu et al. 2023 ) : Provides feature-level explanations of