I-SAFE : Wasserstein Coherence Metrics for Structural Auditing of Scientific AI Models
Barbara Tarantino, Gennaro Auricchio, Paolo Giudici · 2026
Read I-SAFE : Wasserstein Coherence Metrics for Structural Auditing of Scientific AI Models by Barbara Tarantino, Gennaro Auricchio, Paolo Giudici (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21731.txt.
Introduction
Tarantino, Auricchio, and Giudici introduce I-SAFE, a post-hoc audit for scientific AI models. Strong benchmark scores can mislead, since a model may lean on shortcuts or quirks of its data rather than real domain structure. Given a trained predictor and an external structural prior, I-SAFE perturbs inputs along domain-relevant directions and measures how coherently the output distribution responds. It uses quantile, Wasserstein, and shape-based metrics. Applied to three drug-target interaction models, it exposes sharply different response profiles that accuracy alone cannot see.
Catalog record
| CREATOR | Barbara Tarantino, Gennaro Auricchio, Paolo Giudici |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49172 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.21731
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
I-SAFE : Wasserstein Coherence Metrics for Structural Auditing of Scientific AI Models Barbara Tarantino, Gennaro Auricchio, Paolo Giudici Abstract Deep learning models are increasingly used in scientific prediction tasks where strong benchmark performance is often interpreted as evidence of scientifically meaningful behavior. This interpretation is fragile, as models may exploit shortcut features, dataset-specific regularities, or distributional biases that are predictive on held-out data but not aligned with domain-relevant structure. To address this limitation, we introduce the I-SAFE (Interventional Secure, Accurate, Fair and Explainable) framework, a post-hoc distributional auditing framework for scientific AI models centered on the Wasserstein Coherence Metric (WCM). Given a trained black-box predictor and an external structural prior encoding domain knowledge about task-relevant input structure, I-SAFE evaluates raw model outputs under structurally guided perturbations of the input. The proposed audit measures output-distribution coherence through three complementary metrics: a Quantile-Based Metric (QBM) for location-level coherence, the WCM for ordinal coherence, and a translation-invariant WCM variant for shape coherence. We instantiate I-SAFE on drug–target interaction (DTI) prediction using the Davis kinase benchmark, KLIFS (Kinase–Ligand Interaction Fingerprints and Structures) binding-pocket annotations, and three sequence-based DTI models: DeepConvDTI, DeepDTA, and TAPB. Although the models operate in a comparable predictive regime, I-SAFE reveals substantially different distributional response profiles, a distinction invisible to accuracy-based evaluation. The framework is model-agnostic and applicable to any domain where inputs admit a structured decomposition and an external prior is available. 1 Introduction Held-out predictive performance remains the dominant criterion for evaluating deep learning models in scientific machine learning, including molecular property prediction, drug–target interaction (DTI), and gene perturbation response [ 37 , 14 , 21 ] . In these settings, strong benchmark performance is often interpreted as evidence of scientifically meaningful behavior. This interpretation is fragile, as predictive accuracy measures are affected by statistical regularities that are present in the benchmark distribution, and not only on whether the model rightly identified the relevant structures of the input [ 25 ] . This gap is central to modern machine learning, where high-capacity models can achieve strong performance by exploiting shortcuts that do not necessarily align with the scientific structure of interest [ 12 , 15 ] . In scientific applications, this limitation is empirical as well as conceptual. For example, high-performing protein–ligand affinity models have been shown to rely substantially on ligand memorisation rather than interaction-specific information [ 23 ] . Specifically, in DTI, apparent progress on standard benchmarks can be influenced by target bias, scaffold effects, leakage, and other forms of distributional bias [ 20 , 35 , 13 ] , which leads the model to fail on structurally similar compounds with markedly different functional behaviour [ 33 ] . These findings expose a mismatch between the predictive success of a model and its ability to capture the structural properties of the problem. Standard benchmark evaluation can establish that a model predicts well on a given distribution, but cannot characterize how model outputs reorganize when scientifically relevant input structure is perturbed. A principled response to this problem is to move from observational to interventional evaluation, where the question is not only whether a model predicts correctly, but how its predictions change under controlled perturbations of the input. In causal terms, mechanistic claims concern responses to interventions rather than associations observed under a fixed distribution [ 25 , 26 ] . This perspective has informed several post-hoc lines of work, including causal abstraction of internal representations [ 10 , 11 ] , model-randomisation tests for explanation faithfulness [ 1 ] , and perturbation probes of reasoning behaviour in language models [ 38 , 40 ] . In scientific prediction, domain knowledge provides a structural prior over inputs, enabling comparison of model responses to perturbations on prior-selected versus non-prior selected components. This yields a post-hoc, prior-relative audit of whether the model response is organized with respect to meaningful input structure, as formalized in [ 32 ] . Our Contribution. In this paper, we introduce I-SAFE (Interventional Secure, Accurate, Fair and Explainable), a post-hoc distributional auditing framework for trained black-box scientific predictors. While existing intervention-based audits rely on scalar summaries, the I-SAFE framework evaluates the full output distribution induced by the model, capturing how output ranks reorder under prior-guided perturbations of selected input components. Our main theoretical contribution thus consists in defining a set of metrics that capture different levels of ranking coherence: the Quantile-Based Metric for location-level coherence, the Wasserstein Coherence Metric for ordinal coherence, and a translation-invariant Wasserstein Metric for distributional shape coherence. For each metric, the prior-relative contrast compares the ranking-coherence under outside-prior controls and prior-selected perturbations. Positive contrasts indicate that perturbations of prior-selected components induce more coherent output responses than their controls outside the prior. We then instantiate I-SAFE on the Davis kinase benchmark [ 8 ] , auditing three sequence-based DTI models, DeepDTA [ 24 ] , DeepConvDTI [ 18 ] , and TAPB [ 20 ] , using Kinase–Ligand Interaction Fingerprints and Structures (KLIFS) binding-pocket annotations as an external structural prior [ 17 , 16 ] . While the audited models operate in a comparable predictive regime, we show that their interventional behaviour differs substantially. In particular, TAPB is the only model for which KLIFS-aligned pocket perturbations induce significantly more coherent quantile-level and ordinal responses than non-pocket controls. Our results show that predictive performance and distributional coherence capture distinct aspects of scientific model behaviour, indicating that I-SAFE provides a statistically grounded, prior-relative test of how trained scientific predictors operate under structurally meaningful perturbations. We stress that the audit does not establish causal validity of the model, nor does it require access to the model itself, it rather provides reusable, model-agnostic metrics for evaluating black-box model responses under structurally guided perturbations, applicable to any setting where inputs admit a structured decomposition and a domain prior is available. 2 Related Work From explanation to interventional model analysis. Attribution and explanation methods provide tools for inspecting trained models. Saliency maps, local surrogate models, Shapley-based explanations, and integrated gradients [ 28 , 22 , 31 , 29 ] identify input features that influence predictions, supporting transparency and debugging [ 9 ] . However, such explanations are mostly associational: they indicate the influential features under the observed input distribution, without establishing whether predictions depend on scientifically relevant structure. Their fragility has been documented empirically: Adebayo et al. [ 1 ] show that saliency methods can be invariant to model parameter randomisation, calling into question their mechanistic faithfulness. Intervention-based approaches address this limitation by asking how the model changes under controlled modifications. Causal abstraction and related methods [ 10 , 11 ] compare neural representations with interpretable causal variables through interchange interventions on internal activations. These methods provide a formal route to mechanistic comparison, but usually require access to internal representations and a target causal structure. Input-level perturbation methods avoid this requirement by probing the input–output matching induced by the model and have been applied to language models [ 38 , 40 ] . In scientific prediction, post-hoc structural auditing under an external prior has been proposed to contrast mechanistic and spurious perturbations through scalar summaries [ 32 ] . I-SAFE retains the post-hoc black-box setting, but shifts the object of comparison from scalar aggregated values to the distributional changes in