Graft : Auditing Graph Neural Networks via Global Feature Attribution Rishi Raj Sahoo, Subhankar Mishra Abstract Graph Neural Networks (GNNs) achieve strong performance on node classification tasks but remain difficult to interpret, particularly with respect to which input features drive their predictions. Existing global GNN explainers operate at the structural level identifying recurring subgraph motifs, but none explain model behaviour globally at the level of input node attributes. We propose Graft , a post-hoc global explanation framework that identifies class-level feature importance profiles for GNNs. The method combines diversity-guided exemplar selection, Integrated Gradients-based attribution, and aggregation to construct a global view of feature influence for each class, which can be further expressed as concise natural language rules using a large language model with self-refinement. We evaluate Graft across multiple datasets, architectures, and experimental settings, demonstrating its effectiveness in capturing model-relevant features, supporting bias analysis, and enabling feature-efficient transfer learning. In addition, we introduce a structured human evaluation protocol to assess the interpretability of generated rules along dimensions such as accuracy and usefulness. Our results suggest that Graft provides a practical and interpretable approach for analysing feature-level behaviour in GNNs, bridging quantitative attribution with human-understandable explanations. 1 Introduction Graph Neural Networks achieve state-of-the-art accuracy on node classification across citation networks, co-authorship graphs, product graphs, and social networks ( 10 ; 23 ; 8 ; 24 ) . Yet their predictions remain largely opaque. A practitioner cannot easily answer: which node attributes drive the model’s class decisions? This opacity is not merely inconvenient: a GNN trained for citation classification may exploit irrelevant author-name tokens, or a product-recommendation model may rely on price artefacts injected at training time. Without a way to audit which features a GNN actually uses for each class , such shortcuts go undetected until deployment. Model auditing gap. We propose feature shortcut detection as the primary evaluation target for global GNN explainers. Given a trained GNN, does the explainer identify features the model relies on, rather than features merely correlated with class labels in the training set? We formalise this through controlled bias-injection experiments: a synthetic binary feature is correlated with a target class and injected into the graph; a trustworthy explainer must surface this feature prominently. No existing global GNN explainer has demonstrated this capability. Figure 1 : Graft pipeline. Input : trained GNN f and graph (G,X) . Stage 1 selects k diverse exemplar nodes per class via Farthest Point Sampling in embedding space. Stage 2 computes Integrated Gradients for each exemplar: a zero baseline, 50 Riemann interpolation steps, yielding \mathrm{IG}_{e}\in\mathbb{R}^{d} . Stage 3 aggregates |\mathrm{IG}| over exemplars and ranks features by mean importance, producing class profile \mathcal{P}_{c} . Stage 4 verbalises \mathcal{P}_{c} as a natural language rule r_{c} via an LLM with self-refinement, which is human-readable. This work. We fill the global feature-level explainability gap with Graft ( G lobal g R aph A ttribute F eature a T tribution), a post-hoc, model-agnostic method that works with any GNN producing node embeddings. The pipeline has four stages as illustrated in Figure 1 : (1) select k maximally diverse class-representative nodes via Farthest Point Sampling; (2) compute Integrated Gradients ( 22 ) per exemplar; (3) aggregate attributions into a ranked class-level feature importance profile; and (4) verbalise the profile as natural language rules via an LLM. GNN explainability methods split along locality (local vs. global) and granularity (structural vs. feature-level) axes. Global structural methods now exist: GnnXemplar ( 1 ) identifies representative subgraph patterns per class; CIFlow-GNN ( 25 ) uses causal flows over graph topology. The global feature-level quadrant is unoccupied; Graft fills it. Beyond profiles, we introduce three analysis tools: (i) Cross-architecture consensus : what fraction of top- K features are identified independently by \geq 3 of 4 architectures? (ii) Contrastive profiles : for class c , which features have high importance for c but not for any other class? (iii) Jaccard stability : how reproducible is the top- K feature set across seeds? Contributions. 1. Auditing application : the first demonstration of feature shortcut detection for GNNs via global attribution: injected spurious features are recovered within top-3 across all 11 (dataset, architecture) pairs tested (GCN and GAT architectures; § 4.2 ), rank 1 in 9 of 11. 2. Method : Graft , the first global, feature-level, post-hoc GNN explainer with natural language rule generation (§ 3 ). 3. Discriminative evaluation : Graft -selected features (1%–17% of the feature space on the evaluated benchmarks) achieve competitive transfer performance, outperforming frequency-based selection on several datasets while remaining comparable on others (§ 4.3 ). 4. Systematic evaluation : 260 runs across 13 datasets, 4 architectures, 5 seeds; three novel analysis tools quantify explanation quality beyond fidelity. 2 Related Work Local GNN explainability. GNNExplainer ( 26 ) learns per-instance edge/feature masks; PGExplainer ( 14 ) parametrises masks for generalisation. Both target individual predictions; their outputs cannot be straightforwardly aggregated to class-level feature attributions. Per-node Integrated Gradients and SHAP ( 13 ) produce scalar feature attributions for each node, but a class-level summary requires choosing which nodes to include and how to pool, choices that are ad-hoc and that strongly affect the result. From Nodes to Narratives ( 2 ) generates LLM-based natural language explanations at the per-node (local) level. Global GNN explainability. GnnXemplar ( 1 ) is the closest prior work: it selects structural exemplars and uses an LLM to describe recurring subgraph patterns. Its attribution target is graph structure; no feature importance profile is produced. CIFlow-GNN ( 25 ) identifies globally influential structural components via causal intervention flows. Global Shapley methods ( 9 ) attribute importance to activation patterns in intermediate layers rather than raw input features. Graft is complementary to GnnXemplar : the two methods can be combined (" Graft +", see § 5 ) to produce explanations covering both structural and feature-level aspects of a class. Table 1 summarises the landscape. Table 1 : Comparison of global GNN explanation methods. Graft uniquely combines global scope, input-feature attribution, and NL rules. Method Global? Feature-level? NL rules? GNNExplainer ( 26 ) \times ✓(local) \times GnnXemplar ( 1 ) ✓ \times (structural) ✓ CIFlow-GNN ( 25 ) ✓ \times (structural) \times From Nodes to Narratives ( 2 ) \times ✓(local) ✓ Shapley for GNNs ( 9 ) ✓ Partial (activations) \times Graft (ours) ✓ ✓ ✓ Feature attribution. Integrated Gradients ( 22 ) satisfies completeness (attributions sum to f(x)-f(\mathbf{0}) ) and sensitivity (features affecting output receive non-zero attribution). Graft uses IG as a subroutine; any scalar-per-feature attribution method (Grad \times Input ( 21 ) , SHAP ( 13 ) ) can be substituted. Exemplar-based explanations. ProtGNN ( 27 ) learns prototypical subgraphs embedded in the model architecture (intrinsic, not post-hoc). Graft is post-hoc, requiring no architectural changes. FPS-based diversity selection from GnnXemplar is adapted here from the structural to the feature attribution domain. Shortcut and bias detection. Spurious correlations in neural networks have been studied in vision ( 5 ) and NLP ( 16 ) . To our knowledge, Graft is the first method to demonstrate feature shortcut detection for GNNs via global feature attribution. 3 Method 3.1 Problem Formulation Let G=(\mathcal{V},\mathcal{E},X) be a graph with node feature matrix X\in\mathbb{R}^{|\mathcal{V}|\times d} and labels y\in\{1,\ldots,C\}^{|\mathcal{V}|} . Let f be a trained GNN node classifier with f_{c}(x,G) denoting the class- c logit for a node with features x . Goal. For each class c , produce a ranked profile \mathcal{P}_{c}=[(i_{1},s_{1}),\ldots,(i_{K},s_{K})] of the K input features most responsible for f ’s classification of nodes as class c , where s_{j} is feature i_{j} ’s importance score. Produce a natural language rule r_{c} describing the class in terms of these features. 3.2 Graft Stage 1: Diversity-guided exemplar selection. Let h_{v}\in\mathbb{R}^{d_{h}} be the penultimate-layer embedding of node v . Rather than averaging attributions over all class nodes (expensive and dominated by the centroid, which reduces explanation diversity), we select k maximally diverse exemplars via Farthest Point Sampling (FPS) ( 4 ) : e_{1}=\argmin_{v\in\mathcal{V}_{c}}\|h_{v}-\bar{h}_{c}\|_{2},\qquad e_{j+1}=\argmax_{v\in\mathcal{V}_{c}}\min_{i\leq j}\|h_{v}-h_{e_{i}}\|_{2}, (1) where \bar{h}_{c} is the class centroid. FPS guarantees maximum minimum inter-point distance, covering the class manifold without redundancy. Crucially, because FPS is a deterministic function of fixed trained embeddings, profiles built from FPS exemplars are highly reproducible across random seeds (cf. Jaccard stability, § 4.6 ), whereas profiles built from randomly-sampled subsets of class nodes exhibit substantially higher variance. We use k=10 exemplars per class throughout. Separately, K=20 top features are selected for fidelity evaluation; ablations over both k and K are in Appendix B . Stage 2: Integrated Gradients. Integrated Gradients provides a path-integrated measure of feature influence, capturing non-linear interactions between input dimensions. In the context of GNNs, this is particularly important as feature contributions are mediated through message passing and aggregation. The IG formulation ensures that features contributing through higher-order neighborhood effects are still reflected in the attribution signal. For exemplar e\in\mathcal{E}_{c} , with zero baseline (absence of features): \mathrm{IG}_{e}[i]=x_{e}[i]\cdot\int_{0}^{1}\frac{\partial f_{c}(\alpha\cdot x_{e},G)}{\partial x[i]}\,d\alpha, (2) approximated with 50 Gauss-Legendre steps using Captum ( 11 ) . The zero baseline is natural for bag-of-words and TF-IDF features where 0 means word absent. 1 1 1 Runtime: on Cora/GCN (2,708 nodes, 70 exemplars, 50 IG steps) the attribution stage completes in \approx 28s on a single CPU core. A frequency-based profile takes < 1s; the IG overhead is justified by stability, consensus, and bias-detection capabilities unavailable from frequency. Stage 3: Class-level aggregation. The aggregation step transforms local, instance-level explanations into a global class-level representation. This step is critical: naive averaging over all nodes would dilute informative signals due to redundancy and class imbalance. By combining FPS-based diversity with aggregation, GRAFT ensures that the resulting profile captures the support of the class manifold rather than its centroid alone. The default aggregation is a simple mean: \mu_{c}=\frac{1}{|\mathcal{E}_{c}|}\sum_{e\in\mathcal{E}_{c}}|\mathrm{IG}_{e}|\in\mathbb{R}^{d}. (3) We also introduce a confidence-weighted variant that upweights exemplars for which the GNN is more certain: \mu_{c}^{\mathrm{cw}}=\frac{\sum_{e\in\mathcal{E}_{c}}p_{c}(e)\,|\mathrm{IG}_{e}|}{\sum_{e\in\mathcal{E}_{c}}p_{c}(e)}, (4) where p_{c}(e)=\mathrm{softmax}(f(x_{e},G))[c] is the GNN’s predicted probability for class c on exemplar e . High-confidence exemplars are the most unambiguous class representatives; their attributions are more reliable signals. The top- K indices by \mu_{c} (or \mu_{c}^{\mathrm{cw}} ) form the core profile \mathcal{P}_{c} . Remark 1 (Aggregate completeness) . IG satisfies per-exemplar completeness: \sum_{i}\mathrm{IG}_{e}[i]=f_{c}(x_{e},G)-f_{c}(\mathbf{0},G) . Taking the mean over \mathcal{E}_{c} gives \langle\mu_{c},\mathbf{1}\rangle=\frac{1}{|\mathcal{E}_{c}|}\sum_{e}[f_{c}(x_{e},G)-f_{c}(\mathbf{0},G)] , the average gap between exemplar predictions and the all-zero baseline. This aggregate quantity is a meaningful measure of how strongly the class is "supported" by its top features, grounding \mu_{c} in the model’s actual output differences. Proposition 1 (FPS profile approximation) . Let |\mathrm{IG}|:\mathcal{V}_{c}\!\to\!\mathbb{R}^{d} be L -Lipschitz with respect to the GNN embedding: \big\||\mathrm{IG}_{u}|-|\mathrm{IG}_{v}|\big\|_{\infty}\leq L\|h_{u}-h_{v}\|_{2} for all u,v\in\mathcal{V}_{c} . Let r_{k} be the FPS coverage radius and assume balanced Voronoi cells. Then \bigl\|\mu_{c}-\mu_{c}^{*}\bigr\|_{\infty}\;\leq\;L\cdot r_{k}, (5) where \mu_{c}^{*}=\frac{1}{|\mathcal{V}_{c}|}\sum_{v\in\mathcal{V}_{c}}|\mathrm{IG}_{v}| is the oracle profile over all class nodes. Since FPS is a 2-approximation to the optimal k -centre radius ( 7 ) , r_{k}\leq 2r_{k}^{*} , and increasing k monotonically tightens the bound. Proposition 2 (Fidelity-attribution correspondence) . Assume a linear decoder : f_{c}(x,G)=a_{c}^{\top}x+b_{c} where a_{c}=B^{\top}w_{c} for a fixed graph-dependent matrix B and bias b_{c} (valid for any GNN with a linear readout head, including GCNConv which has a bias by default). Then for node v with top- K profile T_{c} : \displaystyle f_{c}(x_{v},G)-f_{c}(x_{v}^{-T_{c}},G) \displaystyle=\sum_{i\in T_{c}}\mathrm{IG}_{v}[i], (6) \displaystyle f_{c}(x_{v}^{T_{c}},G)-f_{c}(\mathbf{0},G) \displaystyle=\sum_{i\in T_{c}}\mathrm{IG}_{v}[i], (7) where x_{v}^{T_{c}} zeros all features outside T_{c} . Both quantities equal \sum_{i\in T_{c}}\mathrm{IG}_{v}[i] : the profile captures exactly that portion of the class- c logit. Furthermore, under the class-positive assumption ( \mathrm{IG}_{v}[i]\geq 0 for all i\in T_{c} , which holds when top- K features positively support class c , e.g. for binary bag-of-words with a well-trained classifier), \sum_{i\in T_{c}(K)}\mathrm{IG}_{v}[i] is non-decreasing in K . Proofs are in Appendix I . Proposition 1 directly justifies why more exemplars ( \uparrow k ) improve profile quality; Proposition 2 provides a logit-level interpretation of fidelity as attribution capture, and explains the monotone \mathrm{Fid}^{-} vs K trend in our ablation (Appendix B ) under the mild class-positive assumption satisfied by bag-of-words features. Contrastive profiles (subtracting the max attribution of other classes from \mu_{c}[i] ) are defined in Appendix J and used for qualitative analysis only. Stage 4: Natural language rules. The top-15 features from \mathcal{P}_{c} , with importance scores, are passed to an LLM (Claude Sonnet 4.6 / Gemini / Ollama) with dataset-specific context, using temperature =0.2 . The same model acts as both generator and self-refinement judge: an initial rule is generated from the feature list, then a single self-refinement pass re-examines the rule against the features and rewrites it if any aspect (accuracy, specificity, completeness) can be improved, returning it unchanged otherwise (exact prompts in Appendix H ). All quantitative evaluations use \mathcal{P}_{c} directly; Stage 4 adds a human-readable layer for practitioners. 3.3 Analysis Tools Cross-architecture consensus. Let T_{c}^{(m)} be the top- K feature indices from model m . \mathrm{Consensus}_{c}(\tau)=\frac{\bigl|\{i:|\{m:i\in T_{c}^{(m)}\}|\geq\tau\}\bigr|}{K}. (8) We use \tau=3 (out of 4 architectures). High consensus means the explanation is architecture-invariant. Jaccard stability. Let T_{c}^{(s)} be the top- K set from seed s . J_{c}=\frac{1}{\binom{N_{s}}{2}}\sum_{s