AGOP-IxG: A Gradient Covariance Filter for Local Feature Attribution on Tabular Data, with a Controlled Benchmark
Raj Kiran Gupta Katakam · 2026
Read AGOP-IxG: A Gradient Covariance Filter for Local Feature Attribution on Tabular Data, with a Controlled Benchmark by Raj Kiran Gupta Katakam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15700.txt.
Introduction
Raj Kiran Gupta Katakam proposes AGOP-IxG, a fast per-sample attribution method for tabular classifiers. It pre-multiplies each sample gradient by a rank-truncated average gradient outer product matrix. Tests use a controlled tabular benchmark with ground-truth attribution. On three synthetic tasks it leads on rank correlation and noise mass, and on top-k precision for the interaction task. It runs about 350 to 1,650 times faster than SHAP. On real income and credit data, methods cluster within about 1.7 percent relative AUC, fitting a local rather than global tool.
Catalog record
| CREATOR | Raj Kiran Gupta Katakam |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40279 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15700
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AGOP-IxG: A Gradient Covariance Filter for Local Feature Attribution on Tabular Data, with a Controlled Benchmark Raj Kiran Gupta Katakam Abstract Automated machine learning pipelines increasingly produce models whose predictions must be explained to end users, auditors, and downstream decision systems. The most widely used feature attribution methods (SHAP, Integrated Gradients, LIME) are typically chosen by convention rather than measured fidelity, because rigorous evaluation is impeded by the absence of ground-truth attribution on real data. We propose AGOP-IxG , a fast per-sample attribution method for tabular classifiers that pre-multiplies the per-sample gradient by a top- K K rank-truncated Average Gradient Outer Product matrix, and evaluate it against four widely-used baselines on a controlled tabular benchmark designed for AutoML practitioners. In Part 1, we construct three synthetic multi-class tabular tasks — linear, sparse nonlinear, and interaction-based — where ground-truth attribution per sample is analytically or numerically derivable, and compare five methods: AGOP-IxG (shortened to ‘‘AGOP’’ in figure panels only), SHAP (DeepExplainer), Integrated Gradients, InputXGradient, and LIME. AGOP-IxG leads on Spearman rank correlation and on noise feature mass on all three synthetic datasets, and on top- k k precision on the interaction dataset. On the linear task, LIME has a marginal advantage on top- k k precision only ( 0.915 0.915 vs. 0.895 0.895 ). On the sparse nonlinear task, SHAP holds a near-tie advantage on top- k k precision ( 0.515 0.515 vs. AGOP-IxG’s 0.514 0.514 ) but AGOP-IxG leads on Spearman ( 0.516 0.516 vs. 0.511 0.511 ) and on noise feature mass by a wide margin ( 0.244 0.244 vs. 0.409 0.409 ). Across all settings, AGOP-IxG is approximately 350 × 350\times to 1,650 × 1{,}650\times faster than SHAP ( ∼ \sim 0.02–0.10 s vs. ∼ \sim 33 s per dataset). In Part 2, we evaluate global faithfulness on two real tabular datasets (Adult Income and Credit Card Default) using the ROAR protocol ( ℍ⋊⋊ℸ∖ ≈ ⅁⋖∤∦ ⊭⊬⊮↛ ) . On real data the methods are closely clustered, and no single method dominates, consistent with AGOP-IxG being optimized for per-sample local attribution rather than global feature ranking. 1 Introduction Modern AutoML systems search over models, hyperparameters, and preprocessing pipelines, with the result that the model handed to a practitioner is often a black-box artifact of the search rather than a hand-designed architecture. In high-stakes deployments — credit scoring, medical risk, fraud detection — regulators and downstream consumers of the model demand per-prediction explanations. Feature attribution methods are the standard tooling for this need: they assign a scalar importance score to each input feature, indicating its contribution to a specific prediction. Despite a rich literature, a fundamental evaluation problem remains: how do we know if an attribution is correct? On real tabular data, ground-truth attribution is unavailable. The most commonly used proxy — agreement between methods, or plausibility judged by domain experts — is circular: it rewards methods that agree with each other, not methods that recover the true causal signal. The ROAR protocol ( ℍ⋊⋊ℸ∖ ≈ ⅁⋖∤∦ ⊭⊬⊮↛ ) offers a model-based proxy by measuring accuracy degradation under feature removal and retraining, but it measures global feature importance, not the quality of individual per-sample explanations. As a consequence, AutoML practitioners selecting an attribution method for a downstream pipeline have no principled basis for comparison. In this paper we propose AGOP-IxG (Section 3.1 ), a fast per-sample attribution method for tabular classifiers, and evaluate it on a controlled benchmark with known ground-truth attribution per sample, enabling direct evaluation of per-sample attribution quality without proxy measures. We compare AGOP-IxG against four widely-used baselines spanning the main algorithmic families — gradient-based (InputXGradient), path-integral (Integrated Gradients), game-theoretic (SHAP), and local surrogate (LIME) — on these synthetic benchmarks, and then apply ROAR on two real datasets to assess global faithfulness. Relevance to AutoML. The benchmark is designed for direct reuse in AutoML evaluation pipelines: (i) the synthetic generators are parametric and require no proprietary data, (ii) the evaluation metrics are model-agnostic and applicable to any attribution method that produces a per-sample attribution vector, and (iii) ground-truth attribution provides a loss-like signal that can be used inside an AutoML system to auto-select or auto-tune attribution methods for a target model. Our main contributions are: 1. AGOP-IxG (Section 3.1 ): a fast per-sample attribution method for tabular classifiers composing InputXGradient with a top- K rank-truncated AGOP gradient filter. AGOP-IxG achieves the lowest noise-feature mass on every synthetic benchmark we evaluate. 2. A controlled tabular evaluation framework (Section 4 ) with three multi-class synthetic regimes (linear, sparse nonlinear, feature-interaction) for which per-sample ground-truth attribution is analytically or numerically derivable, evaluated under Spearman, top- k , and noise feature mass across four seeds. 3. A ROAR evaluation on real tabular data (Section 5 ) contrasting local per-sample fidelity (where AGOP-IxG leads) against global feature ranking (where methods cluster within {\sim}1.7\% AUC) — a distinction relevant when AutoML systems must serve both per-decision explanations and feature-selection consumers. 2 Background and Related Work Gradient-based attribution. 𝕊ℶ⋗⋊⋉↷⅁⋉ ≈ ⅁⋖∤∦ ⊭⊬⊮⋭ introduced vanilla gradients as saliency maps. 𝕊≂∖ℶℸ≊⋗⅁∖ ≈ ⅁⋖∤∦ ⊭⊬⊮⋫ showed that gradients times inputs better reflect feature contributions, leading to InputXGradient. 𝕊≊⋉⅁∖⅁∖⅁ℷ⅁⋉ ≈ ⅁⋖∤∦ ⊭⊬⊮⋪ formalised Integrated Gradients (IG), which satisfies the completeness axiom by integrating gradients along a path from a baseline to the input. Game-theoretic attribution. 𝕊≂⅁∣⋖↷∦ ⊮↛⋬⊯ defined Shapley values in cooperative game theory; 𝕃≊⋉∖ð ⅁⋉ 𝕃∦ ⊭⊬⊮⋪ unified several attribution methods under the SHAP framework and provided DeepExplainer for neural networks via a background-dataset approximation. Local surrogate methods. ℝℶℶ∖⋊ ≈ ⅁⋖∤∦ ⊭⊬⊮⋫ proposed LIME, which fits a local linear model in the neighbourhood of each sample using perturbed inputs. Second-order gradient methods. The Average Gradient Outer Product (AGOP) matrix M=\frac{1}{n}\sum_{i}g_{i}g_{i}^{\top} has connections to the Neural Tangent Kernel ( 𝕁⅁⋊≈ ≈ ⅁⋖∤∦ ⊭⊬⊮↚ ) and to function-space geometry studied in ℝ⅁≂⅁ℸ∖ℶ∼≂⋉⅁⋉ ≈ ⅁⋖∤∦ ⊭⊬⊭⊭ . 𝔼⋉ð∼≈∖⋊⋗ ≈ ⅁⋖∤∦ ⊭⊬⊭⊯ use gradient covariance for data selection; our work applies it as a per-sample attribution filter. ℝ⅁≂⅁ℸ∖ℶ∼≂⋉⅁⋉ ≈ ⅁⋖∤∦ ⊭⊬⊭⊭ studies AGOP in the context of feature learning in neural networks but does not apply it as an attribution method or benchmark it against SHAP/IG/LIME on controlled ground-truth tasks. Concurrent work ( 𝕂⅁≈⅁ℸ⅁⋗∦ ⊭⊬⊭⋫ ) explores AGOP-based attribution for image classifiers via a different formulation ( AGOP-Weighted : per-pixel scaling of the gradient magnitude by the normalised diagonal \sqrt{\mathrm{diag}(M)/\max_{j}\mathrm{diag}(M)_{j}} ). The AGOP-IxG formulation in this paper (Section 3.1 ) instead uses the full top- K rank reconstruction M_{K}=V_{K}\Lambda_{K}V_{K}^{\top} as a linear projection of the gradient, with InputXGradient-style baseline subtraction; the two methods share the AGOP matrix as a training-distribution prior but apply it differently. Evaluation of attribution methods. ℍ⋊⋊ℸ∖ ≈ ⅁⋖∤∦ ⊭⊬⊮↛ proposed ROAR, replacing top-attributed features and retraining; we use this in Part 2. 𝕊⅁⋗ℸ ≈ ⅁⋖∤∦ ⊭⊬⊮⋪ proposed pixel-flipping for images. 𝔸⅁↷⋊ ≈ ⅁⋖∤∦ ⊭⊬⊮↚ introduced sanity checks via model/data randomisation. Synthetic benchmarks with known ground truth have been used for image saliency ( 𝕐⅁⋉ð ⅁⋉ 𝕂ℶ⋗∦ ⊭⊬⊮↛ ) but are less common for tabular data; our work fills this gap. Attribution in AutoML. Attribution outputs are increasingly produced by AutoML systems alongside the model itself (e.g. as part of a deployed explainability service). Most AutoML benchmarks ( 𝔾ℶℷ∼∖∼ ≈ ⅁⋖∤∦ ⊭⊬⊭⊭ ) measure predictive accuracy and