Extending Kernel Trick to Influence Functions
Zhenhuan Sun, Shahrokh Valaee · 2026
Read Extending Kernel Trick to Influence Functions by Zhenhuan Sun, Shahrokh Valaee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11239.txt.
Description
Zhenhuan Sun and Shahrokh Valaee extend the kernel trick to influence functions with a dual representation that scales in cost with dataset size rather than model size. In theory and in tests, this representation gives a cheaper stand-in for original influence functions when estimating how removing a data point shifts parameters, model outputs, and loss. This holds when model size is large versus dataset size or when parameter-space evaluation is infeasible.
The dual route is limited to linearizable models, whose behavior can be approximated by linearizations throughout training. It also needs a matrix whose size scales with model output dimension times dataset size. Interpretability researchers get a dataset-sized route to influence estimation, with its limits stated plainly.
Catalog record
| CREATOR | Zhenhuan Sun, Shahrokh Valaee |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78227 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11239