Extending Kernel Trick to Influence Functions

Zhenhuan Sun, Shahrokh Valaee · 2026

Read Extending Kernel Trick to Influence Functions by Zhenhuan Sun, Shahrokh Valaee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11239.txt.

Description

Zhenhuan Sun and Shahrokh Valaee extend the kernel trick to influence functions with a dual representation that scales in cost with dataset size rather than model size. In theory and in tests, this representation gives a cheaper stand-in for original influence functions when estimating how removing a data point shifts parameters, model outputs, and loss. This holds when model size is large versus dataset size or when parameter-space evaluation is infeasible.

The dual route is limited to linearizable models, whose behavior can be approximated by linearizations throughout training. It also needs a matrix whose size scales with model output dimension times dataset size. Interpretability researchers get a dataset-sized route to influence estimation, with its limits stated plainly.

Catalog record

CREATORZhenhuan Sun, Shahrokh Valaee
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78227
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11239

Browse the full library · About the Tower of Babel