GradPCA: Leveraging NTK Alignment for Reliable Out-of-Distribution Detection
Mariia Seleznova, Hung-Hsu Chou, Claudio Mayrink Verdun, Gitta Kutyniok · 2025
Read GradPCA: Leveraging NTK Alignment for Reliable Out-of-Distribution Detection by Mariia Seleznova, Hung-Hsu Chou, Claudio Mayrink Verdun, Gitta Kutyniok (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16017.txt.
Introduction
Mariia Seleznova, Hung-Hsu Chou, and their co-authors present GradPCA, a 2025 method for spotting inputs that lie outside a neural network's training data. Flagging out of distribution inputs matters for safe deployment, since models fail silently on them. Their method reads the gradients of the network, whose structure, they argue, carries a useful signal.
Networks trained in a certain regime show gradients that align along a low rank pattern, tied to the neural tangent kernel. Applying principal component analysis to the mean gradient of each class exploits that pattern. Tests on standard image benchmarks gave more consistent detection than rival methods. The team's theory also shows that feature quality, above all using pretrained features, decides which detectors succeed.
Catalog record
| CREATOR | Mariia Seleznova, Hung-Hsu Chou, Claudio Mayrink Verdun, Gitta Kutyniok |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 131 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-16017