GradPCA: Leveraging NTK Alignment for Reliable Out-of-Distribution Detection

Mariia Seleznova, Hung-Hsu Chou, Claudio Mayrink Verdun, Gitta Kutyniok · 2025

Read GradPCA: Leveraging NTK Alignment for Reliable Out-of-Distribution Detection by Mariia Seleznova, Hung-Hsu Chou, Claudio Mayrink Verdun, Gitta Kutyniok (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16017.txt.

Introduction

Mariia Seleznova, Hung-Hsu Chou, and their co-authors present GradPCA, a 2025 method for spotting inputs that lie outside a neural network's training data. Flagging out of distribution inputs matters for safe deployment, since models fail silently on them. Their method reads the gradients of the network, whose structure, they argue, carries a useful signal.

Networks trained in a certain regime show gradients that align along a low rank pattern, tied to the neural tangent kernel. Applying principal component analysis to the mean gradient of each class exploits that pattern. Tests on standard image benchmarks gave more consistent detection than rival methods. The team's theory also shows that feature quality, above all using pretrained features, decides which detectors succeed.

Catalog record

CREATORMariia Seleznova, Hung-Hsu Chou, Claudio Mayrink Verdun, Gitta Kutyniok
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE131 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-16017

Browse the full library · About the Tower of Babel