Post-Hoc Uncertainty Quantification in Pre-Trained Neural Networks via Activation-Level Gaussian Processes

Richard Bergna, Stefan Depeweg, Sergio Calvo-Ordoñez, Jonathan Plenk, Alvaro Cartea, Jose Miguel Hernández-Lobato · 2025

Read Post-Hoc Uncertainty Quantification in Pre-Trained Neural Networks via Activation-Level Gaussian Processes by Richard Bergna, Stefan Depeweg, Sergio Calvo-Ordoñez, Jonathan Plenk, Alvaro Cartea, Jose Miguel Hernández-Lobato (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20966.txt.

Description

Richard Bergna and co-authors bolt uncertainty estimates onto already-trained neural networks without retraining them. Knowing when a model is unsure is essential in medicine and finance, but classic Bayesian fixes either underfit or cost too much at scale. Their move is to place the uncertainty in the activations, the neuron outputs, rather than in the weights.

A Gaussian process activation function measures how variable each neuron's response is. Because the method is post-hoc, the original predictions stay untouched, dodging the underfitting of full Bayesian training. Two variants trade flexibility for speed. Pretrained giants can thus confess doubt cheaply. Deployment settings that cannot retrain stand to gain most.

Catalog record

CREATORRichard Bergna, Stefan Depeweg, Sergio Calvo-Ordoñez, Jonathan Plenk, Alvaro Cartea, Jose Miguel Hernández-Lobato
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-20966

Browse the full library · About the Tower of Babel