Post-Hoc Uncertainty Quantification in Pre-Trained Neural Networks via Activation-Level Gaussian Processes
Richard Bergna, Stefan Depeweg, Sergio Calvo-Ordoñez, Jonathan Plenk, Alvaro Cartea, Jose Miguel Hernández-Lobato · 2025
Read Post-Hoc Uncertainty Quantification in Pre-Trained Neural Networks via Activation-Level Gaussian Processes by Richard Bergna, Stefan Depeweg, Sergio Calvo-Ordoñez, Jonathan Plenk, Alvaro Cartea, Jose Miguel Hernández-Lobato (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20966.txt.
Description
Richard Bergna and co-authors bolt uncertainty estimates onto already-trained neural networks without retraining them. Knowing when a model is unsure is essential in medicine and finance, but classic Bayesian fixes either underfit or cost too much at scale. Their move is to place the uncertainty in the activations, the neuron outputs, rather than in the weights.
A Gaussian process activation function measures how variable each neuron's response is. Because the method is post-hoc, the original predictions stay untouched, dodging the underfitting of full Bayesian training. Two variants trade flexibility for speed. Pretrained giants can thus confess doubt cheaply. Deployment settings that cannot retrain stand to gain most.
Catalog record
| CREATOR | Richard Bergna, Stefan Depeweg, Sergio Calvo-Ordoñez, Jonathan Plenk, Alvaro Cartea, Jose Miguel Hernández-Lobato |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-20966