Logit Disagreement: OoD Detection with Bayesian Neural Networks

Kevin Raina · 2025

Read Logit Disagreement: OoD Detection with Bayesian Neural Networks by Kevin Raina (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15648.txt.

Description

Kevin Raina proposes a sharper uncertainty score for spotting out-of-place data, in a 2025 paper. Bayesian neural networks spread their bets across many settings, and their doubt should flare on inputs unlike the training set. The standard doubt split often underperforms the cruder total score, a standing puzzle.

Raina measures disagreement among the network's pre-final outputs, the logits, after a correction drawn from related work. Three scores built this way estimate the knowledge-based part of doubt directly. Across a range of detection tests they beat the usual information score clearly and match it elsewhere. Better doubt estimates matter wherever models must say they do not know, from clinics to self-driving stacks.

Catalog record

CREATORKevin Raina
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-15648

Browse the full library · About the Tower of Babel