Unstable Rankings in Bayesian Deep Learning Evaluation

Qishi Zhan, Minxuan Hu, Guansu Wang, Jiaxin Liu, Liang He · 2026

Read Unstable Rankings in Bayesian Deep Learning Evaluation by Qishi Zhan, Minxuan Hu, Guansu Wang, Jiaxin Liu, Liang He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23102.txt.

Description

Zhan and four colleagues show that rankings of Bayesian deep learning methods turn shaky when data are scarce. The same comparison can look certain on one dataset and doubtful on another, so no single sample size fits all. They model scores as random across data draws and add a curve testing whether a gap would show at a given size. Across six methods and five datasets, uncertainty checks must precede claims of superiority.

Catalog record

CREATORQishi Zhan, Minxuan Hu, Guansu Wang, Jiaxin Liu, Liang He
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52097
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23102

Browse the full library · About the Tower of Babel