Unstable Rankings in Bayesian Deep Learning Evaluation
Qishi Zhan, Minxuan Hu, Guansu Wang, Jiaxin Liu, Liang He · 2026
Read Unstable Rankings in Bayesian Deep Learning Evaluation by Qishi Zhan, Minxuan Hu, Guansu Wang, Jiaxin Liu, Liang He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23102.txt.
Description
Zhan and four colleagues show that rankings of Bayesian deep learning methods turn shaky when data are scarce. The same comparison can look certain on one dataset and doubtful on another, so no single sample size fits all. They model scores as random across data draws and add a curve testing whether a gap would show at a given size. Across six methods and five datasets, uncertainty checks must precede claims of superiority.
Catalog record
| CREATOR | Qishi Zhan, Minxuan Hu, Guansu Wang, Jiaxin Liu, Liang He |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52097 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.23102