Feature Preserving Shrinkage on Bayesian Neural Networks via the R2D2 Prior

Tsai Hor Chan, Dora Yan Zhang, Guosheng Yin, Lequan Yu · 2025

Read Feature Preserving Shrinkage on Bayesian Neural Networks via the R2D2 Prior by Tsai Hor Chan, Dora Yan Zhang, Guosheng Yin, Lequan Yu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18280.txt.

Description

Tsai Hor Chan, Dora Yan Zhang, Guosheng Yin, and Lequan Yu improve how Bayesian neural networks handle noisy features, in a research paper from 2025. These networks treat their weights as ranges rather than fixed values, which helps them report uncertainty. A poor prior choice can bloat that uncertainty or crush real signals.

Their design applies a prior that shrinks useless weights toward zero while sparing key features. A new inference method mixes sampling steps with gradient updates for steadier estimates. The authors back the method with theory on how fast the posterior settles. Tests on natural and medical images show good accuracy and uncertainty scores.

Catalog record

CREATORTsai Hor Chan, Dora Yan Zhang, Guosheng Yin, Lequan Yu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18280

Browse the full library · About the Tower of Babel