Analog Bayesian neural networks are insensitive to the shape of the weight distribution
Ravi G. Patel, T. Patrick Xiao, Sapan Agarwal, Christopher Bennett · 2025
Read Analog Bayesian neural networks are insensitive to the shape of the weight distribution by Ravi G. Patel, T. Patrick Xiao, Sapan Agarwal, Christopher Bennett (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05564.txt.
Description
Ravi Patel, Patrick Xiao, Sapan Agarwal, and Christopher Bennett study neural networks that run on analog hardware in a 2025 paper. Such networks state their doubt about each weight, and analog chips could save large amounts of energy. But chips make noise with hard to control shapes, while standard training assumes a neat bell shaped spread.
The authors give a training method that uses the real noise from a device as the spread. In tests, networks with the same weight means and spreads settled to the same forecasts, no matter what shape the noise took. Chip designers can thus ignore noise shape for this kind of network, they argue.
Catalog record
| CREATOR | Ravi G. Patel, T. Patrick Xiao, Sapan Agarwal, Christopher Bennett |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-05564