Uncertainty propagation in feed-forward neural network models
Jeremy Diamzon, Daniele Venturi · 2025
Read Uncertainty propagation in feed-forward neural network models by Jeremy Diamzon, Daniele Venturi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21059.txt.
Description
Jeremy Diamzon and Daniele Venturi work out how doubt flows through a neural network when its inputs are noisy. Their 2025 paper treats feed-forward networks built with leaky ReLU units, a common design. Engineers need the full spread of possible outputs, not just a single best guess, when a network feeds a safety call.
The pair derive exact formulas for the output's probability curve and its key averages, written in terms of the input spread and the network's own weights. A surprise finding helps: a mild linearization of the activation keeps the formulas accurate even for large input swings. They also build fast stand-in models for the joint output curve. Monte Carlo tests on a network that mimics a complex operator matched the theory closely.
Catalog record
| CREATOR | Jeremy Diamzon, Daniele Venturi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-21059