Uncertainty propagation in feed-forward neural network models

Jeremy Diamzon, Daniele Venturi · 2025

Read Uncertainty propagation in feed-forward neural network models by Jeremy Diamzon, Daniele Venturi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21059.txt.

Description

Jeremy Diamzon and Daniele Venturi work out how doubt flows through a neural network when its inputs are noisy. Their 2025 paper treats feed-forward networks built with leaky ReLU units, a common design. Engineers need the full spread of possible outputs, not just a single best guess, when a network feeds a safety call.

The pair derive exact formulas for the output's probability curve and its key averages, written in terms of the input spread and the network's own weights. A surprise finding helps: a mild linearization of the activation keeps the formulas accurate even for large input swings. They also build fast stand-in models for the joint output curve. Monte Carlo tests on a network that mimics a complex operator matched the theory closely.

Catalog record

CREATORJeremy Diamzon, Daniele Venturi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-21059

Browse the full library · About the Tower of Babel