Activation Functions Considered Harmful: Recovering Neural Network Weights through Controlled Channels

Jesse Spielman and and and, David Oswald, Mark Ryan, Jo Van Bulck · 2025

Read Activation Functions Considered Harmful: Recovering Neural Network Weights through Controlled Channels by Jesse Spielman and and and, David Oswald, Mark Ryan, Jo Van Bulck (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19142.txt.

Description

Jesse Spielman, David Oswald, Mark Ryan, and Jo Van Bulck show a new way to steal the weights of a neural network. Their 2025 attack targets models run inside a guarded Intel enclave that should keep secrets safe. The weak point is how common activation functions read memory in ways that depend on the input.

With a fine-grained trace tool, the team can watch page access step by step with no noise. In one test net they recover all first-layer weights and biases with high accuracy. Only a small set of queries per weight is needed. A broad scan finds the same flawed pattern in many popular tools. The authors urge stricter side-channel checks for such code.

Catalog record

CREATORJesse Spielman and and and, David Oswald, Mark Ryan, Jo Van Bulck
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-19142

Browse the full library · About the Tower of Babel