Activation Functions Considered Harmful: Recovering Neural Network Weights through Controlled Channels
Jesse Spielman and and and, David Oswald, Mark Ryan, Jo Van Bulck · 2025
Read Activation Functions Considered Harmful: Recovering Neural Network Weights through Controlled Channels by Jesse Spielman and and and, David Oswald, Mark Ryan, Jo Van Bulck (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19142.txt.
Description
Jesse Spielman, David Oswald, Mark Ryan, and Jo Van Bulck show a new way to steal the weights of a neural network. Their 2025 attack targets models run inside a guarded Intel enclave that should keep secrets safe. The weak point is how common activation functions read memory in ways that depend on the input.
With a fine-grained trace tool, the team can watch page access step by step with no noise. In one test net they recover all first-layer weights and biases with high accuracy. Only a small set of queries per weight is needed. A broad scan finds the same flawed pattern in many popular tools. The authors urge stricter side-channel checks for such code.
Catalog record
| CREATOR | Jesse Spielman and and and, David Oswald, Mark Ryan, Jo Van Bulck |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-19142