Verifying LLM Inference to Prevent Model Weight Exfiltration
Roy Rinberg, Adam Karvonen, Alexander Hoover, Daniel Reuter, Keri Warr, [2mm] Harvard University · 2025
Read Verifying LLM Inference to Prevent Model Weight Exfiltration by Roy Rinberg, Adam Karvonen, Alexander Hoover, Daniel Reuter, Keri Warr, [2mm] Harvard University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-02620.txt.
Introduction
Roy Rinberg, Adam Karvonen, Alexander Hoover, Daniel Reuter, and Keri Warr defend the crown jewels of AI companies, the model weights, against theft through the front door. Whoever runs an inference server could smuggle the weights out hidden inside ordinary-looking model responses, a steganographic exfiltration that normal monitoring would miss. The authors formalise the threat as a security game and build a verification framework that provably limits how much information such a channel can carry.
Verification means characterising every legitimate source of randomness in model inference, so anything unexplained becomes suspicious; two practical estimators measure those sources. Tested on open models from three to thirty billion parameters, the detector squeezed the exfiltratable information below 0.5 percent of responses at a false-positive rate under 0.01 percent on the largest model, slowing an attacker more than two-hundredfold. Protection, the authors conclude, need not cost providers much.
Catalog record
| CREATOR | Roy Rinberg, Adam Karvonen, Alexander Hoover, Daniel Reuter, Keri Warr, [2mm] Harvard University |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 120 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-02620