Undetectable Backdoors in Model Parameters: Hiding Sparse Secrets in High Dimensions
Sarthak Choudhary, Atharv Singh Patlan, Nils Palumbo, Ashish Hooda, Kassem Fawaz, Somesh Jha, [0.5em] University of Wisconsin--Madison · 2026
Read Undetectable Backdoors in Model Parameters: Hiding Sparse Secrets in High Dimensions by Sarthak Choudhary, Atharv Singh Patlan, Nils Palumbo, Ashish Hooda, Kassem Fawaz, Somesh Jha, [0.5em] University of Wisconsin--Madison (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04209.txt.
Description
Sarthak Choudhary and five co-authors describe an attack that hides a secret backdoor inside a pretrained image classifier. The altered model behaves normally until a trigger appears, then it sends the input to a class chosen by the attacker.
The change is a sparse nudge spread across layers, masked with random noise so the weights look like a clean reference model. The authors prove that telling the two apart is at least as hard as a known hard detection problem, even for a checker who can inspect every weight. The work exposes a supply-chain risk for shared models.
Catalog record
| CREATOR | Sarthak Choudhary, Atharv Singh Patlan, Nils Palumbo, Ashish Hooda, Kassem Fawaz, Somesh Jha, [0.5em] University of Wisconsin--Madison |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 125 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.04209