Teach Me to Trick: Exploring Adversarial Transferability via Knowledge Distillation
Siddhartha Pradhan, Shikshya Shiwakoti, Neha Bathuri · 2025
Read Teach Me to Trick: Exploring Adversarial Transferability via Knowledge Distillation by Siddhartha Pradhan, Shikshya Shiwakoti, Neha Bathuri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21992.txt.
Description
Fooling a guarded neural network often works by crafting an attack on a stand-in model and hoping it transfers. Siddhartha Pradhan, Shikshya Shiwakoti, and Neha Bathuri show in 2025 that a student model distilled from several teachers crafts unusually transferable attacks.
The small student learned from two large networks, by alternating lessons and by joint training. Attacks brewed on the student, gradient tricks of three kinds, then hit a black-box target they had never touched. Success matched ensemble attacks while running up to six times faster. Cooler training settings and keeping true labels in the mix sharpened transfer further. Distillation, usually a compression tool, here serves as an attack amplifier worth defending against.
Catalog record
| CREATOR | Siddhartha Pradhan, Shikshya Shiwakoti, Neha Bathuri |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-21992