Robustness Tokens: Towards Adversarial Robustness of Transformers
Brian Pulfer, Yury Belousov, Slava Voloshynovskiy · 2025
Read Robustness Tokens: Towards Adversarial Robustness of Transformers by Brian Pulfer, Yury Belousov, Slava Voloshynovskiy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-10191.txt.
Description
Brian Pulfer, Yury Belousov, and Slava Voloshynovskiy harden vision transformers against adversarial attacks by tuning a few secret tokens. Their work appeared in twenty twenty-five. Public foundation models are shared widely, so attackers can craft attacks on the very backbone a defender uses.
Instead of retraining the whole model, their method adds a handful of private tokens and tunes only those. The cost is tiny compared with classic adversarial training. In white-box tests, where the attacker knows the model, robustness rose sharply. Normal task accuracy stayed intact. The trick exploits the transformer design itself: extra tokens steer attention away from attack patterns. The authors pitch it as cheap insurance for anyone building on public models.
Catalog record
| CREATOR | Brian Pulfer, Yury Belousov, Slava Voloshynovskiy |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-10191