Robustness Tokens: Towards Adversarial Robustness of Transformers

Brian Pulfer, Yury Belousov, Slava Voloshynovskiy · 2025

Read Robustness Tokens: Towards Adversarial Robustness of Transformers by Brian Pulfer, Yury Belousov, Slava Voloshynovskiy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-10191.txt.

Description

Brian Pulfer, Yury Belousov, and Slava Voloshynovskiy harden vision transformers against adversarial attacks by tuning a few secret tokens. Their work appeared in twenty twenty-five. Public foundation models are shared widely, so attackers can craft attacks on the very backbone a defender uses.

Instead of retraining the whole model, their method adds a handful of private tokens and tunes only those. The cost is tiny compared with classic adversarial training. In white-box tests, where the attacker knows the model, robustness rose sharply. Normal task accuracy stayed intact. The trick exploits the transformer design itself: extra tokens steer attention away from attack patterns. The authors pitch it as cheap insurance for anyone building on public models.

Catalog record

CREATORBrian Pulfer, Yury Belousov, Slava Voloshynovskiy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-10191

Browse the full library · About the Tower of Babel