Benign Overfitting in Adversarial Training for Vision Transformers
Jiaming Zhang, Meng Ding, Shaopeng Fu, Jingfeng Zhang, Di Wang · 2026
Read Benign Overfitting in Adversarial Training for Vision Transformers by Jiaming Zhang, Meng Ding, Shaopeng Fu, Jingfeng Zhang, Di Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19724.txt.
Introduction
Zhang and four colleagues give the first theory for adversarial training under simple vision transformer architectures. When signal-to-noise ratio meets a stated rule and perturbation budgets stay modest, training drives robust training loss near zero with small robust error. Strong results persist despite overfitting, the benign overfitting seen only before in convolutional networks with adversarial training. Lab and real-world experiments back the theory.
Catalog record
| CREATOR | Jiaming Zhang, Meng Ding, Shaopeng Fu, Jingfeng Zhang, Di Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 333796 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.19724