Benign Overfitting in Adversarial Training for Vision Transformers

Jiaming Zhang, Meng Ding, Shaopeng Fu, Jingfeng Zhang, Di Wang · 2026

Read Benign Overfitting in Adversarial Training for Vision Transformers by Jiaming Zhang, Meng Ding, Shaopeng Fu, Jingfeng Zhang, Di Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19724.txt.

Introduction

Zhang and four colleagues give the first theory for adversarial training under simple vision transformer architectures. When signal-to-noise ratio meets a stated rule and perturbation budgets stay modest, training drives robust training loss near zero with small robust error. Strong results persist despite overfitting, the benign overfitting seen only before in convolutional networks with adversarial training. Lab and real-world experiments back the theory.

Catalog record

CREATORJiaming Zhang, Meng Ding, Shaopeng Fu, Jingfeng Zhang, Di Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE333796
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19724

Browse the full library · About the Tower of Babel