Probabilistic Robustness for Free? Revisiting Training via a Benchmark
Yi Zhang, Zheng Wang, Zhen Chen, Wenjie Ruan, Qing Guo, Siddartha Khastgir, Carsten Maple, Xingyu Zhao · 2025
Read Probabilistic Robustness for Free? Revisiting Training via a Benchmark by Yi Zhang, Zheng Wang, Zhen Chen, Wenjie Ruan, Qing Guo, Siddartha Khastgir, Carsten Maple, Xingyu Zhao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01724.txt.
Introduction
Yi Zhang and seven colleagues launch PRBench. It is the first shared test set for probabilistic robustness in image classifiers. Adversarial robustness asks if any tiny change can fool a model. Probabilistic robustness asks a softer, statistical question: how likely is a random change to fool it? Training methods for the second kind exist. But they were scored under mismatched rules, and rarely against strong adversarial training.
PRBench scores the common methods side by side. It checks clean accuracy, both kinds of robustness, training speed, and generalization error. A theory section covers the last. One headline result: adversarial training lifts probabilistic robustness more than expected. The set gives a scattered subfield one yardstick at last.
Catalog record
| CREATOR | Yi Zhang, Zheng Wang, Zhen Chen, Wenjie Ruan, Qing Guo, Siddartha Khastgir, Carsten Maple, Xingyu Zhao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 136 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-01724