Do ImageNet-trained models learn shortcuts? The impact of frequency shortcuts on generalization
Shunxin Wang, Raymond Veldhuis, Nicola Strisciuglio · 2025
Read Do ImageNet-trained models learn shortcuts? The impact of frequency shortcuts on generalization by Shunxin Wang, Raymond Veldhuis, Nicola Strisciuglio (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03519.txt.
Description
Shunxin Wang, Raymond Veldhuis, and Nicola Strisciuglio present a machine learning paper, published in 2025, on whether image classifiers secretly lean on texture like frequency patterns. Such frequency shortcuts were known from small datasets, but spotting them in giant models was too expensive to attempt. The authors devise the first practical method to audit for them at ImageNet scale.
Both classic convolutional networks and transformers, they find, do learn frequency shortcuts. Those shortcuts flatter test scores on distorted sets that keep texture, yet they drag down performance when images change style, as in sketches and renditions. The authors warn that popular robustness tests can overrate models by leaving the shortcut intact, and propose accounting for it in future benchmarks.
Catalog record
| CREATOR | Shunxin Wang, Raymond Veldhuis, Nicola Strisciuglio |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-03519