Do ImageNet-trained models learn shortcuts? The impact of frequency shortcuts on generalization

Shunxin Wang, Raymond Veldhuis, Nicola Strisciuglio · 2025

Read Do ImageNet-trained models learn shortcuts? The impact of frequency shortcuts on generalization by Shunxin Wang, Raymond Veldhuis, Nicola Strisciuglio (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03519.txt.

Description

Shunxin Wang, Raymond Veldhuis, and Nicola Strisciuglio present a machine learning paper, published in 2025, on whether image classifiers secretly lean on texture like frequency patterns. Such frequency shortcuts were known from small datasets, but spotting them in giant models was too expensive to attempt. The authors devise the first practical method to audit for them at ImageNet scale.

Both classic convolutional networks and transformers, they find, do learn frequency shortcuts. Those shortcuts flatter test scores on distorted sets that keep texture, yet they drag down performance when images change style, as in sketches and renditions. The authors warn that popular robustness tests can overrate models by leaving the shortcut intact, and propose accounting for it in future benchmarks.

Catalog record

CREATORShunxin Wang, Raymond Veldhuis, Nicola Strisciuglio
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-03519

Browse the full library · About the Tower of Babel