FastDINOv2: Frequency Based Curriculum Learning Improves Robustness and Training Speed

Jiaqi Zhang, Juntuo Wang, Zhixin Sun, John Zou, Randall Balestriero · 2025

Read FastDINOv2: Frequency Based Curriculum Learning Improves Robustness and Training Speed by Jiaqi Zhang, Juntuo Wang, Zhixin Sun, John Zou, Randall Balestriero (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03779.txt.

Description

Jiaqi Zhang, Juntuo Wang, Zhixin Sun, John Zou, and Randall Balestriero published a 2025 paper on training a large vision model faster and more robustly. DINOv2 is a foundation model that learns from images without labels, but retraining it is very costly. That cost blocks work on private data or new kinds of images.

Their method, FastDINOv2, shows the model blurred, low-detail images first and sharper ones later, a schedule based on image frequency. A noise-based augmentation is added along the way. Training time fell by a factor of 1.6 and computing cost by 2.25, while accuracy on standard tests stayed competitive. Robustness to corrupted images matched the original model. The code is public for others to use.

Catalog record

CREATORJiaqi Zhang, Juntuo Wang, Zhixin Sun, John Zou, Randall Balestriero
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-03779

Browse the full library · About the Tower of Babel