FastDINOv2: Frequency Based Curriculum Learning Improves Robustness and Training Speed
Jiaqi Zhang, Juntuo Wang, Zhixin Sun, John Zou, Randall Balestriero · 2025
Read FastDINOv2: Frequency Based Curriculum Learning Improves Robustness and Training Speed by Jiaqi Zhang, Juntuo Wang, Zhixin Sun, John Zou, Randall Balestriero (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03779.txt.
Description
Jiaqi Zhang, Juntuo Wang, Zhixin Sun, John Zou, and Randall Balestriero published a 2025 paper on training a large vision model faster and more robustly. DINOv2 is a foundation model that learns from images without labels, but retraining it is very costly. That cost blocks work on private data or new kinds of images.
Their method, FastDINOv2, shows the model blurred, low-detail images first and sharper ones later, a schedule based on image frequency. A noise-based augmentation is added along the way. Training time fell by a factor of 1.6 and computing cost by 2.25, while accuracy on standard tests stayed competitive. Robustness to corrupted images matched the original model. The code is public for others to use.
Catalog record
| CREATOR | Jiaqi Zhang, Juntuo Wang, Zhixin Sun, John Zou, Randall Balestriero |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-03779