Instance-dependent Early Stopping
Suqin Yuan, Runqi Lin, Lei Feng, Tongliang Liu · 2025
Read Instance-dependent Early Stopping by Suqin Yuan, Runqi Lin, Lei Feng, Tongliang Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-07547.txt.
Description
Yuan and co-authors propose stopping training early for each example on its own, rather than for a whole dataset at once. Standard early stopping watches a validation set and halts everything together, wasting effort on examples the model already knows. Their 2025 method judges mastery per example: when an example's loss stops changing in a steady way, it drops out of further training.
A second order check on the loss gives a consistent mastery signal, so one threshold serves all examples. Dropping mastered examples raises gradient sizes and speeds the fall of training loss, the team shows. Across benchmarks, the method cut backpropagation work by ten to fifty percent. Test accuracy and transfer performance held steady or slightly improved.
Catalog record
| CREATOR | Suqin Yuan, Runqi Lin, Lei Feng, Tongliang Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-07547