When to retrain a machine learning model
Florence Regol, Leo Schwinn, Kyle Sprague, Mark Coates, Thomas Markovich · 2025
Read When to retrain a machine learning model by Florence Regol, Leo Schwinn, Kyle Sprague, Mark Coates, Thomas Markovich (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14903.txt.
Description
Five researchers tackle a daily puzzle for teams that run machine learning systems: when should a model be retrained? Data shifts over time in ways no one can fully foresee, so a model's skill quietly fades. Retraining too late hurts results, but retraining too often wastes money. To make the call, teams often have only a few fresh examples and no clear price for being wrong.
The authors frame the choice in a strict form and build a method that forecasts how model skill will evolve. The method leans on its own uncertainty and works with a bounded score of performance. In tests on seven data sets for sorting tasks, it beat rival rules again and again. The work aims to give working teams a sound, ready-to-use policy instead of guesswork.
Catalog record
| CREATOR | Florence Regol, Leo Schwinn, Kyle Sprague, Mark Coates, Thomas Markovich |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 102 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-14903