When to retrain a machine learning model

Florence Regol, Leo Schwinn, Kyle Sprague, Mark Coates, Thomas Markovich · 2025

Read When to retrain a machine learning model by Florence Regol, Leo Schwinn, Kyle Sprague, Mark Coates, Thomas Markovich (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14903.txt.

Description

Five researchers tackle a daily puzzle for teams that run machine learning systems: when should a model be retrained? Data shifts over time in ways no one can fully foresee, so a model's skill quietly fades. Retraining too late hurts results, but retraining too often wastes money. To make the call, teams often have only a few fresh examples and no clear price for being wrong.

The authors frame the choice in a strict form and build a method that forecasts how model skill will evolve. The method leans on its own uncertainty and works with a bounded score of performance. In tests on seven data sets for sorting tasks, it beat rival rules again and again. The work aims to give working teams a sound, ready-to-use policy instead of guesswork.

Catalog record

CREATORFlorence Regol, Leo Schwinn, Kyle Sprague, Mark Coates, Thomas Markovich
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE102 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-14903

Browse the full library · About the Tower of Babel