Evaluating Supervised Machine Learning Models: Principles, Pitfalls, and Metric Selection

Xuanyan Liu, Ignacio Cabrera Martin, Marcello Trovati, Xiaolong Xu, Nikolaos Polatidis · 2026

Read Evaluating Supervised Machine Learning Models: Principles, Pitfalls, and Metric Selection by Xuanyan Liu, Ignacio Cabrera Martin, Marcello Trovati, Xiaolong Xu, Nikolaos Polatidis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13882.txt.

Description

Liu and colleagues argue that judging supervised learning models by a few headline scores misleads. Through controlled trials on varied benchmark data, they show how dataset quirks, validation design, and class imbalance can distort results. Uneven error costs and metric choice add further traps, like the accuracy paradox and data leakage. Their guide ties metric and validation choice to the job the model must actually do.

Catalog record

CREATORXuanyan Liu, Ignacio Cabrera Martin, Marcello Trovati, Xiaolong Xu, Nikolaos Polatidis
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61300
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.13882

Browse the full library · About the Tower of Babel