Comparing Classifiers: A Case Study Using PyCM

Sadra Sabouri, Alireza Zolanvari & Sepand Haghighi · 2026

Read Comparing Classifiers: A Case Study Using PyCM by Sadra Sabouri, Alireza Zolanvari & Sepand Haghighi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-13482.txt.

Description

Picking a classifier is easy to get wrong when only one score is reported, since the choice of metric can flip which model looks best. This tutorial paper walks through the PyCM library for deep evaluation of multi-class classifiers, using two case scenarios to show how metric choice reshapes interpretation. A multi-dimensional view surfaces small but important differences that single scores hide.

Standard metrics, the authors warn, may miss subtle trade-offs between models, and a robust, comprehensive evaluation framework is essential for a defensible choice. The tutorial style makes the material accessible to practitioners who need to compare models rather than merely rank them by accuracy. Sadra Sabouri leads the work with two co-authors.

Catalog record

CREATORSadra Sabouri, Alireza Zolanvari & Sepand Haghighi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-13482

Browse the full library · About the Tower of Babel