A thorough benchmark of automatic text classification From traditional approaches to large language models Conference: Washington Cunha et al.; March, 2025; Brazil

Washington Cunha, Leonardo Rocha, Marcos André Gonçalves · 2025

Read A thorough benchmark of automatic text classification From traditional approaches to large language models Conference: Washington Cunha et al.; March, 2025; Brazil by Washington Cunha, Leonardo Rocha, Marcos André Gonçalves (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-01930.txt.

Description

Cunha, Rocha, and Goncalves benchmark automatic text classification from traditional methods to large language models, in a paper from twenty twenty-five. Recent transformer models improved accuracy, but cost-benefit versus classic methods was unmeasured. Twelve solutions, including five open large models, face a unified comparison. Twenty-two data sets cover sentiment and topic classification tasks.

Large models beat traditional methods and small models on effectiveness clearly. Gains average several points over small models and far more over classics. Fine-tuning costs are immense, hundreds of times slower than traditional training. Small models like RoBERTa offer near-optimal effectiveness-efficiency balance. Recommendations split by budget, with classics for constrained settings and large models for peak accuracy.

Catalog record

CREATORWashington Cunha, Leonardo Rocha, Marcos André Gonçalves
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-01930

Browse the full library · About the Tower of Babel