A thorough benchmark of automatic text classification From traditional approaches to large language models Conference: Washington Cunha et al.; March, 2025; Brazil
Washington Cunha, Leonardo Rocha, Marcos André Gonçalves · 2025
Read A thorough benchmark of automatic text classification From traditional approaches to large language models Conference: Washington Cunha et al.; March, 2025; Brazil by Washington Cunha, Leonardo Rocha, Marcos André Gonçalves (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-01930.txt.
Description
Cunha, Rocha, and Goncalves benchmark automatic text classification from traditional methods to large language models, in a paper from twenty twenty-five. Recent transformer models improved accuracy, but cost-benefit versus classic methods was unmeasured. Twelve solutions, including five open large models, face a unified comparison. Twenty-two data sets cover sentiment and topic classification tasks.
Large models beat traditional methods and small models on effectiveness clearly. Gains average several points over small models and far more over classics. Fine-tuning costs are immense, hundreds of times slower than traditional training. Small models like RoBERTa offer near-optimal effectiveness-efficiency balance. Recommendations split by budget, with classics for constrained settings and large models for peak accuracy.
Catalog record
| CREATOR | Washington Cunha, Leonardo Rocha, Marcos André Gonçalves |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-01930