Beyond Holistic Scores: Automatic Trait-Based Quality Scoring of Argumentative Essays
Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver · 2026
Read Beyond Holistic Scores: Automatic Trait-Based Quality Scoring of Argumentative Essays by Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04604.txt.
Description
Grading essays with one overall score gives students little guidance. Lucile Favero and 3 co-authors study trait-based scoring of argumentative essays in a 2026 paper, where separate scores cover distinct qualities of writing.
They compare two approaches on a dataset with five trait scores. One uses small open-source language models guided by rubric-aligned examples. The other uses a supervised encoder built for long texts, with regression that respects score ordering. Modeling that ordering improved agreement with human raters across all traits, beating the language models and simpler baselines. The small models still performed competitively without fine-tuning. They also allow transparent, private, local deployment in schools.
Catalog record
| CREATOR | Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04604