Beyond Holistic Scores: Automatic Trait-Based Quality Scoring of Argumentative Essays

Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver · 2026

Read Beyond Holistic Scores: Automatic Trait-Based Quality Scoring of Argumentative Essays by Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04604.txt.

Description

Grading essays with one overall score gives students little guidance. Lucile Favero and 3 co-authors study trait-based scoring of argumentative essays in a 2026 paper, where separate scores cover distinct qualities of writing.

They compare two approaches on a dataset with five trait scores. One uses small open-source language models guided by rubric-aligned examples. The other uses a supervised encoder built for long texts, with regression that respects score ordering. Modeling that ordering improved agreement with human raters across all traits, beating the language models and simpler baselines. The small models still performed competitively without fine-tuning. They also allow transparent, private, local deployment in schools.

Catalog record

CREATORLucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04604

Browse the full library · About the Tower of Babel