Leveraging AI Graders for Missing Score Imputation to Achieve Accurate Ability Estimation in Constructed-Response Tests

Masaki Uto, Yuma Ito · 2025

Read Leveraging AI Graders for Missing Score Imputation to Achieve Accurate Ability Estimation in Constructed-Response Tests by Masaki Uto, Yuma Ito (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20119.txt.

Description

Masaki Uto and Yuma Ito use AI graders to fill missing scores and sharpen ability estimates in open-response tests. Essay and short-answer tests measure deep skills well. Full human grading of every answer is slow and costly.

Item response theory can estimate ability from partial grading. Its accuracy falls as the missing share of scores grows. Past filling methods struggle with sparse or mixed data. The new method lets automated graders supply the missing scores. Those scores then support fuller ability estimation per learner. The pair test the method against prior filling approaches. Their aim is accurate ranking at lower grading cost. The work suits large courses and national testing programs.

Catalog record

CREATORMasaki Uto, Yuma Ito
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-20119

Browse the full library · About the Tower of Babel