Leveraging AI Graders for Missing Score Imputation to Achieve Accurate Ability Estimation in Constructed-Response Tests
Masaki Uto, Yuma Ito · 2025
Read Leveraging AI Graders for Missing Score Imputation to Achieve Accurate Ability Estimation in Constructed-Response Tests by Masaki Uto, Yuma Ito (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20119.txt.
Description
Masaki Uto and Yuma Ito use AI graders to fill missing scores and sharpen ability estimates in open-response tests. Essay and short-answer tests measure deep skills well. Full human grading of every answer is slow and costly.
Item response theory can estimate ability from partial grading. Its accuracy falls as the missing share of scores grows. Past filling methods struggle with sparse or mixed data. The new method lets automated graders supply the missing scores. Those scores then support fuller ability estimation per learner. The pair test the method against prior filling approaches. Their aim is accurate ranking at lower grading cost. The work suits large courses and national testing programs.
Catalog record
| CREATOR | Masaki Uto, Yuma Ito |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-20119