Confidence Estimation in Automatic Short Answer Grading with LLMs
Longwei Cong, Sonja Hahn, Sebastian Gombert, Leon Camus, Hendrik Drachsler, Ulf Kroehne · 2026
Read Confidence Estimation in Automatic Short Answer Grading with LLMs by Longwei Cong, Sonja Hahn, Sebastian Gombert, Leon Camus, Hendrik Drachsler, Ulf Kroehne (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-00200.txt.
Introduction
Longwei Cong and 5 co-authors study a weak point in automatic grading of short student answers by large language models: knowing when the grade may be wrong. A wrong grade that looks certain can mislead teachers. The team compares three ways to estimate a model's own confidence.
They find that model-based confidence alone does not capture the real uncertainty in grading. Their fix adds a second signal: how varied similar student answers are, found by clustering answers with alike meanings. The combined measure proved more reliable and improved selective grading, where the system grades only the answers it trusts. The work aims at safer human and AI teamwork in classroom assessment.
Catalog record
| CREATOR | Longwei Cong, Sonja Hahn, Sebastian Gombert, Leon Camus, Hendrik Drachsler, Ulf Kroehne |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.00200
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Confidence Estimation in Automatic Short Answer Grading with LLMs Longwei Cong, Sonja Hahn, Sebastian Gombert, Leon Camus, Hendrik Drachsler, Ulf Kroehne Abstract Automatic Short Answer Grading (ASAG) with generative large language models (LLMs) has recently demonstrated strong performance without task-specific fine-tuning, while also enabling the generation of synthetic feedback for educational assessment. Despite these advances, LLM-based grading remains imperfect, making reliable confidence estimates essential for safe and effective human-AI collaboration in educational decision-making. In this work, we investigate confidence estimation for ASAG with LLMs by jointly considering model-based confidence signals and dataset-derived uncertainty. We systematically compare three model-based confidence estimation strategies, namely verbalizing, latent, and consistency-based confidence estimation, and show that model-based confidence alone is insufficient to reliably capture uncertainty in ASAG. To address this limitation, we propose a hybrid confidence framework that integrates model-based confidence signals with an explicit estimate of dataset-derived aleatoric uncertainty. Aleatoric uncertainty is operationalized by clustering semantically embedded student responses and quantifying within-cluster heterogeneity. Our results demonstrate that the proposed hybrid confidence measure yields more reliable confidence estimates and improves selective grading performance compared to single-source approaches. Overall, this work advances confidence-aware LLM-based grading for human-in-the-loop assessment, supporting more trustworthy AI-assisted educational assessment systems. 1 Introduction Automatic Short Answer Grading (ASAG) refers to the task of assessing short, natural-language student responses to objective questions using computational methods [ 7 ] . By automating the evaluation of constructed responses, ASAG promises scalable assessment while preserving richer evidence of student understanding than multiple-choice formats [ 23 ] . Early work in ASAG primarily relied on traditional machine learning approaches, which require carefully engineered linguistic features and substantial amounts of annotated training data [ 25 ] . With advances in natural language processing, encoder-only pre-trained language models (PLMs) have been increasingly applied to ASAG [ 8 , 17 ] . While such models achieve strong performance after task-specific fine-tuning, their application in educational settings is often impractical due to the limited availability of annotated student responses, particularly in early stages of assessment development. More recently, generative large language models (LLMs) have been explored for ASAG due to their strong language understanding and multi-step reasoning capabilities [ 12 , 13 ] . Without task-specific fine-tuning, LLMs can achieve grading performance comparable to, or even exceeding, that of fine-tuned PLMs, while eliminating the need for labeled training data [ 9 ] . Moreover, LLMs are capable of automatically generating feedback based on their grading decisions [ 2 ] . Despite these advances, no ASAG system achieves perfect accuracy due to linguistic variability in student responses, ambiguity in scoring criteria, and inherent disagreement among human graders, which impose an upper bound on performance [ 7 ] . In practical assessment scenarios, a fundamental trade-off exists between grading accuracy and the human effort required for review [ 5 ] . Rather than fully automating grading, recent work [ 5 , 39 ] increasingly emphasizes human-in-the-loop ASAG, where automated systems assist human graders by selectively deferring uncertain responses for manual inspection. A key requirement for such human–AI collaboration is reliable confidence estimation. Existing work on confidence estimation in ASAG has largely focused on PLMs, while confidence estimation for LLMs remains insufficiently studied, despite increasing adoption in educational assessment. Moreover, existing approaches typically derive confidence solely from model-based signals, while uncertainty arising from the dataset itself remains underexplored. This limitation is particularly consequential in ASAG, where open-ended student responses are often ambiguous, underspecified, or semantically diverse [ 7 ] . Finally, confidence estimates are often used only for binary thresholding and are rarely subjected to systematic reliability analysis, limiting their interpretability and usefulness for educators. Our contributions are threefold. First, we provide a systematic study of confidence estimation for ASAG with LLMs by comparing verbalizing, latent, and consistency-based confidence signals. To the best of our knowledge, such an analysis has not been previously conducted in the context of ASAG. Second, we explicitly model uncertainty arising from the dataset itself by quantifying semantic heterogeneity, and propose a hybrid confidence measure that integrates model-based confidence with dataset-derived uncertainty via a probabilistic classifier. Third, beyond method development, we demonstrate how reliability analysis and selective prediction can be used to evaluate confidence estimates in ASAG, and show that the proposed hybrid confidence scores are better aligned with empirical grading accuracy, making them more suitable for selective grading scenarios in human-in-the-loop assessment. 2 Background 2.1 Confidence Estimation in Automatic Short Answer Grading In practical educational assessment settings, automated grading systems are commonly integrated into human-in-the-loop workflows, where automated scores serve as decision support for human graders in detecting and correcting potential grading errors [ 3 ] . Several studies have investigated selective grading frameworks that combine automated scoring with human review. Funayama et al. [ 14 ] proposed an approach in which ASAG systems share the grading workload with human raters by estimating a confidence score for each prediction. Responses with confidence below a predefined threshold are deferred to human graders, where the threshold is calibrated on a development dataset to constrain automated scoring errors. Confidence is estimated using different approaches, including model-based posterior probabilities, distance-based metrics such as Trust Score [ 21 ] , and predictive uncertainty estimates obtained from regression models. Similarly, Bexte et al. [ 5 ] employed a similarity-based classification approach for ASAG, where the similarity score underlying the classification decision is directly used as a confidence estimate. In their work, confidence thresholds are predefined based on classification performance metrics. More recently, Zehner et al. [ 39 ] introduced a semi-automatic grading framework that cascades fine-tuned PLMs and human graders. The confidence threshold determining whether a response is graded automatically or forwarded to human raters is selected by maximizing Youden’s index, which quantifies the trade-off between sensitivity and specificity of classification. While these studies demonstrate the value of confidence-based selective grading for ASAG, they primarily focus on PLMs. In contrast, confidence estimation for ASAG with LLMs remains largely unexplored. 2.2 Confidence Estimation with LLMs LLMs have demonstrated remarkable performance across a wide range of tasks and domains. However, their outputs can be unreliable due to factual errors and hallucinations [ 15 ] . Consequently, reliable confidence estimation is essential for enabling safe and effective human–AI collaboration, allowing systems to defer uncertain predictions to human experts. Broadly, existing approaches to confidence estimation for LLMs can be categorized into four classes [ 28 ] . Verbalizing-based methods explicitly prompt the model to generate both a task prediction and a self-reported confidence score [ 30 ] . In contrast, latent-based methods derive confidence from internal model signals, such as token-level probability distributions, which are aggregated using task-specific metrics [ 22 ] . Consistency-based methods estimate confidence by measuring the stability of model predictions across multiple sampled outputs, obtained by varying decoding parameters (e.g., temperature) or by perturbing the input through paraphrasing [ 36 ] . Finally, mechanistic interpretability [ 4 ] has been proposed as a direction for understanding uncertainty in LLMs, although it has not yet been widely applied in practice. Despite their methodological differences, the above approaches estimate confidence primarily from model-based signals. In ASAG tasks, however, uncertainty may also arise from the dataset itself. Such dataset-derived uncertainty (i.e., aleatoric uncertainty) is not explicitly modeled in