Evalet : Evaluating Large Language Models by Fragmenting Outputs into Functions DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Interact

Tae Soo Kim, Heechan Lee, Yoonjoo Lee, Joseph Seering, Juho Kim · 2025

Read Evalet : Evaluating Large Language Models by Fragmenting Outputs into Functions DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Interact by Tae Soo Kim, Heechan Lee, Yoonjoo Lee, Joseph Seering, Juho Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-11206.txt.

Description

Tae Soo Kim and four co-authors address a trust problem in this 2025 human-computer interaction paper. Researchers often ask large language models to grade AI outputs. The single score that comes back hides key details. Nobody can see which parts of the output drove the grade.

Their approach is called functional fragmentation. It cuts each output into key fragments. Each fragment gets a label for the job it does. The labels relate to the grading criteria. A system named Evalet displays the fragments across many outputs. Users can inspect, rate, and compare judgments there. Ten practitioners joined a study of the system. They spotted nearly half again as many grading mistakes. That helped them calibrate trust in the automated scores.

Catalog record

CREATORTae Soo Kim, Heechan Lee, Yoonjoo Lee, Joseph Seering, Juho Kim
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE118 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-11206

Browse the full library · About the Tower of Babel