Evalet : Evaluating Large Language Models by Fragmenting Outputs into Functions DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Interact
Tae Soo Kim, Heechan Lee, Yoonjoo Lee, Joseph Seering, Juho Kim · 2025
Read Evalet : Evaluating Large Language Models by Fragmenting Outputs into Functions DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing Interact by Tae Soo Kim, Heechan Lee, Yoonjoo Lee, Joseph Seering, Juho Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-11206.txt.
Description
Tae Soo Kim and four co-authors address a trust problem in this 2025 human-computer interaction paper. Researchers often ask large language models to grade AI outputs. The single score that comes back hides key details. Nobody can see which parts of the output drove the grade.
Their approach is called functional fragmentation. It cuts each output into key fragments. Each fragment gets a label for the job it does. The labels relate to the grading criteria. A system named Evalet displays the fragments across many outputs. Users can inspect, rate, and compare judgments there. Ten practitioners joined a study of the system. They spotted nearly half again as many grading mistakes. That helped them calibrate trust in the automated scores.
Catalog record
| CREATOR | Tae Soo Kim, Heechan Lee, Yoonjoo Lee, Joseph Seering, Juho Kim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 118 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-11206