Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistencies Conference: CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan CHI Conference on Human Factors in Computing Systems (CHI ’25), April 26-May 1, 2025
Sunnie S. Y. Kim, Jennifer Wortman Vaughan, Q. Vera Liao, Tania Lombrozo, Olga Russakovsky · 2025
Read Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistencies Conference: CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan CHI Conference on Human Factors in Computing Systems (CHI ’25), April 26-May 1, 2025 by Sunnie S. Y. Kim, Jennifer Wortman Vaughan, Q. Vera Liao, Tania Lombrozo, Olga Russakovsky (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08554.txt.
Description
Sunnie Kim and four co-authors study when people should trust answers from large language models. Their paper, from two thousand twenty-five, starts from a plain risk. These models can sound smooth and sure while being wrong. Users may then lean on false answers. The team asks which parts of a reply shape that trust.
A think-aloud study first flagged three such parts: explanations, clashes within them, and sources. A large preregistered experiment with three hundred eight people then tested each part alone. Explanations raised trust in both right and wrong answers. Sources cut trust in wrong answers while keeping trust in right ones. Clashes inside an explanation also made users more wary. The findings point to design choices that keep reliance in line with accuracy.
Catalog record
| CREATOR | Sunnie S. Y. Kim, Jennifer Wortman Vaughan, Q. Vera Liao, Tania Lombrozo, Olga Russakovsky |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 126 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-08554