Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistencies Conference: CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan CHI Conference on Human Factors in Computing Systems (CHI ’25), April 26-May 1, 2025

Sunnie S. Y. Kim, Jennifer Wortman Vaughan, Q. Vera Liao, Tania Lombrozo, Olga Russakovsky · 2025

Read Fostering Appropriate Reliance on Large Language Models: The Role of Explanations, Sources, and Inconsistencies Conference: CHI Conference on Human Factors in Computing Systems; April 26-May 1, 2025; Yokohama, Japan CHI Conference on Human Factors in Computing Systems (CHI ’25), April 26-May 1, 2025 by Sunnie S. Y. Kim, Jennifer Wortman Vaughan, Q. Vera Liao, Tania Lombrozo, Olga Russakovsky (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08554.txt.

Description

Sunnie Kim and four co-authors study when people should trust answers from large language models. Their paper, from two thousand twenty-five, starts from a plain risk. These models can sound smooth and sure while being wrong. Users may then lean on false answers. The team asks which parts of a reply shape that trust.

A think-aloud study first flagged three such parts: explanations, clashes within them, and sources. A large preregistered experiment with three hundred eight people then tested each part alone. Explanations raised trust in both right and wrong answers. Sources cut trust in wrong answers while keeping trust in right ones. Clashes inside an explanation also made users more wary. The findings point to design choices that keep reliance in line with accuracy.

Catalog record

CREATORSunnie S. Y. Kim, Jennifer Wortman Vaughan, Q. Vera Liao, Tania Lombrozo, Olga Russakovsky
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE126 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-08554

Browse the full library · About the Tower of Babel