Evaluating Human Trust in LLM-Based Planners: A Preliminary Study Conference: ; Year; Location

Shenghui Chen, Yunhao Yang, Kayla Boggess, Seongkook Heo, Lu Feng, Ufuk Topcu · 2025

Read Evaluating Human Trust in LLM-Based Planners: A Preliminary Study Conference: ; Year; Location by Shenghui Chen, Yunhao Yang, Kayla Boggess, Seongkook Heo, Lu Feng, Ufuk Topcu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20284.txt.

Description

Shenghui Chen and co-authors run an early study of how much people trust AI language models that make plans, in this 2025 paper. Language models can explain their steps and revise plans, unlike classic planning software. Trust, though, decides whether people will use such systems at all.

Volunteers compared model-made plans with classic ones inside a standard planning puzzle format. Surveys measured trust, while scoring tasks measured how well people judged plan quality. Correctness drove both trust and judging success. Explanations helped people judge plans but barely moved trust. Letting the model refine its plan looked promising for trust, a lead for designers.

Catalog record

CREATORShenghui Chen, Yunhao Yang, Kayla Boggess, Seongkook Heo, Lu Feng, Ufuk Topcu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-20284

Browse the full library · About the Tower of Babel