Evaluating Human Trust in LLM-Based Planners: A Preliminary Study Conference: ; Year; Location
Shenghui Chen, Yunhao Yang, Kayla Boggess, Seongkook Heo, Lu Feng, Ufuk Topcu · 2025
Read Evaluating Human Trust in LLM-Based Planners: A Preliminary Study Conference: ; Year; Location by Shenghui Chen, Yunhao Yang, Kayla Boggess, Seongkook Heo, Lu Feng, Ufuk Topcu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20284.txt.
Description
Shenghui Chen and co-authors run an early study of how much people trust AI language models that make plans, in this 2025 paper. Language models can explain their steps and revise plans, unlike classic planning software. Trust, though, decides whether people will use such systems at all.
Volunteers compared model-made plans with classic ones inside a standard planning puzzle format. Surveys measured trust, while scoring tasks measured how well people judged plan quality. Correctness drove both trust and judging success. Explanations helped people judge plans but barely moved trust. Letting the model refine its plan looked promising for trust, a lead for designers.
Catalog record
| CREATOR | Shenghui Chen, Yunhao Yang, Kayla Boggess, Seongkook Heo, Lu Feng, Ufuk Topcu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-20284