Citations and Trust in LLM Generated Answers

Yifan Ding, Matthew Facciani, Amrit Poudel, Ellen Joyce, Salvador Aguinaga, Balaji Veeramani, Sanmitra Bhattacharya, Tim Weninger · 2025

Read Citations and Trust in LLM Generated Answers by Yifan Ding, Matthew Facciani, Amrit Poudel, Ellen Joyce, Salvador Aguinaga, Balaji Veeramani, Sanmitra Bhattacharya, Tim Weninger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-01303.txt.

Description

Yifan Ding and seven co-authors report a 2025 experiment on whether citations change how much people trust answers written by a chatbot. Their framework predicts that trust rises when citations appear and falls when people check them. Volunteers read chatbot answers shown with no citations, one citation, or five citations, and the citations were either relevant or random.

Trust rose whenever citations were present, even when the citations were random and useless. Trust fell among people who actually opened and checked the citations. The findings carry a warning for AI design. Citations can make an answer look sound even when they add no real support, so systems should link trust to sources that truly back the text.

Catalog record

CREATORYifan Ding, Matthew Facciani, Amrit Poudel, Ellen Joyce, Salvador Aguinaga, Balaji Veeramani, Sanmitra Bhattacharya, Tim Weninger
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-01303

Browse the full library · About the Tower of Babel