Breakdowns in Conversational AI: Interactional Failures in Emotionally and Ethically Sensitive Contexts Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3791186 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing Empirical studies in HCI

Jiawen Deng, Wentao Zhang, Ziyun Jiao, Fuji Ren · 2026

Read Breakdowns in Conversational AI: Interactional Failures in Emotionally and Ethically Sensitive Contexts Conference: Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems; April 13–17, 2026; Barcelona, Spain Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI ’26), April 13–17, 2026, Barcelona, Spain DOI: 10.1145/3772318.3791186 ISBN: 979-8-4007-2278-3/2026/04 CCS: Human-centered computing Empirical studies in HCI by Jiawen Deng, Wentao Zhang, Ziyun Jiao, Fuji Ren (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02713.txt.

Description

Deng and three colleagues probe how chatbots break down in chats that are charged with feeling and fraught with ethics. Prior work leans on static safety checks, missing how alignment unfolds over turns. With a simulator that plays users with set personas and staged emotional pacing, they find breakdowns that worsen as feelings escalate. Empathy at times overrides duty, and ethical guidance fails. They sort the patterns into a taxonomy with design lessons.

Catalog record

CREATORJiawen Deng, Wentao Zhang, Ziyun Jiao, Fuji Ren
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE131084
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.02713

Browse the full library · About the Tower of Babel