Analyzing Human Heuristics and Strategies in Everyday Decision-Making Conversations for Conversational AI Design

Sora Kang ([email protected]) , Soyun Jeon , Jinsu Eun , Kwangwon Lee Chaerin Song , Minyoung Joo , Joonhwan Lee · 2026

Read Analyzing Human Heuristics and Strategies in Everyday Decision-Making Conversations for Conversational AI Design by Sora Kang ([email protected]) , Soyun Jeon , Jinsu Eun , Kwangwon Lee Chaerin Song , Minyoung Joo , Joonhwan Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07789.txt.

Introduction

Sora Kang and six co-authors study how people actually make everyday decisions in conversation, to design conversational AI that works the way people do. Most systems reason from data, but people lean on heuristics and social moves in natural talk. The team analyzed nine hundred fifty-five real Korean conversations about food and travel decisions, coding them with a decision-making codebook.

People mostly satisfice rather than optimize, drawing on internal knowledge and conversational strategies to manage mental effort. A frequency-efficiency mismatch stood out: the commonest heuristics keep exploration flowing, while rare rule-based strategies are the ones that drive decisions to resolution when closing. The authors map how these patterns transfer to human-AI interaction and derive design lessons from them.

Catalog record

CREATORSora Kang ([email protected]) , Soyun Jeon , Jinsu Eun , Kwangwon Lee Chaerin Song , Minyoung Joo , Joonhwan Lee
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.07789

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Analyzing Human Heuristics and Strategies in Everyday Decision-Making Conversations for Conversational AI Design Sora Kang ([email protected]) , Soyun Jeon , Jinsu Eun , Kwangwon Lee Chaerin Song , Minyoung Joo , Joonhwan Lee Abstract Conversational AI increasingly supports everyday decision-making, yet most systems rely on data-centric reasoning rather than the heuristic and interactional strategies people use in natural conversation. To ground design in actual human practice, we analyze 955 real-world Korean conversations (15,476 utterances) involving food and travel decisions, applying a decision-making codebook through an LLM-assisted coding pipeline. Our findings reveal that people prioritize satisficing over optimization, relying heavily on internal knowledge and interactional strategies to manage cognitive load. Critically, we identify a frequency–efficiency mismatch: the most prevalent heuristics sustain conversational flow during exploration, whereas infrequent, rule-based strategies are highly effective at driving resolution during exploitation. By mapping how these patterns transfer across the spectrum of human-AI interaction, this work provides empirical grounding consistent with cognitive theories of decision-making and offers design implications that align AI systems with human heuristic processes. Keywords: Conversational AI; Human-AI Interaction; Decision Support Systems; Heuristics; Conversation Analysis Introduction Recent advances in large language models (LLMs) have positioned conversational AI as an increasingly capable interaction partner, not merely a tool for information retrieval. Yet most contemporary conversational systems still operate primarily as answer providers: they respond to well-formed questions, summarize relevant information, and produce recommendations given explicit constraints. This framing fits tasks with clear correctness criteria (e.g., factual queries or constrained lookups). In contrast, much of everyday life consists of decisions without a single objective “right” answer—what to eat tonight, where to travel next, or which hobby to start—where choices are shaped by personal values, affect, context, and limited time. Decision-making in such settings is classically explained through bounded rationality and satisficing (i.e., seeking an option that is “good enough” rather than globally optimal) ( 24 ; 25 ) . Under bounded resources, people rely on heuristics—fast, experience-based shortcuts—to reduce cognitive effort and reach closure. These heuristics can be adaptive and efficient, but they also introduce systematic distortions and biases. For a conversational AI meant to support everyday decision-making, this creates a central design tension: effective support should feel lightweight and conversation-friendly (as in human dialogue), while also helping users structure reasoning, reduce bias, and maintain agency. Yet we still lack clear empirical answers to a key question: How do humans actually talk their way toward everyday decisions, and what heuristics and interactional strategies structure this process? Moreover, conversational decision-making encompasses a range of participant structures. Two friends may co-decide where to eat, one person may recommend options while the other chooses, or a knowledgeable party may guide an uncertain one toward a decision. These configurations—co-decider, recommender, advisor—reflect the fact that language use in decision-making is fundamentally a coordinated activity whose structure varies with the roles, stakes, and relationships of the participants ( 4 ) . Understanding how cognitive heuristics and interactional strategies operate across these varied structures is essential not only for theories of human decision-making but also for designing conversational AI systems, which may occupy any of these roles. To address this gap, we propose a human-grounded approach that treats everyday decision-making as a conversational process rather than a one-shot recommendation problem. We analyze real human–human decision dialogues to identify recurring strategies and heuristics as they appear in conversation, and we compile these patterns into a reusable codebook. This paper investigates the following research questions: • RQ1. How are decision-making strategies and heuristics manifested and distributed in everyday human–human decision-making conversations? • RQ2. Which conversational strategies and heuristics are associated with whether a decision is ultimately reached? Our contributions are: (1) a conversation-grounded codebook of decision-making heuristics and strategies; (2) an LLM-assisted coding pipeline for large-scale analysis; and (3) an empirical characterization of how conversational strategies relate to decision outcomes, with implications for conversational AI design. Related Work Decision-Making Theories: Heuristics and Biases Human decision-making is defined by cognitive and environmental constraints, contrasting the rational agent model with Simon’s theory of bounded rationality ( 24 ) . Individuals navigate these limits through satisficing—selecting "good enough" options rather than exhaustive optimization ( 24 ; 25 ) . Under bounded resources, people rely on heuristics: fast, intuitive shortcuts that reduce cognitive effort ( 28 ) . These include judgment heuristics such as availability ( 27 ) , representativeness ( 28 ) , affect ( 26 ) , and anchoring ( 28 ) . Furthermore, choices are sensitive to framing effects and loss aversion, which skew decisions based on presentation ( 29 ; 9 ) . Decision-making is also a social process influenced by heuristics like consistency, reciprocity, and social proof ( 3 ) . For selection tasks, adaptive agents utilize choice heuristics—such as lexicographic rules or elimination by aspects—flexibly switching between them based on task complexity ( 7 ; 20 ) . While functional, these processes can result in systematic biases ( 10 ) . Conversational AI and Decision Support AI-assisted decision-making aims for complementary performance between human and machine ( 1 ; 11 ; 22 ; 30 ) . However, recommendation-centric systems often ignore the underlying reasoning process, leading to inappropriate reliance where users either over-rely on or disregard suggestions ( 11 ; 14 ) . While AI explanations are intended to foster trust, they can paradoxically increase over-reliance by reducing active cognitive engagement ( 2 ; 16 ) . Recent research thus advocates for AI as a cognitive assistant that encourages independent judgment ( 13 ; 19 ) . Systems like Extend AI and frameworks focusing on causal rather than probabilistic reasoning aim to align AI with human cognition and mitigate over-reliance ( 15 ; 21 ) . While analyses of user–chatbot interaction logs have informed such designs ( 31 ; 12 ) , these logs often reflect existing system limitations rather than natural interaction; human–human dialogues reveal richer relational cues and patterns for designing more empathic and effective agents ( 23 ) . We build on this by empirically characterizing naturalistic decision-making talk to ground future AI that aligns with human heuristics. Method This paper presents a conversation-analytic study of everyday decision-making interactions. We analyze real-world conversations to uncover the strategies individuals use in decision-making and to characterize how heuristics surface in naturalistic dialogue. Human Conversation Dataset To examine how individuals interact and address the inherent challenges of decision-making, we employed the Subject-Specific Text Data for Everyday Conversation dataset from AI-Hub ( 18 ) , a Korean national platform providing open AI resources. The dataset consists of free-form conversations in Korean, spanning 20 different subjects. For this study, we focused on two domains—Food & Drink (5,176 conversations) and Travel (5,550 conversations)—as they frequently involve collaborative decision-making tasks, such as choosing meals or selecting travel destinations. From these subsets, we filtered for conversations containing explicit decision-making sequences, excluding those lacking a clear decision goal (e.g., simple reporting of past events) or containing insufficient interactional turns. After this filtering, a set of 955 conversations (15,476 utterances) remained, which served as the basis for both codebook validation and analysis. Conversation Codebook Table 1: The Decision-Making Conversation Codebook. The framework consists of conversation-level outcomes and methods, utterance-level interaction structures, and cognitive heuristics. Category Definitions and Indicators I.

Read the complete text