Beyond Task-Oriented and Chitchat Dialogues: Proactive and Transition-Aware Conversational Agents
Yejin Yoon, Yuri Son, Namyoung So, Minseo Kim, [0.5em] Minsoo Cho, Chanhee Park, Seungshin Lee, Taeuk Kim · 2025
Read Beyond Task-Oriented and Chitchat Dialogues: Proactive and Transition-Aware Conversational Agents by Yejin Yoon, Yuri Son, Namyoung So, Minseo Kim, [0.5em] Minsoo Cho, Chanhee Park, Seungshin Lee, Taeuk Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08835.txt.
Introduction
Yejin Yoon and seven co-authors build conversational agents that can slide between doing tasks and making small talk, the way people actually chat. Assistants are usually trained for one mode or the other, yet real conversations switch modes constantly, driven by either side.
Their dataset, TACT, packs structurally varied dialogues where task talk and chitchat interweave and transitions flow both ways. Two new metrics, Switch and Recovery, grade how well an agent starts a mode change and how gracefully it returns. Models trained on TACT beat baselines at intent detection and transition handling. A round of preference optimization pushes joint mode-intent accuracy to about seventy-six percent, and human judges preferred the tuned model over GPT-4o seventy percent of the time.
Catalog record
| CREATOR | Yejin Yoon, Yuri Son, Namyoung So, Minseo Kim, [0.5em] Minsoo Cho, Chanhee Park, Seungshin Lee, Taeuk Kim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08835
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Task-Oriented and Chitchat Dialogues: Proactive and Transition-Aware Conversational Agents Yejin Yoon, Yuri Son, Namyoung So, Minseo Kim, [0.5em] Minsoo Cho, Chanhee Park, Seungshin Lee, Taeuk Kim Abstract Conversational agents have traditionally been developed for either task-oriented dialogue (TOD) or open-ended chitchat, with limited progress in unifying the two. Yet, real-world conversations naturally involve fluid transitions between these modes. To address this gap, we introduce TACT ( T OD- A nd- C hitchat T ransition), a dataset designed for transition-aware dialogue modeling that incorporates structurally diverse and integrated mode flows. TACT supports both user- and agent-driven mode switches, enabling robust modeling of complex conversational dynamics. To evaluate an agent’s ability to initiate and recover from mode transitions, we propose two new metrics—Switch and Recovery. Models trained on TACT outperform baselines in both intent detection and mode transition handling. Moreover, applying Direct Preference Optimization (DPO) to TACT-trained models yields additional gains, achieving 75.74% joint mode-intent accuracy and a 70.1% win rate against GPT-4o in human evaluation. These results demonstrate that pairing structurally diverse data with DPO enhances response quality and transition control, paving the way for more proactive and transition-aware conversational agents. 1 Introduction Conversational agents are generally classified into two types: task-oriented dialogue (TOD) systems and chitchat models for open-domain social interaction. TOD systems 12 follow predefined workflows to accomplish user goals, while chitchat models 33 generate contextually appropriate responses. Figure 1: Comparison of dialogue flows across MultiWOZ, FusedChat, and TACT. MultiWOZ contains only task-oriented dialogues (TODs) with no mode transitions, whereas FusedChat allows a single transition between TOD and chitchat. In contrast, TACT supports multiple mode transitions (2+), enabling training on complex dialogues with diverse switching patterns. With the aid of large language models (LLMs), research bridging the two traditionally independent paradigms has gained momentum 26 . However, current efforts overlook a core challenge: most dialogue systems remain predominantly reactive , focusing on responding to user inputs rather than proactively coordinating dialogue flows 35 ; 3 . In real-world conversations, users frequently shift between task-oriented dialogue (TOD) and chitchat within a single session, as empirically observed in deployed systems ( 25 ) . 1 1 1 For example, during a conversation with a ticket-booking agent, a user might share past travel experiences. Ideally, the agent should respond appropriately to the digression, then autonomously return to the booking task when appropriate to fulfill its objective. See Figure 2 for a similar case study. To manage these dynamic transitions, agents must predict mode shifts, take initiative, and maintain coherent multi-turn interactions. This requires two key abilities: (1) transition-awareness , for detecting and adapting to mode changes, (2) proactivity , to plan ahead and guide the conversation flow when appropriate—both of which are essential yet underexplored 35 ; 1 . In this work, we present a framework for building proactive and transition-aware conversational agents, grounded in our novel TACT 2 2 2 Available at https://github.com/HYU-NLP/TACT . ( T OD- A nd- C hitchat T ransition) dataset. As illustrated in Figure 1 , TACT features complex dialogue sessions in which task-oriented and chitchat modes frequently alternate. In contrast to prior mode-switching datasets ( 6 ; 36 ; 28 ) , which lack structural diversity (see Table 1 3 3 3 We treat InterfereChat solely as T(OD), as chitchat utterances always coexist with TOD turns. We also re-define the intent space of SLURP to eliminate overlaps between intents. We refer readers to Table 8 for more details. ), TACT provides richer interactions that better support the training of agents to detect and manage mode shifts with both transition-awareness and proactivity. For instance, Figure 2 showcases a scenario in which only the TACT-based agent successfully returns to the original task after an interruption, whereas other models fail to recover and remain off track. Furthermore, we define metrics to quantify how often agents attempt to switch or recover dialogue modes, and whether those transitions succeed based on user responses. Compared to previous datasets, agents trained on TACT consistently handle flow switching and recovery more effectively, while maintaining strong performance on standard TOD and chitchat tasks. Beyond structural coverage, we further adopt Direct Preference Optimization (DPO; 22 ) to align model outputs with human preferences, which significantly enhances response quality and transition naturalness. These results suggest the potential to develop more autonomous and predictive conversational agents, surpassing the current standard where mere response accuracy is considered sufficient. 2 Related Work Dataset SalesBot2.0 FusedChat InterfereChat TACT Seed SalesBot1.0 MultiWOZ2.4 FusedChat MultiWOZ2.2 SLURP # Intents 6 11 11 11 50* # Dialog 5,453 10,436 4,475 7,199 9,936 # Avg. Turn 7.71 18.36 13.58 15.04 16.42 # Avg. Switch 0.96 1 0* 1.93 2.06 # Avg. Recov. - 0 0* 0.93 1.07 # Uniq. Flow 2 2 1 11 12 Flow Types CT TC, CT T* TCT, CTC, TCTCT, etc. Table 1: Statistics of existing datasets and the newly proposed TACT variants. Asterisks (*) indicate factors affected by the pre-processing performed in this work. Recov. : recovery. # Uniq. Flow : the number of unique dialogue mode transition patterns. Datasets for dialogue mode switching Previous efforts to unify TOD and chitchat have largely relied on augmenting existing TOD corpora. FusedChat 36 and InterfereChat 28 inject chitchat turns into TOD, typically at fixed points or as single exchanges, hereby adhering to a TOD-centric perspective. Such simple rule-based modification restricts TOD-chitchat variations, rendering these resources unsuitable for modeling dynamic dialogue transitions. To overcome this shortcoming and support rich transitions, we construct two TACT variants based on SLURP 4 and MultiWOZ 2.2 37 , featuring diverse intents and interwoven mode switches. Figure 2: A scenario demonstrating that only Agent- \text{Trained}_{\text{TACT}} exhibits transition-awareness and proactivity by successfully returning to the task after a chitchat. Note that all other baselines fail to recover the original context. Methods for dialogue mode switching While prior research, e.g., SimpleTOD 12 and SalesAgent 6 , have made progress in unifying TOD and chitchat, these methods fall short in managing fluent mode control across multi-turn interactions. Recent work has extended these efforts by integrating TOD and chitchat systems (Accentor; 29 ) or employing function calling 27 ; 18 for accurate intent tracking. However, a critical aspect remains underexplored: the ability to recover and re-engage with relevant dialogue history at appropriate turns. Programmable control Prior work on controllable dialogue frameworks 24 enables rule-driven flow control, effective when conversation graphs are known in advance. However, while these systems achieve tight control over dialogue flows—akin to classic pipelines 5 ; 19 —they are inherently rigid and costly to adapt to new scenarios. In contrast, we address more challenging and practical settings where dialogues shift dynamically between chitchat and tasks without rigid scripts. To this end, we frame transition handling as a learning problem and construct TACT to capture such phenomena without predefined flows. Building on this, we propose a unified framework that fine-tunes LLMs with TACT for proactive transition and flow control, while incorporating response-level preferences through DPO. 3 Dataset Construction: TACT In this section, we design the TACT ( T OD- A nd- C hitchat T ransition) dataset to support agents that manage both TOD and chitchat, through coherent multi-turn dialogues. Unlike prior datasets, it regards mode transitions as recoverable and context-sensitive,