User-Oriented Multi-Turn Dialogue Generation with Tool Use at scale
Jungho Cho, Minbyul Jeong, Sungrae Park · 2026
Read User-Oriented Multi-Turn Dialogue Generation with Tool Use at scale by Jungho Cho, Minbyul Jeong, Sungrae Park (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08225.txt.
Introduction
Jungho Cho, Minbyul Jeong, and Sungrae Park wrote a 2026 arXiv paper on training chats for AI agents that use tools. Large reasoning models now act as agents that work on their own, which raises the call for rich chats across many turns. Data sets in use rest on fixed tool sets set in advance. Such sets can not scale to open-ended work with a user. The authors build chats with the user at the core, to meet that need at scale.
Catalog record
| CREATOR | Jungho Cho, Minbyul Jeong, Sungrae Park |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-08225
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
User-Oriented Multi-Turn Dialogue Generation with Tool Use at scale Jungho Cho, Minbyul Jeong, Sungrae Park Abstract The recent paradigm shift toward large reasoning models (LRMs) as autonomous agents has intensified the demand for sophisticated, multi-turn tool-use capabilities. Yet, existing datasets and data-generation approaches are limited by static, predefined toolsets that cannot scale to the complexity of open-ended human-agent collaboration. To address this, we initially developed a framework for automated task-oriented multi-turn dialogue generation at scale, utilizing an LRM-based simulator to dynamically generate high-value, domain-specific tools to solve specified tasks. However, we observe that a purely task-oriented design often results in "solely task-solving" trajectories, where the agent completes the objective with minimal interaction, failing to generate the high turn-count conversations seen in realistic scenarios. To bridge this gap, we shift toward a user-oriented simulation paradigm. By decoupling task generation from a dedicated user simulator that mimics human behavioral rules—such as incremental request-making and turn-by-turn feedback—we facilitate more authentic, extended multi-turn dialogues that reflect the iterative nature of real-world problem solving. Our generation pipeline operates as a versatile, plug-and-play module capable of initiating generation from any state, ensuring high scalability in producing extended tool-use data. Furthermore, by facilitating multiple task completions within a single trajectory, it yields a high-density dataset that reflects the multifaceted demands of real-world human-agent interaction. 1 Introduction Figure 1: Plug-and-Play Tool Preparation Module. A modular pipeline for dynamic tool synthesis and preprocessing, designed to initiate multi-turn data generation from any arbitrary state. The evolution of large language models (LLMs) has reached a critical inflection point, transitioning from text-generative systems into large reasoning models (LRMs) acting as autonomous agents ( 8 ; 37 ; 40 ) . This change is driven by advances in both reasoning and tool use , grounded in a core set of agentic capabilities: the high-level decision-making and planning required to decompose complex tasks; the technical precision of tool choice and argument generation; the analytical rigor of result analysis and error handling; and the foundational memory and environment awareness needed to maintain context in dynamic settings ( 30 ; 13 ; 16 ; 33 ; 31 ; 34 ) . While tool use grounds reasoning in the real world, the ultimate objective of LRMs is to orchestrate these interdependent capabilities to support extended, multi-turn interactions that reflect the dynamics of real-world human–agent collaboration. Despite the growing capabilities of LRMs, progress remains constrained by the lack of high-quality and diverse training data. Most existing datasets rely on static, predefined toolsets, which inadequately capture the open-ended and evolving nature of real-world human–agent collaboration ( 28 ; 43 ; 22 ) . Agents trained under such fixed schemas often struggle to generalize beyond seen domains or to reason over unfamiliar tool compositions. Moreover, many data-generation pipelines implicitly favor single-shot trajectories 1 1 1 We define the trajectory as a sequence of API Calls, which are related (or correlated) with tool arguments for solving tasks , in which a user poses a complex request and the agent responds with an optimal tool-use sequence in a single task. While efficient, these interactions fail to reflect the iterative, incremental, and often noisy nature of real-world human–agent collaboration. To overcome these limitations, we first developed an automated framework for large-scale task-oriented dialogue generation. Leveraging an LRM-based simulator, the framework dynamically synthesizes domain-specific tools and database schemas (e.g., SQL-style read/write operations), along with corresponding tasks and evaluation rubrics. While this successfully scaled the volume of data, we observed an efficiency trap: the simulator, acting as a perfect task-solver, tended to complete objectives with the minimum number of turns. These solely task-solving trajectories lacked the back-and-forth dialogue—clarifications, incremental requests, and feedback loops—that define realistic human interaction. To address this efficiency-driven bias, we propose a user-oriented simulation paradigm. Our approach decouples the objective (the "Task") from the interaction (the "User"). By employing a dedicated user simulator governed by human behavioral rules—such as asking for only one subtask at a time and providing turn-by-turn feedback—we force the agent to navigate extended, multi-turn dialogues. Our generation pipeline consists of three key components: (1) Dynamic Tool & Task Synthesis: Instead of relying on fixed APIs, our LRM-based generator creates unique, rubric-backed tasks grounded in synthesized database schemas, ensuring the agent learns to reason over diverse structures. (2) Plug-and-Play Scalability: The generation pipeline is modular. It can initiate a simulation from any state—whether starting from a blank slate or injecting a tool-use requirement into an ongoing conversation—making it highly versatile for data augmentation. (3) High-Density Trajectories: By allowing multiple task completions within a single conversation thread, we produce a "high-density" dataset. This reflects the multifaceted nature of real-world use cases, where a user might update a record, query a trend, and request a summary all within a single session. Empirical results on agentic benchmarks, including BFCL ( 20 ) and \tau 2 ( 3 ) , demonstrate that models trained on our data achieve consistently stronger multi-turn performance and more reliable tool usage, particularly in long-horizon and stateful domains. Moreover, consistency analysis under repeated executions shows that our models sustain correct tool-use behavior across multiple trials, rather than relying on isolated successes. Our findings highlight the importance of user-oriented interaction modeling and execution-grounded supervision for training robust and realistic agentic reasoning models. 2 Related Works Reasoning Models and Tool-use Benchmarks. Recent advancements in LRMs have catalyzed the development of benchmarks designed to evaluate autonomous agents in tool-mediated environments ( 8 ; 37 ; 28 ; 29 ; 42 ) . Early benchmarks primarily focused on single-turn tool invocation or static API selection within constrained domains ( 17 ; 23 ; 12 ) . However, as the field shifted toward more complex problem solving, datasets like StableToolBench ( 9 ) , BFCL ( 21 ) , and \tau benchmarks ( 39 ; 3 ) emerged to test the model’s ability to navigate vast API landscapes ( 14 ; 36 ; 35 ) . Figure 2: Task-Oriented Multi-Turn Conversation Generation Pipeline. An automated framework that generates tool-use trajectories focused on efficient task completion through direct simulator-based responses. Evolution of Tool-use Agents. Beyond benchmarking, the paradigm for tool-use agents has evolved from simple function-calling to sophisticated, autonomous orchestration. While early frameworks enabled LLMs to parse queries and interpret results, they often relied on fixed toolsets, which inherently limited their adaptability to open-ended tasks ( 25 ; 10 ) . To address this, recent research has explored the dynamic creation of tools, such as generating reusable tools on the fly ( 4 ) or leveraging existing code repositories through ToolMaker ( 32 ) . Furthermore, specialized training strategies have been proposed to enhance agentic capabilities, including critique-informed planning ( 6 ) , fine-tuning on selective reasoning steps ( 38 ) , and decoupling reasoning from format following (e.g., Agent-FLAN) ( 5 ) . Despite these advances, most existing approaches still struggle to maintain long-term coherence in multi-turn interactions, a gap that our user-oriented simulation framework aims to bridge. Synthetic Dialogue Generation for Agents. The scarcity of training data still requires high-quality synthetic data generation. Despite these efforts, existing data generation approaches rely on fixed, predefined trajectories and toolsets (e.g., API graphs) ( 18 ; 26 ; 2 ; 27 ) and rigid schemas