Empowering LLMs in Task-Oriented Dialogues: A Domain-Independent Multi-Agent Framework and Fine-Tuning Strategy
Zihao Feng, Xiaoxue Wang, Bowen Wu, Weihong Zhong, Zhen Xu, Hailong Cao, Tiejun Zhao, Ying Li, Baoxun Wang · 2025
Read Empowering LLMs in Task-Oriented Dialogues: A Domain-Independent Multi-Agent Framework and Fine-Tuning Strategy by Zihao Feng, Xiaoxue Wang, Bowen Wu, Weihong Zhong, Zhen Xu, Hailong Cao, Tiejun Zhao, Ying Li, Baoxun Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14299.txt.
Introduction
Zihao Feng and co-authors present a multi-agent framework for task-oriented dialogue in a 2025 paper. Such systems help users book, order, or solve tasks through chat. Stuffing a whole workflow into one agent works for huge models, but small fine-tuned models struggle with the tangled logic, so the team split the job by role.
Their framework uses three agents: one classifies intent, one fills in the needed slots, and one writes the reply. Each part ignores domain specifics, which aids transfer to new topics. They sharpen context reading with a preference training method and add a data fix that curbs quality drops during that training. Tests on a standard dialogue data set beat all baselines, with strong zero-shot transfer.
Catalog record
| CREATOR | Zihao Feng, Xiaoxue Wang, Bowen Wu, Weihong Zhong, Zhen Xu, Hailong Cao, Tiejun Zhao, Ying Li, Baoxun Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-14299
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Empowering LLMs in Task-Oriented Dialogues: A Domain-Independent Multi-Agent Framework and Fine-Tuning Strategy Zihao Feng, Xiaoxue Wang, Bowen Wu, Weihong Zhong, Zhen Xu, Hailong Cao, Tiejun Zhao, Ying Li, Baoxun Wang Abstract Task-oriented dialogue systems based on Large Language Models (LLMs) have gained increasing attention across various industries and achieved significant results. Current approaches condense complex procedural workflows into a single agent to achieve satisfactory performance on large-scale LLMs. However, these approaches face challenges to achieve comparable performance on fine-tuned lightweight LLMs, due to their limited capabilities in handling multiple complex logic. In this work, we design a Domain-Independent Multi-Agent Framework (DIMF), which contains Intent Classification Agent, Slot Filling Agent and Response Agent. This approach simplifies the learning complexity and enhances the generalization ability by separating the tasks into domain-independent components. In this framework, we enhance the capabilities in contextual understanding using the Direct Preference Optimisation (DPO) method, and propose a simple and effective Data Distribution Adaptation (DDA) method to mitigate degradation issues during DPO training. Experiments conducted on the MultiWOZ datasets show that our proposed method achieves a better average performance among all the baselines. Extensive analysis also demonstrates that our proposed framework exhibits excellent generalizability and zero-shot capability. 1 Introduction Figure 1: Different architectures of our proposed system and other LLM-based systems. The left part is other LLM-based systems and the right is ours. The information in the orange box indicates the strategies in different sub-tasks that the agent needs to follow. Task-oriented dialogue (TOD) systems play a significant role in both academic research and industry. Peng et al. (2022) ; Xu et al. (2024) . Researchers have divided the traditional TOD systems into the following several key components Zhang et al. (2020) : 1) Natural Language Understanding (NLU) Karanikolas et al. (2023) . 2) Dialogue State Tracking (DST) Feng et al. (2023) ; Heck et al. (2023) ; Feng et al. (2025) . 3) Dialogue Policy. 4) Natural Language Generation (NLG) Li et al. (2020) . With the development of the Large Language Model (LLM), recent research has mainly focused on leveraging the strong capabilities and generalization of LLMs to solve the complex task of TOD Qin et al. (2023a) ; Algherairy and Ahmed (2024) ; Chung et al. (2023) . The LLM-based multi-agent approach has been proven to be effective in multi-domain TOD systems Gupta et al. () . Existing methodologies often attempt to condense complex procedural workflows of TOD systems into a single large-scale LLM-based agent such as GPT-4 Achiam et al. (2023) and Claude, or divide the workflow into different domains to conduct multi-agent TOD systems for lightweight LLMs. Most works have achieved satisfactory performance on large-scale LLMs Xu et al. (2024) ; Gupta et al. () . In contrast, the lightweight models, even when fine-tuned for specific tasks, struggle to attain comparable completion quality Xu et al. (2024) ; Gupta et al. () . This discrepancy contrasts sharply with their competitive performance in other NLP tasks , suggesting that the inherent complexity of TOD necessitates specialized approaches. We posit that effective modeling of multi-step procedural logic and developing targeted learning strategies are critical to bridging this performance gap. To address this challenge, we propose a Domain-Independent Multi-Agent Framework (DIMF), which contains Intent Classification Agent, Slot Filling Agent and Response Agent. Unlike the current methods, which conduct multi-agent system by different domain-specific agents, DIMF decouples the workflow into several components which are domain-independent. As illustrated in Figure 1 , both phases require contextual reasoning and policy-guided decision-making capabilities, easily conflated in monolithic agent architectures. The task separation design stems from our observation of domain relevance and challenges in slot integration from dialogue history during slot filling process. This approach guarantees that the agent considers the slot that matches the current specific domain. Furthermore, this modular decomposition facilitates the enhancement of targeted capability through reinforcement learning techniques (e.g., DPO/PPO Rafailov et al. (2023) ; Schulman et al. (2017) ), enabling specialized optimization while maintaining domain adaptability. We therefore propose a Data Distribution Adaptation (DDA) method designed to mitigate the degradation of DPO training attributable to the diversity of domain types. The experimental results indicate that the framework and training methodology significantly enhance the performance of the fine-tuned models. Additionally, it was observed that the domain-independent design exhibits a robust zero-shot capability. In conclusion, this paper offers the following contributions: • We design a novel Domain-Independent Multi-Agent Framework for TOD systems based on LLMs. Our approach separates the complex task into three sub-tasks which better leverages the generalization capabilities of LLMs. • We utilize DPO during the training process, and innovatively propose a Data Distribution Adaptation method to alleviate the DPO’s training degradation problem during the DPO training process. • Our new framework and training strategy for the TOD system have enhanced the system’s scalability and zero-shot capabilities, allowing the system to maintain good performance even on domains it has not seen before. 2 Background 2.1 Large Language Models as Agents Recently, many efforts have been made to build systems through LLMs acting as agents for planning, decision-making, and acting tasks between various specialized APIs, dialogue, or other simpler tools to perform complex tasks Liu et al. (2023) ; Liang et al. (2023) ; Deng et al. (2024) . ReAct Yao et al. (2023) method is a prompt framework that has been widely used for fine-tuning the LLMs with the ability of reasoning and action based on text. Various tasks such as logical reasoning Du et al. (2023) ; Tang et al. (2023) , societal simulations Zhou et al. (2023) , tool learning Qin et al. (2023b) ; Shen et al. (2024) have achieved significant improvement in performance using LLMs as agents. However, most research focuses on task-specific scenarios with poor scalability. The challenge of LLMs working as agents that can generalize better and adapt to different tasks needs more research. 2.2 Direct Preference Optimisation (DPO) Direct Preference Optimisation (DPO) Rafailov et al. (2024) is a popular method for learning from human-preference data, and it has been widely leveraged to improve the performance of pre-trained LLMs on downstream tasks Wang et al. (2023) ; Tunstall et al. (2023) . DPO directly uses pair-wise preference data for model optimization. In this way, we can directly train the language model through the reward learning pipeline, eliminating the need for the reinforcement learning stage. Figure 2: The main framework of our proposed method. The left part is the framework of our proposed DIMF. We train three agents to collaboratively solve users’ questions and provide responses. Each agent can fulfill different user needs through different prompts, instead of training domain-specific agents (as indicated by the agents in the left part such as "Restaurant"). The right part is the framework of our training process for each agent. We first fine-tune the model with the training set, and then leverage the validation dataset to complete the DPO process. Although the DPO method facilitates model training, experiments demonstrate that the DPO loss has flaws: Compared to learning to generate responses preferred by humans, the DPO loss function demonstrates a tendency for LLMs to readily learn to avoid generating responses that humans disprefer Feng et al. (2024) . Based on this conclusion, DPO exhibits significant