ReSpAct: Harmonizing Reasoning, Speaking, and Acting Towards Building Large Language Model-Based Conversational AI Agents
Vardhan Dongre, Xiaocheng Yang, Emre Can Acikgoz, Suvodip Dey, Gokhan Tur, Dilek Hakkani-Tür University of Illinois Urbana-Champaign {vdongre2,xy61,cacikgoz2,sdey,gokhan,dilek}@illinois.edu · 2024
Read ReSpAct: Harmonizing Reasoning, Speaking, and Acting Towards Building Large Language Model-Based Conversational AI Agents by Vardhan Dongre, Xiaocheng Yang, Emre Can Acikgoz, Suvodip Dey, Gokhan Tur, Dilek Hakkani-Tür University of Illinois Urbana-Champaign {vdongre2,xy61,cacikgoz2,sdey,gokhan,dilek}@illinois.edu (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00927.txt.
Description
A 2024 arXiv research paper by Vardhan Dongre, Xiaocheng Yang, Emre Can Acikgoz, Suvodip Dey, Gokhan Tur, Dilek Hakkani-Tür University of Illinois Urbana-Champaign {vdongre2,xy61,cacikgoz2,sdey,gokhan,dilek}@illinois.edu. Large language model (LLM)- based agents have been increasingly used to interact with external environments (e.g., games, APIs etc.) and solve tasks. However, current frameworks do not enable these agents to work with users and interact with them to align on the details of their tasks and reach user-defined goals, instead, in ambiguous situations these agents may make decisions based on assumptions.
Catalog record
| CREATOR | Vardhan Dongre, Xiaocheng Yang, Emre Can Acikgoz, Suvodip Dey, Gokhan Tur, Dilek Hakkani-Tür University of Illinois Urbana-Champaign {vdongre2,xy61,cacikgoz2,sdey,gokhan,dilek}@illinois.edu |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 79 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-00927
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ReSpAct: Harmonizing Reasoning, Speaking, and Acting Towards Building Large Language Model-Based Conversational AI Agents Vardhan Dongre, Xiaocheng Yang, Emre Can Acikgoz, Suvodip Dey, Gokhan Tur, Dilek Hakkani-Tür University of Illinois Urbana-Champaign {vdongre2,xy61,cacikgoz2,sdey,gokhan,dilek}@illinois.edu Abstract Large language model (LLM)- based agents have been increasingly used to interact with external environments (e.g., games, APIs etc.) and solve tasks. However, current frameworks do not enable these agents to work with users and interact with them to align on the details of their tasks and reach user-defined goals, instead, in ambiguous situations these agents may make decisions based on assumptions. This work introduces ReSpAct (Reason, Speak, and Act), a novel framework that synergistically combines the essential skills for building task-oriented "conversational" agents. ReSpAct addresses this need for agents, expanding on the ReAct approach. ReSpAct framework enables agents to interpret user instructions, reason about complex tasks, execute appropriate actions, and engage in dynamic dialogue to seek guidance, clarify ambiguities, understand user preferences, resolve problems, and use the intermediate feedback and responses of users to update their plans. We evaluated ReSpAct with GPT-4 in environments supporting user interaction, such as task-oriented dialogue (MultiWOZ) and interactive decision-making (Alfworld, WebShop), ReSpAct is flexible enough to incorporate dynamic user feedback and addresses prevalent issues like error propagation and agents getting stuck in reasoning loops. This results in more interpretable, human-like task-solving trajectories than baselines relying solely on reasoning traces. In two interactive decision-making benchmarks, AlfWorld and WebShop, ReSpAct outperforms strong reasoning-only method ReAct by an absolute success rate of 6% and 4%, respectively. In the task-oriented dialogue benchmark MultiWOZ, ReSpAct improved Inform and Success scores by 5.5% and 3%, respectively. Figure 1: ReSpAct is a framework for task-oriented conversational agents that allows agents to ask questions, request feedback, and adapt their strategies based on user input. Figure 2: Comparison of (a) ReAct and (b) ReSpAct to solve a game in AlfWorld Shridhar et al. 2020b . We show only the task-solving trajectories generated by the model (Act, Thought and Speech) and the environment (Obs). 1 Introduction Instruction-following is a fundamental capability for intelligent agents operating in real-world environments. Recent works such as Wei et al. 2022 ; Huang et al. 2022 ; Yao et al. 2022b ; Shinn et al. 2024 have focused primarily on building agents that can follow individual instructions without considering the importance of feedback and interaction. In realistic settings, instruction-following often involves a back-and-forth exchange between the agent and the user to reduce uncertainties, correct mistakes, and handle exceptions. Consider a scenario where a user instructs an embodied agent: "Go to the kitchen and bring me the pan." If the agent encounters multiple pans in the kitchen, it may need to seek clarification from the user about which specific pan to bring. Additionally, if the agent accidentally brings a wrong pan, immediate feedback from the user can help the agent correct its mistake and complete the task successfully. Without the ability to engage in a dialogue and incorporate user feedback, the interactive agents would act based on assumptions, wasting time and resources while searching for the wrong objects in the wrong places or performing actions that do not satisfy user needs and preferences. This method of operating without communication is not intuitive for agents. For instance, if a user requests, "Arrange a trip to Hawaii," they likely don’t expect the agent to book hotels, flights, and rental cars for random dates without confirming the details first. Existing reasoning and decision-making approaches for language agents augment the agent’s action space with a language model, allowing the agent to generate free-form thoughts in natural language that help contextualize and reason about the task at hand. By alternating between task-solving actions and language thoughts, these agents can perform multi-step reasoning and compose useful information for solving complex tasks. However, such frameworks do not explicitly incorporate user interaction and feedback into the agent’s reasoning process. In real-world scenarios, engagement with users can provide valuable information, clarification, and guidance that can significantly improve an agent’s task-solving capabilities. In this paper, we propose ReSpAct , a framework for task-oriented conversational agents that allows the agent to actively engage with users through dialogue actions. By introducing a new action space for user interaction, the agent can ask clarifying questions, request feedback, and incorporate user responses into its evolving context. This human-in-the-loop approach enables the agent to leverage user insights, adapt to user preferences, and refine its task-solving strategy based on user input. The ReSpAct framework, as shown in Fig. 1 , is a critical step towards moving from agents to "conversational" agents, which can proactively solicit information from the user, give feedback or take any follow-up directions. Figure 2 shows an example from AlfWorld setting, contrasting ReAct with ReSpAct interactions. In the second turn, the agent cleverly asks the user the possible location of a cloth, making the task easier for itself. ReSpAct framework aims to enable such an experience with LLMs, expanding on the ReAct framework. This would result in a more controllable dialogue experience instead of letting the agent struggle to handle all cases by itself without any help. Recent work on the developer side, such as LangGraph 1 1 1 https://www.langchain.com/langgraph attempts to remedy this problem by building a manually crafted dialogue flow. In contrast, the ReSpAct approach allows the model to decide on when to "speak" based on its reasoning. Our key contributions are as follows: • We introduce the ReSpAct framework enabling interactive agents with LLMs, expanding on the ReAct approach. • We perform experiments showing the value of "conversations" in goal completion for task-oriented Conversational AI using multiple datasets. • We perform ablation studies discussing the extent of conversations to optimize task success without annoying the users. 2 Related Work 2.1 Language Models and Reasoning Logical reasoning often involves breaking down complex inputs into a series of intermediary steps, guiding the model toward a final goal or answer step by step, as demonstrated by Wei et al. 2022 and its several different variants Kojima et al. 2022 ; Madaan and Yazdanbakhsh 2022 ; Wang et al. 2022 . However, these methods often suffer from error propagation due to compound errors as the sequence length increases Guo et al. 2018 ; Chen et al. 2022 , where mistakes made in earlier steps accumulate, leading to greater inaccuracies in later stages. Approaches such as Creswell et al. 2022 , and Creswell and Shanahan 2022 propose sophisticated ways to break down reasoning process, Madaan et al. 2024 ; Shinn et al. 2024 use an iterative approach to refine the model’s reasoning. However, these methods overlook the crucial role of human feedback. ReSpAct allows the agent to engage in dialogue with the user to seek assistance, feedback, and guidance, preventing a cascade of subsequent errors. 2.2 Language Models and Decision-Making LLMs have been adapted for decision-making and acting tasks, serving as policy models in interactive environments. In robotics, LLMs function as high-level controllers for lower-level control policies Ahn et al. 2022 ; Huang et al. 2022 ; Driess et al. 2023 and have proven useful in tasks like web navigation Deng et al. 2024a ; Zheng et al. 2024 . They are particularly effective in text-based environments Shridhar et al. 2020b