Connecting the Dots: A Chain-of-Collaboration Prompting Framework for LLM Agents
Jiaxing Zhao, Hongbin Xie, Yuzhen Lei, Xuan Song Zhuoran Shi, Lianxin Li, Shuangxue Liu, Haoran Zhang School of Artificial Intelligence, Jilin UniversityDepartment of Computer Science and Engineering, Southern University of Science and TechnologySchool of Urban Planning and Design, Peking University · 2025
Read Connecting the Dots: A Chain-of-Collaboration Prompting Framework for LLM Agents by Jiaxing Zhao, Hongbin Xie, Yuzhen Lei, Xuan Song Zhuoran Shi, Lianxin Li, Shuangxue Liu, Haoran Zhang School of Artificial Intelligence, Jilin UniversityDepartment of Computer Science and Engineering, Southern University of Science and TechnologySchool of Urban Planning and Design, Peking University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10936.txt.
Introduction
Jiaxing Zhao and co-authors present Cochain in a 2025 paper, a prompting framework that helps language model agents work together on business tasks. A single agent with chain of thought prompting struggles when a task spans many domains. Multi agent systems can cover more ground, but they burn many tokens and can dilute the main problem. Cochain aims for joint work at lower cost.
The framework builds a knowledge graph that links what is known across the stages of a workflow. It also keeps a tree of prompts, so a stage can pull in prompt material from other stages when needed. Tests across several data sets show Cochain beating both prompt based and multi agent baselines. Expert judges also rated a small model with Cochain above a leading large model on their tasks.
Catalog record
| CREATOR | Jiaxing Zhao, Hongbin Xie, Yuzhen Lei, Xuan Song Zhuoran Shi, Lianxin Li, Shuangxue Liu, Haoran Zhang School of Artificial Intelligence, Jilin UniversityDepartment of Computer Science and Engineering, Southern University of Science and TechnologySchool of Urban Planning and Design, Peking University |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-10936
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Connecting the Dots: A Chain-of-Collaboration Prompting Framework for LLM Agents Jiaxing Zhao, Hongbin Xie, Yuzhen Lei, Xuan Song Zhuoran Shi, Lianxin Li, Shuangxue Liu, Haoran Zhang School of Artificial Intelligence, Jilin UniversityDepartment of Computer Science and Engineering, Southern University of Science and TechnologySchool of Urban Planning and Design, Peking University {zhaojx9921,leiyz9921,liusx9921}@mails.jlu.edu.cn,[email protected],{12131108,12210702,12212055}@mail.sustech.edu.cn,[email protected] Abstract Large Language Models (LLMs) have demonstrated impressive performance in executing complex reasoning tasks. Chain-of-thought effectively enhances reasoning capabilities by unlocking the potential of large models, while multi-agent systems provide more comprehensive solutions by integrating collective intelligence of multiple agents. However, both approaches face significant limitations. Single-agent with chain-of-thought, due to the inherent complexity of designing cross-domain prompts, faces collaboration challenges. Meanwhile, multi-agent systems consume substantial tokens and inevitably dilute the primary problem, which is particularly problematic in business workflow tasks. To address these challenges, we propose Cochain , a collaboration prompting framework that effectively solves business workflow collaboration problem by combining knowledge and prompts at a reduced cost. Specifically, we construct an integrated knowledge graph that incorporates knowledge from multiple stages. Furthermore, by maintaining and retrieving a prompts tree, we can obtain prompt information relevant to other stages of the business workflow. We perform extensive evaluations of Cochain across multiple datasets, demonstrating that Cochain outperforms all baselines in both prompt engineering and multi-agent LLMs. Additionally, expert evaluation results indicate that the use of a small model in combination with Cochain outperforms GPT-4. * * footnotetext: Equal contribution. † † footnotetext: Corresponding author. 1 Instruction Large Language Models (LLMs) have demonstrated impressive performance in language understanding and complex reasoning tasks [ 51 , 5 , 21 , 8 ] , with prompt engineering playing a crucial role in enhancing their reasoning capabilities. Prompt engineering represented by Chain-of-Thought prompt LLMs in ways that facilitate coherent and step-by-step reasoning processes, endowing agents with depth of thought [ 7 , 57 , 66 ] . To enhance agent collaborative capabilities, various multi-agent collaborative frameworks have been developed, providing agents with breadth of thought. These frameworks encode carefully designed agent profiles and collaborative mechanisms into prompts, yielding favorable outcomes across domains such as healthcare [ 50 , 29 , 38 ] , education [ 17 , 44 , 22 ] , law [ 16 ] , and finance [ 64 ] . Due to their exceptional problem-solving and collaborative abilities, multi-agent systems are considered a promising pathway toward Artificial General Intelligence (AGI) [ 9 , 81 ] . However, this raises a critical question: Is a multi-agent LLM system all you need? Evidently not, as both single-agent and multi-agent systems exhibit limitations [ 53 ] . As illustrated in Figure 1 , the inherent complexity in designing cross-domain prompts [ 47 ] means that single agents employing prompt engineering lack constraint awareness and face challenges in cross-domain collaboration (under-collaboration). Simultaneously, multi-agent systems face challenges from expensive token consumption and extensive inference time [ 20 , 60 ] , with inter-agent communications often ineffectively utilized [ 72 ] . More importantly, existing research primarily focuses on maximizing collaboration, extensively exploring how multi-agent systems can improve decision quality [ 73 , 43 ] , make safe decisions [ 33 , 42 ] , and solve problems [ 78 , 34 ] , while paying insufficient attention to the negative effects of excessive agent collaboration. When all agents simultaneously participate in every decision-making process, core issues are frequently overwhelmed by non-critical information, leading not only to a decline in answer quality but also to a preference for consensus-driven answers over accurate ones [ 20 ] , particularly in business workflow tasks. To our best knowledge, no existing literature has systematically analyzed and defined this “over-collaboration” phenomenon or proposed targeted solutions . This prompts us to consider: Why not combine the reasoning capabilities of chain-of-thought prompting with the collaborative nature of multi-agent systems? Inspired by these challenges, we propose a collaborative prompting framework, Cochain, designed to enhance LLM agents’ collaborative capabilities in business workflow tasks at low cost, while mitigating over-collaboration through indirect rather than direct agent participation in decision-making. As shown in Figure 2 , Cochain comprises two primary components: collaborative knowledge graph and prompts tree. We mine agent knowledge through counterfactual reasoning and refine it into a knowledge graph integrated with explicit dataset knowledge. To mitigate the impact of irrelevant knowledge on model performance [ 79 ] , we introduce causal chain structure to improve cross-stage reasoning capabilities. Inspired by how the human brain integrates fragmented knowledge into coherent thought [ 15 ] , we propose prompts tree that distills prompts from agent responses. By retrieving from the prompts tree, agents can automatically acquire chain-like cross-stage prompts, avoiding the high cost of manual prompt design while effectively utilizing inter-agent communications. Figure 1: The impact of agent collaboration degree on problem-solving effectiveness. Under-collaboration ignores constraints from other stages, while over-collaboration dilutes main issues with irrelevant information (underlined in our examples). Agents using Cochain achieve balance by considering constraints while maintaining focus on key problems, effectively connecting the dots. The main contributions are summarized as follows: \bullet Effective Collaboration: We propose an agent collaborative prompting framework, Cochain, that equips agents with both depth and breadth of thinking, effectively alleviating the problems of over-collaboration and under-collaboration. \bullet Cost-Effective yet Efficient: Our extensive experimental results demonstrate that Cochain exhibits significant improvements over all baselines across different model backbones and three business workflow datasets. Cochain possesses reasoning speeds comparable to single-agent systems and even lower inference costs, and surpasses existing multi-agent systems in capability, achieving an optimal balance between performance and efficiency. \bullet The Small + Cochain Outperforms the Large: Evaluations by domain experts have further confirmed that the combination of the small model and our framework outperforms the large model. To support further research on over-collaboration and business workflow tasks, we will publicly release our collaborative knowledge graph and high-quality datasets. 2 Related Work Figure 2: Cochain connects business workflow stages. In part (a), agents address counterfactual inquiries, with answers undergoing interactive iteration. In part (b), a prompts tree is built. Part (d) presents our framework: an agent uses the prompts tree and a collaborative knowledge graph built from counterfactual answers and original data, achieving more collaborative results than part (c). 2.1 Knowledge Graph Augmented LLMs LLM reasoning capabilities are critical for high-quality responses [ 28 , 49 , 30 ] . Knowledge graphs, with their structured, explicit, and interpretable nature [ 75 , 40 , 80 ] , offer clear representations and transparent reasoning paths, effectively guiding LLMs in deeper reasoning and mitigating limitations [ 36 , 67 , 56 ] . For domain-specific LLMs, knowledge graphs enable continuous updating of knowledge frameworks to accommodate evolving information [ 27 , 37 , 31 ] . Currently, MindMap [ 59 ] applies knowledge graphs in medicine, while ChatLAW [ 16 ] employs them in legal domains for process simulation. Business workflows, due to their multi-stage nature and cross-domain integration requirements, face the unique challenge of multi-stage knowledge fusion. To prevent performance degradation from irrelevant knowledge [ 39 ] , we propose a causal chain optimizing knowledge selection, enhancing understanding of cross-stage relationships while filtering out noise. 2.2 Prompt Engineering Prompt engineering aims to guide LLMs to maximize their potential