DIG to Heal: Scaling General-purpose Agent Collaboration via Explainable Dynamic Decision Paths

Hanqing Yang, Hyungwoo Lee, Yuhang Yao, Zhiwei Liu, Kay Liu, Jingdi Chen, Carlee Joe-Wong · 2026

Read DIG to Heal: Scaling General-purpose Agent Collaboration via Explainable Dynamic Decision Paths by Hanqing Yang, Hyungwoo Lee, Yuhang Yao, Zhiwei Liu, Kay Liu, Jingdi Chen, Carlee Joe-Wong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00309.txt.

Introduction

Yang and colleagues study language-model agents that work together with no preset roles or workflows. In such free-form teamwork, duplicated effort and cascading failures often arise. They introduce the Dynamic Interaction Graph, tracking agent activations and interactions over time as a causal network. The graph makes such teamwork observable and explainable. From teamwork paths alone, it supports live spotting, explanation, and correction of teamwork-caused error patterns. The authors argue this fills a key gap in grasping how general agents solve problems together.

Catalog record

CREATORHanqing Yang, Hyungwoo Lee, Yuhang Yao, Zhiwei Liu, Kay Liu, Jingdi Chen, Carlee Joe-Wong
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63030
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00309

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DIG to Heal: Scaling General-purpose Agent Collaboration via Explainable Dynamic Decision Paths Hanqing Yang, Hyungwoo Lee, Yuhang Yao, Zhiwei Liu, Kay Liu, Jingdi Chen, Carlee Joe-Wong Abstract The increasingly popular agentic AI paradigm promises to harness the power of multiple, general-purpose large language model (LLM) agents to collaboratively complete complex tasks. While many agentic AI systems utilize predefined workflows or agent roles in order to reduce complexity, ideally these agents would be truly autonomous, able to achieve emergent collaboration even as the number of collaborating agents increases. Yet in practice, such unstructured interactions can lead to redundant work and cascading failures that are difficult to interpret or correct. In this work, we study multi-agent systems composed of general-purpose LLM agents that operate without predefined roles, control flow, or communication constraints, relying instead on emergent collaboration to solve problems. We introduce the Dynamic Interaction Graph (DIG), which captures emergent collaboration as a time-evolving causal network of agent activations and interactions. DIG makes emergent collaboration observable and explainable for the first time, enabling real-time identification, explanation, and correction of collaboration-induced error patterns directly from agents’ collaboration paths. Thus, DIG fills a critical gap in understanding how general LLM agents solve problems together in truly agentic multi-agent systems. The project webpage can be found at: https://happyeureka.github.io/dig . 1 Introduction Large Language Models (LLMs) are increasingly used as general decision-making units due to their broad world knowledge, flexible reasoning abilities, and capacity to interact with external tools and memory. This has led to the emergence of LLM agents , which extend LLMs with persistent state, tool access, and environment interaction, enabling them to act autonomously in complex tasks. Recently, significant attention has been devoted to LLM-powered multi-agent systems ( Chen et al. 2026 ; Yang et al. 2025 ) , where multiple agents collaborate on tasks such as research, software engineering, robotics, simulation, and question answering ( Durante et al. 2024 ) . Despite the potential of allowing LLM agents to act autonomously, in practice unstructured agent collaboration often leads to task failure. Thus, many multi-agent systems utilize predefined workflows , with fixed roles, task decompositions, tool usage patterns, and message routing policies, in order to stabilize performance ( Li et al. 2024 ) . However, such designs are often domain-specific and fundamentally constrain how agents interact. In contrast, we study LLM-powered multi-agent systems composed of general-purpose LLM agents that operate without predefined roles, control flow, or communication constraints. In such systems, coordination, task decomposition, and problem-solving strategies must arise implicitly from local agent decisions and interactions, resembling how human teams dynamically adapt to evolving tasks. Our goal is to characterize analogous forms of cooperative intelligence in general-purpose LLM agents and illuminate the causes of collaboration failures so as to enable more resilient autonomous multi-agent systems. The Challenges of Emergent Cooperation. Allowing agents to autonomously interact introduces substantial challenges. Each agent receives information, from other agents and the environment, at arbitrary times while acting concurrently with others. Local agent decisions can thus easily push global execution away from intended behavior, producing redundant work, stalled progress, or cascading failures that are difficult to diagnose or recover from. Simply increasing the number of agents does not guarantee improved performance; instead, interaction complexity grows combinatorially, leading to even more interdependent outputs that may cause task failures or redundancies. Unlike traditional distributed systems, multi-LLM agent systems are stochastic, heterogeneous, and message-driven, making tracing, debugging, and recovery particularly challenging. Existing approaches typically rely on centralized monitors ( Gandhi et al. 2025 ; Zhang et al. 2025a ) , guard agents ( Yu et al. 2025 ) , or post hoc failure attribution based on execution logs or curated error datasets ( Kong et al. 2025 ; Zhang et al. 2025b ) . These methods either assume fixed workflows, operate after failures have already occurred, or require large amounts of annotated data, and therefore do not directly address how cooperation emerges or fails during execution. Our Perspective: Analyzing Agent Interactions. In this work, we argue that understanding and improving general multi-agent systems requires treating collaboration itself as the primary object of analysis. Rather than focusing on individual agents or final outcomes, we model the system in terms of its interaction structure. We introduce the Dynamic Interaction Graph (DIG) , a time-evolving directed graph that represents agent activations and interaction events as a causal network. This abstraction makes emergent collaboration observable and explainable, enabling real-time tracing, structural analysis, and principled reasoning about how cooperative behavior forms, propagates, and fails. Building on DIG, we establish a topological characterization of emergent collaboration, which maps interaction graph structures to distinct classes of collaboration-induced error patterns. This result provides a model-agnostic categorization of failure modes, enabling early failure detection at the level of collaboration structure rather than individual agent outputs. Importantly, this structural perspective is designed to be compatible with existing failure detection and attribution methods ( Cemri et al. 2025 ) . Rather than replacing them, it provides an error detection and guarding layer , where topology-level signals can be integrated into semantic, behavioral, and learning-based detectors. The DIG framework further supports reasoning about effective agent utilization, revealing when additional agents contribute meaningful progress versus when they introduce redundancy, inefficiency, or instability. Together, these capabilities provide a unified and explainable foundation for understanding and debugging truly agentic multi-LLM systems, where cooperation emerges dynamically rather than being imposed by predefined workflows. Our main contributions are: (1) Interaction Modeling. We formalize the interaction structure and cooperative problem-solving process of general LLM agents with DIG, a dynamic directed acyclic graph (DAG) representation that captures both sequential and parallel dependencies, as well as temporal ordering, in unconstrained multi-agent systems. (2) Topological Failure Characterization. We establish a principled mapping from the DIG topology to collaboration-induced error types, yielding a high-level, model-agnostic categorization of failure modes that supports explainable and hierarchical error detection and can be naturally integrated with existing error detection and attribution methods. (3) General-Agent Execution Traces. We evaluate DIG on two scalable and verifiable evaluation tasks, allowing us to introduce the first dataset of execution traces that capture the behavior and interaction patterns of general-purpose agents operating without predefined roles or control flow. (4) Structure-Driven System Healing. We propose an automatic system healing mechanism driven by observed agent behavior and interaction structure, enabling early detection and correction of collaboration-induced failures during execution. In experiments, we find that this mechanism yields improved efficiency and fewer errors, particularly on difficult tasks with many agents After reviewing related work in Section 2 , we formalize agent interactions and DIG’s construction in Section 3 . We then explain how DIG allows for failure monitoring and interventions in Section 5 . We then describe the design (Section 6 ) and results (Section 7 ) of our validation experiments and conclude in Section 8 . 2 Related Work LLM-powered Multi-agent Systems. Recent frameworks such as LangGraph ( lan ) , AutoGen ( Wu et al. 2023 ) , and AgentVerse ( Chen et al. 2023 ) enable multi-agent collaboration through structured workflows and orchestration policies, and have been applied to tasks including research assistants, software engineering, robotics, and simulation ( Chen et al. 2026 ) . While effective in domain-specific settings, these systems

Read the complete text