GraphMind: From Operational Traces to Self-Evolving Workflow Automation
Yiwen Zhu, Joyce Cahoon, Anna Pavlenko, Qiushi Bai, Nima Shahbazi, Divya Vermareddy, Meina Wang, Mathieu Demarne, Swati Bararia, Wenjing Wang, Hemkesh Vijaya Kumar, Hannah Lerner, Katherine Lin, Steve Toscano, Miso Cilimdzic, Subru Krishnan · 2026
Read GraphMind: From Operational Traces to Self-Evolving Workflow Automation by Yiwen Zhu, Joyce Cahoon, Anna Pavlenko, Qiushi Bai, Nima Shahbazi, Divya Vermareddy, Meina Wang, Mathieu Demarne, Swati Bararia, Wenjing Wang, Hemkesh Vijaya Kumar, Hannah Lerner, Katherine Lin, Steve Toscano, Miso Cilimdzic, Subru Krishnan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17617.txt.
Introduction
Zhu and colleagues present GraphMind, which builds, runs and evolves workflow graphs from operational traces. An offline pipeline mines graphs of problems, actions and causal links from traces. An online engine walks the graph, mixing guided retrieval with language-model reasoning. Adaptive Traversal Reinforcement strengthens successful paths from feedback. Deployed on four cloud services and tested on 93 incidents, it beats a Summary-RAG baseline on reach, hallucination rate and throughput with eight times less context. A 12-week field study finds 97 percent of scored chats yield actionable results.
Catalog record
| CREATOR | Yiwen Zhu, Joyce Cahoon, Anna Pavlenko, Qiushi Bai, Nima Shahbazi, Divya Vermareddy, Meina Wang, Mathieu Demarne, Swati Bararia, Wenjing Wang, Hemkesh Vijaya Kumar, Hannah Lerner, Katherine Lin, Steve Toscano, Miso Cilimdzic, Subru Krishnan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39349 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17617
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GraphMind: From Operational Traces to Self-Evolving Workflow Automation Yiwen Zhu, Joyce Cahoon, Anna Pavlenko, Qiushi Bai, Nima Shahbazi, Divya Vermareddy, Meina Wang, Mathieu Demarne, Swati Bararia, Wenjing Wang, Hemkesh Vijaya Kumar, Hannah Lerner, Katherine Lin, Steve Toscano, Miso Cilimdzic, Subru Krishnan Abstract . Complex operational workflows coordinating personnel, tools, and information are central to system operations, yet end-to-end automation remains challenging due to extensive human input requirements and limited ability to adapt over time. We present GraphMind, a system that constructs, executes, and evolves action-centric workflow graphs with minimal human effort. The system operates in three phases. First, a scalable offline pipeline extracts structured workflow graphs from large volumes of human resolution traces, capturing problems, actions, and their causal relationships. Second, an online multi-agent traversal engine navigates the graph to dynamically construct and execute workflows, combining graph-guided retrieval with LLM-driven reasoning at each step. Third, Adaptive Traversal Reinforcement (ATR) reinforces successful traversal paths, enabling execution-informed graph adaptation. GraphMind has been deployed across four production cloud database services for incident investigation. Evaluated on 93 held-out incidents and validated via blind expert review, the system outperforms an Agentic Summary-RAG baseline in mitigation reach, hallucination rate, and diagnostic throughput while requiring 8 × \times less retrieval context. The ATR layer reduces hallucination rate by 26%, demonstrating that workflow graphs can learn from execution feedback. A 12-week field study confirms practical value: 97% of scored conversations yield actionable results within interactive latency. 1. Introduction Organizations rely on complex operational workflows to coordinate personnel, tools, and information across domains like customer support and service operations. While linear tasks are easily scripted, end-to-end automation remains challenging due to knowledge-intensive processes spanning heterogeneous tools and requiring iterative, context-dependent decisions. For example, diagnosing a database failure involves querying telemetry, analyzing timelines, drilling into exceptions, and ultimately applying mitigations—each step informed by prior observations. Although LLM-based agents ( 5 ; 25 ; 41 ; 36 ; 28 ) and agent skills (e.g., markdown-based instructions in Claude Code ( 2 ) and GitHub Copilot CLI ( 16 ) ) have renewed interest in workflow automation, purely prompt-driven approaches remain brittle: manually authored knowledge artifacts are costly, difficult to maintain, inefficient at retrieval time, and unable to capture the long tail of edge cases. Meanwhile, operational traces—records of how experts actually carried out workflows—remain underutilized as structured knowledge. In this work, we demonstrate that action-centric workflow graphs , constructed from operational traces, offer a far more efficient and agent-friendly format. Moreover, these graphs can learn from their own execution via Adaptive Traversal Reinforcement (ATR), inspired by Ant Colony Optimization (ACO) ( 11 ; 12 ) : successful paths are reinforced while stale edges decay. As Table 1 summarizes, this design uniquely combines storage efficiency, agent-friendly traversal, zero human authoring, expandable coverage, and self-evolution. Table 1 . Knowledge formats for workflow automation. Aspect Playbooks-RAG Agent Skills Trace-RAG † GraphMind Storage efficiency ✗Redundant ✗Per-skill ✗Per-trace ✓Shared nodes Agent friendliness ✗Verbose/Noisy \sim Structured ✗Verbose/Noisy ✓Graph traversal Human authoring High High None None Coverage Fixed top- k Fixed per-skill Fixed top- k Grows with traces Self-evolution ✗ ✗ ✗ ✓Via ATR † Trace-RAG retrieves raw traces via similarity search; raw traces are verbose and noisy. Introduction to GraphMind We present GraphMind, a system realizing this vision through three pillars (Figure 1 ). Pillar 1: Offline graph construction. The offline pipeline extracts actions as the central unit of a lightweight workflow graph with a fixed schema, occupying a middle ground between raw-trace ingestion (high online cost) and entity-centric knowledge graphs ( 14 ; 17 ) (high offline cost and construction complexity), reducing online retrieval to bounded graph traversal (Section 3 ). An open-source implementation is available at https://aka.ms/graphmind . Pillar 2: Online multi-agent traversal. The online phase performs iterative graph traversal : the agent retrieves a relevant subgraph, reasons over context and history, and selects the most promising action ( exploit ) or pivots to a different graph region ( explore ). Each traversal produces a trajectory for reinforcement (Section 4 ). Pillar 3: Adaptive Traversal Reinforcement (ATR). Inspired by ACO, we treat trajectories as reinforcement signals. Deposition strengthens edges along successful paths; temporal decay fades stale elements. The graph adapts over time through execution-informed reinforcement, encoding collective decision-making experience without manual engineering (Section 5 ). Figure 1 . Three-phase architecture of GraphMind. Application to incident management. We instantiate GraphMind for incident management in large-scale cloud database services at Microsoft, deployed in production across four services. Contributions We present GraphMind, to our knowledge the first production-deployed system that jointly constructs, executes, and reinforces action-centric workflow graphs from operational traces, requiring minimal manual authoring. Deployed across four production cloud database services, GraphMind outperforms an Agentic Summary-RAG baseline that shares the same iterative agent orchestration in mitigation reach, hallucination rate, and expert-rated quality while requiring 8 \times less retrieval context (mean 3.9K vs. 32K tokens per graph load), demonstrating that workflow graphs can continuously learn and improve from autonomous agent execution at scale. 2. Related Work ACO and swarm intelligence. ACO was introduced for combinatorial optimization ( 11 ; 12 ) and extended in variants such as ACS and MAX-MIN ( 10 ; 32 ) , with applications to routing ( 9 ) , scheduling ( 22 ) , and feature selection ( 33 ) . These methods optimize over fixed, well-defined search spaces with clear objective functions; GraphMind adapts the reinforcement-and-decay intuition to evolving workflow graphs where the topology itself changes through online execution. Process mining and knowledge graphs. Classical process mining recovers workflows from event logs ( 34 ; 35 ) but assumes structured, machine-parseable inputs; GraphMind targets noisier natural-language traces using LLM extraction. Prior work combines LLMs with knowledge graphs through fine-tuning or retrieval ( 26 ; 39 ) , while GraphRAG ( 17 ; 20 ; 27 ) methods use graph structure to improve retrieval. KG refinement via link prediction ( 4 ; 8 ; 38 ) learns static representations from fixed training data; LLMs can generate structured queries for grounded context ( 19 ; 29 ) but do not update the underlying graph. AIOps and LLM agents. D-Bot, Panda, and RCACopilot apply LLMs to troubleshooting ( 43 ; 31 ; 6 ) ; TRIANGLE and FLASH study triage ( 40 ; 42 ; 44 ) . Cloud-OpsBench ( 37 ) proposes a reproducible evaluation framework for AIOps agents that accounts for analysis trajectory quality, while Trace2Skill ( 23 ) automates skill creation and update from agent trajectories using multi-agent distillation. Neuro-symbolic approaches use structured graphs to constrain LLM outputs ( 7 ) . Tool-augmented agents and agentic RAG support iterative reasoning ( 41 ; 28 ; 30 ; 3 ) . However, these systems either rely on manually curated knowledge artifacts, learn flat skill libraries without causal structure, or treat the knowledge base as static after construction. GraphMind bridges these gaps by grounding agentic traversal in explicit problem–action relationships within a self-evolving workflow graph, which can in turn serve as the knowledge backbone for the aforementioned systems. 3. Pillar 1: Graph Construction (Warm Start) The offline pipeline transforms raw operational traces into a structured workflow graph. The pipeline supports incremental construction , integrating new traces without rebuilding the graph. As illustrated in Figure