ANNEAL: Adapting LLM Agents via Governed Symbolic Patch Learning

Safayat Bin Hakim, Keyan Guo, Wenkai Tan, Alvaro Velasquez, Shouhuai Xu, Houbing Herbert Song, [0.8ex] University of Maryland, Baltimore County University at Buffalo University of Colorado Boulder University of Colorado Colorado Springs · 2026

Read ANNEAL: Adapting LLM Agents via Governed Symbolic Patch Learning by Safayat Bin Hakim, Keyan Guo, Wenkai Tan, Alvaro Velasquez, Shouhuai Xu, Houbing Herbert Song, [0.8ex] University of Maryland, Baltimore County University at Buffalo University of Colorado Boulder University of Colorado Colorado Springs (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16309.txt.

Introduction

Hakim and five colleagues show that ReAct and Reflexion recover episode by episode, yet fail 72 to 100 percent of holdout tests on recurring faults. The operator schemas, preconditions, and constraints behind each fault were never fixed. Their ANNEAL turns repeat failures into governed symbolic edits to a process knowledge graph, leaving model weights untouched. Its Failure-Driven Knowledge Acquisition step finds the responsible operator and drafts a typed patch, validated before commit. Across four domains and 27 runs, ANNEAL alone commits lasting repairs, cutting recurring-fault holdout failure to zero.

Catalog record

CREATORSafayat Bin Hakim, Keyan Guo, Wenkai Tan, Alvaro Velasquez, Shouhuai Xu, Houbing Herbert Song, [0.8ex] University of Maryland, Baltimore County University at Buffalo University of Colorado Boulder University of Colorado Colorado Springs
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72174
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16309

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ANNEAL: Adapting LLM Agents via Governed Symbolic Patch Learning Thanks: Implementation: github.com/sbhakim/anneal-agents . Safayat Bin Hakim, Keyan Guo, Wenkai Tan, Alvaro Velasquez, Shouhuai Xu, Houbing Herbert Song, [0.8ex] University of Maryland, Baltimore County University at Buffalo University of Colorado Boulder University of Colorado Colorado Springs Abstract LLM-based agents can recover from individual execution errors, yet they repeatedly fail on the same fault when the underlying process knowledge—operator schemas, preconditions, and constraints—remains unrepaired. Existing self-evolving approaches address this gap by updating prompts, memory, or model weights, but none directly repair the symbolic structures that encode how tasks are executed, and few provide the governance guarantees required for safe deployment. We introduce Anneal , a neuro-symbolic agent that converts recurring failures into governed symbolic edits of a process knowledge graph without modifying foundation model weights. Its core mechanism, Failure-Driven Knowledge Acquisition (FDKA) , localizes the responsible operator, synthesizes a typed patch through constrained LLM generation, and validates the proposal via multi-dimensional scoring, symbolic guardrails, and canary testing before commit. Every accepted edit carries full provenance and deterministic rollback capability. Across four domains and 27 multi-seed runs, Anneal is the only evaluated system that commits persistent structural repairs—strong baselines such as ReAct and Reflexion achieve high episodic recovery yet retain 72–100% holdout failure rates on recurring faults, whereas Anneal reduces these to 0% in the tested recurring-failure settings. Ablation confirms that removing FDKA eliminates all structural repairs and drops success rate by up to 26.7 percentage points. These results suggest that governed symbolic repair offers a complementary paradigm to weight-level and prompt-level adaptation for persistent fault elimination. 1 Introduction When a human expert encounters a recurring process failure—say, a booking system that keeps rejecting corporate cards during blackout dates—they do not simply retry harder; they repair the underlying procedure by adding a check for blocked dates. This ability to convert recurring breakdowns into durable structural fixes is central to expertise ( 2 ) . LLM-based agents lack this capability: they may recover within a single episode, but when the same fault reappears, they fail again because the process knowledge that caused it—operator schemas, preconditions, and constraints—remains unchanged ( 5 ) . Recent work on self-evolving agents addresses this gap through several paradigms. Reflection-based methods store verbal summaries across episodes ( 16 ) but leave the agent’s operational knowledge intact; the same structural fault can recur on every new task. Memory-augmented approaches retrieve past trajectories or distilled principles to guide decisions ( 22 ; 28 ) , yet they adapt what the agent recalls , not the process definitions it executes . Reinforcement learning on memory ( 26 ) and evolutionary prompt optimization ( 6 ; 25 ) offer stronger adaptation but still operate over prompts, policies, or weights—none directly repair the typed symbolic structures that encode how tasks are planned and executed. Moreover, few of these systems provide the governance guarantees—provenance, guardrails, canary testing, rollback—that safe deployment demands ( 18 ; 15 ) . In this work, we introduce Anneal (Figure 1 ), a neuro-symbolic agent that bridges this gap by converting recurring failures into governed symbolic edits of a process knowledge graph, without modifying foundation model weights. Rather than updating what the agent recalls or how it prompts, Anneal repairs the operator definitions that the planner directly consults—ensuring that once a fault is fixed, it cannot structurally recur. Its core mechanism, Failure-Driven Knowledge Acquisition (FDKA) , treats the LLM strictly as a constrained code generator under a closed typed schema, so that all acceptance logic remains symbolic and auditable. Because no single validation step suffices for safe deployment, proposed edits must survive multi-dimensional scoring, deontic and causal guardrails, and canary testing before commit—each layer catching failure modes the others miss. A metacognitive controller further regulates when adaptation is warranted by arbitrating between fast and deliberative pathways based on uncertainty and violation signals. A formal definition of the target environments and the open-world instructability problem scope is provided in Appendix A . Figure 1: Anneal adaptation cycle. User requests hotel booking; execution fails due to policy violation. FDKA localizes the responsible operator, synthesizes a precondition patch, validates through scoring and guardrails, and commits. Replan with updated operator succeeds. Complete cycle: < 2 minutes, no model retraining. Contributions. Our work combines neuro-symbolic planning ( 5 ; 10 ) , metacognitive control ( 3 ; 8 ) , and causal/value verification ( 7 ; 30 ) into a governed system for symbolic process repair. We make the following contributions: 1. Governed failure-driven knowledge acquisition. We propose FDKA, a pipeline that synthesizes typed symbolic edits (schema updates, precondition additions, effect refinements) under a closed JSON schema and validates them through multi-dimensional scoring, value/causal guardrails, and canary deployment. Across the 27 runs reported here, FDKA achieves 100% patch acceptance with no observed rollbacks (Appendix E , F ). 2. Metacognitive arbitration. A stage-aware control loop monitors uncertainty and violation signals to arbitrate between fast (S1), deliberative (S2), and verify-before-act pathways under explicit budgets. Removing arbitration drops success rate by 4.7 pp under stochastic noise, where compound policy shifts create multi-violation chains that exceed the fast path’s budget. 3. Comprehensive governance envelope. Every committed edit carries provenance, Beta–Bernoulli trust scoring, human-in-the-loop gates, and deterministic rollback. A dedicated governance-stress benchmark confirms selective activation: all six auth-sensitive schema edits are escalated before commit in the reported suite, yielding 100% decision accuracy on that benchmark. 4. Empirical evidence across four domains. Across 27 multi-seed runs, Anneal is the only evaluated system that commits persistent structural repairs while achieving 94.7–100% task success. In recurring-failure stress tests, committed patches reduce holdout failures to 0% in the evaluated settings, whereas ReAct and Reflexion retain 72–100% holdout failure rates despite high episodic recovery. Removing FDKA drops success rate by up to 26.7 percentage points and eliminates all structural repairs (Appendix G provides a TTA convergence bound). Section 2 reviews related work; Section 3 formalizes the agent and control loop; Section 4 details FDKA and governance; Section 5 presents evaluation; Section 6 discusses limitations. 2 Related Work Additional background on neuro-symbolic planning, metacognitive control, and symbolic knowledge editing appears in Appendix A ; the main text focuses here on the most novelty-sensitive comparisons. Governance for self-evolving systems. Integrating causal and value reasoning is critical for safe autonomy ( 7 ; 30 ) . Surveys on governed deployment ( 18 ) emphasize provenance, human oversight, and rollback as prerequisites, while risk analyses show that self-evolution can degrade safety through memory, tool, model, or workflow drift ( 15 ) . Anneal instantiates this line of work through metacognitive arbitration, multi-dimensional scoring, and an explicit governance envelope (provenance, trust, rollback). Self-evolving agents. Surveys organize self-evolving agents by what, when, and how to evolve ( 4 ) . Current approaches span explicit evolution over persistent artifacts ( 14 ) , whole-agent configuration updates at test time ( 6 ) , offline self-distillation plus online policy reinforcement ( 22 ) , trajectory-level self-improvement ( 13 ) , autonomous policy learning from experience ( 17 ) , and memory-augmented or RL-based adaptation ( 28 ; 26 ; 25 ) . These systems mainly evolve prompts, memories, trajectories, or policies. By contrast, Anneal targets typed symbolic process knowledge—operators, preconditions, effects, tool schemas, and

Read the complete text