Cantante : Optimizing Agentic Systems via Contrastive Credit Attribution
Tom Zehle · 2026
Read Cantante : Optimizing Agentic Systems via Contrastive Credit Attribution by Tom Zehle (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13295.txt.
Introduction
Zehle presents CANTANTE, a way to tune multi agent language systems by splitting system scores into per agent signals. Scores arrive only for the whole system, while the settings that matter live inside each agent. Contrasting runs of several joint setups on the same query yields local update signals for prompt tuning. It tops rival optimizers on average across coding, math reasoning and question answering tests, gaining nearly nineteen points on coding over the strongest baseline.
Catalog record
| CREATOR | Tom Zehle |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 79738 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13295
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cantante : Optimizing Agentic Systems via Contrastive Credit Attribution Tom Zehle Abstract LLM-based multi-agent systems have demonstrated strong performance across complex real-world tasks, such as software engineering, predictive modeling, and retrieval-augmented generation. Yet automating their configuration remains a structural challenge, as scores are available only at the system level, whereas the parameters governing agent behavior are local. We argue that optimizing these systems is fundamentally a credit-assignment problem. We therefore introduce Cantante , a framework that decomposes system-level rewards into per-agent update signals by contrasting rollouts of multiple joint configurations on the same query. We instantiate it for prompt optimization, treating agent prompts as learnable system parameters. We evaluate Cantante against GEPA and MIPROv2 on programming (MBPP), mathematical reasoning (GSM8K), and multi-hop question answering (HotpotQA). Across these benchmarks, Cantante achieves the best average rank among all evaluated optimizers and consistently outperforms unoptimized prompts. It improves over the strongest baseline by + 18.9 +18.9 percentage points on MBPP and + 12.5 +12.5 percentage points on GSM8K, while incurring a lower inference cost. It remains within one standard deviation of the strongest baseline on HotpotQA. Crucially, our credit correlation analysis confirms that the attributer produces meaningful per-agent signals rather than echoing the global system score. 1 Introduction Figure 1 : Trajectories on MBPP. Cantante improves steadily, reaching the highest final accuracy. Agentic systems built on large language models have demonstrated strong empirical performance across a range of complex, real-world tasks, from autonomous software engineering [ 1 ] to end-to-end machine learning pipelines [ 2 ] and multi-hop retrieval [ 3 ] . More broadly, multi-agent systems (MAS) turn LLMs from passive conversational models into autonomous problem-solving systems. Yet realizing this potential in practice remains labor-intensive: each deployment requires manual selection of agents, hand-authored prompts, workflow design, and tool setup. Manually tuning MAS configurations, however, contradicts the main paradigm of machine learning: Just as no practitioner hand-tunes neural network weights, manual iteration over agent prompts and roles is a problem that should be solved via optimization. The manual labor required grows combinatorially with each agent requiring its own configuration and each prompt requiring a co-adaption to the behavior of the others, making trial-and-error tuning both tedious and ineffective. Automating the configuration of MAS would reduce this burden and enable principled adaptation to new tasks and models, but doing so is non-trivial. Not only is the search space high-dimensional, but more fundamentally, the optimization problem has a structural mismatch: agent-level parameters are local , while evaluation feedback is global , available only as a scalar signal over the full workflow output. We argue that multi-agent system optimization is fundamentally a credit-assignment problem : global feedback must be converted into per-agent update signals. In a planner–coder–evaluator workflow, for example, faulty code introduced by the coder should not trigger equally negative updates in the planner and evaluator. This problem is well-established in multi-agent reinforcement learning, where cooperative agents must each receive a learning signal derived from a shared global reward [ 4 , 5 ] . Existing approaches to LLM-based MAS optimization largely sidestep this issue by propagating global scores as update signals to individual agents [ 6 , 7 ] . We therefore introduce Cantante , a novel framework for node-level optimization in MAS based on system-level rewards and reasoning trajectories. The central mechanism is contrastive in-group attribution : by comparing rollouts of multiple joint configurations for the same query, the attribution model isolates each agent’s parameterization’s contribution to the observed differences in outcomes. This method is independent of the choice of local optimizer. We instantiate this framework for prompt optimization, treating agent prompts as learnable system parameters rather than fixed implementation details. We evaluate Cantante on workflow graphs with non-trivial structure, including conditional edges, ensemble nodes, and tool-using agents, across programming (MBPP), mathematical reasoning (GSM8K), and multi-hop question answering (HotpotQA). Cantante obtains the best average rank among all evaluated optimizers, with the largest gains occurring on MBPP and GSM8K, where Cantante improves over the strongest baseline by 18.9 percentage points (pp) and 12.5\text{\,}\mathrm{pp} , respectively. The MBPP trajectory plot in Figure 1 further shows that Cantante reaches these gains steadily over optimization, rather than through a single late-stage jump. We show that these gains are achieved without substantially increasing inference-time token cost relative to the unoptimized prompts. On HotpotQA, Cantante remains within a standard deviation of the best baseline and improves over the unoptimized initial configuration. Finally, our credit correlation analysis suggests that the attributer produces meaningful per-agent signals rather than merely echoing the global system score and that these signals can serve as a diagnostic tool for MAS topology design. Contributions. We make the following contributions: I) We formalize the optimization of LLM-based multi-agent systems as a credit-assignment problem and introduce Cantante . II) We instantiate Cantante for prompt optimization, treating agent prompts as learnable system parameters, and evaluate it against MAS-capable prompt optimizers across multiple benchmarks. III) We isolate contrastive attribution itself — rather than the underlying local optimizer — as the principal driver of Cantante ’s gains via an identity-attribution ablation, and further demonstrate robustness to attributer prompt, attributer model, local optimizer choice, and dataset size. IV) We release the full implementation of Cantante to support adoption by practitioners and to enable further research on attribution-driven MAS optimization, available at https://github.com/finitearth/cantante . 2 Related Work LLM-Based Multi-Agent Systems. Multi-agent systems consist of multiple autonomous agents that coordinate their actions to solve a shared task [ 8 ] . LLM-based variants extend this paradigm through a language interface, composing agents via role specialization, communication, planning, memory, and tool use [ 9 ] . Representative applications include autonomous software engineering with SWEAgent [ 1 ] , automated predictive modeling with MLZero [ 2 ] , and agent-based retrieval with MAIN-RAG [ 3 ] . Credit Assignment in Multi-Agent Reinforcement Learning. In multi-agent reinforcement learning (MARL), credit assignment under shared rewards is a well-studied problem. Methods such as QMIX [ 10 ] decompose the global value function into per-agent contributions, while counterfactual approaches like COMA [ 5 ] estimate individual agent impact by comparing observed outcomes against baselines that marginalize out each agent’s action. More recently, LLM-MCA [ 11 ] utilizes LLM critics to decompose global rewards into individual feedback. However, it remains tied to updating the neural network weights of traditional reinforcement learning agents, and it relies on a task-specific attribution prompt. It adapts the comparative intuition behind counterfactual credit assignment to LLM-based workflows by comparing concrete alternative trajectories for the same query and using a prompted LLM to attribute observed differences in outcomes to individual agents. Unlike value-based decomposition methods such as QMIX, Cantante does not impose a constraint requiring credits to reconstruct the global score. Prompt Optimization. Prompt design affects model behavior, with surface-level formatting choices alone producing substantial performance variation [ 12 ] . EvoPrompt [ 13 ] performs evolutionary search over prompt candidates using LLMs in its mutation and selection operators. CAPO [ 14 ] builds on evolutionary search by incorporating AutoML techniques such as racing to reduce optimization cost, and introduces prompt length penalties. TextGrad [ 15 ] simulates gradient descent via LLM feedback, iteratively identifying and correcting failure cases in generated outputs. MIPROv2 [ 16 ] samples