A Sober Look at Agentic Misalignment in Automated Workflows

Wenqian Ye, Bo Yuan, Zhichao Xu, Yijun Tian, Yawei Wang, Henry Kautz, Aidong Zhang, [0.5em] University of Virginia · 2026

Read A Sober Look at Agentic Misalignment in Automated Workflows by Wenqian Ye, Bo Yuan, Zhichao Xu, Yijun Tian, Yawei Wang, Henry Kautz, Aidong Zhang, [0.5em] University of Virginia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24197.txt.

Introduction

Ye and six co-authors examine agentic misalignment in automated multi-agent workflows, where agents chase implicit proxy utilities that drift from human goals. In a Bayesian frame, the authors show generic utilities naturally collapse agent posteriors in such workflows. They propose Agentic Evidence Attribution, which reasons over agent actions and supplies structured evidence to correct misaligned behaviour during collaboration. Two forms are studied: self-reflection from internal evidence and weak-to-strong generalization from outside evidence. A small evidence model aligns the system well by attributing failures orthogonally.

Catalog record

CREATORWenqian Ye, Bo Yuan, Zhichao Xu, Yijun Tian, Yawei Wang, Henry Kautz, Aidong Zhang, [0.5em] University of Virginia
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84099
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.24197

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Sober Look at Agentic Misalignment in Automated Workflows Wenqian Ye, Bo Yuan, Zhichao Xu, Yijun Tian, Yawei Wang, Henry Kautz, Aidong Zhang, [0.5em] University of Virginia Abstract We study a class of emergent misalignment in multi-agent systems (MAS), with a focus on automated workflows, which we refer to agentic misalignment . Although these systems can solve complex tasks, they often fail because agents act according to implicit proxy utilities that do not align with the intended human goals. We formally define these behaviors and analyze them within a Bayesian framework, showing that generic utilities naturally lead to posterior collapse of agents in automated workflows. To address this issue, we propose Agentic Evidence Attribution (AEA), a novel alignment paradigm that improves agent posteriors using context-specific evidence. AEA reasons over agent actions and provides structured evidence to correct misaligned behavior during collaboration. To better understand the role of evidence, we study two instantiations of AEA: self-reflection (internal evidence from the model) and weak-to-strong generalization (external evidence on the agentic trajectory). We show that a small evidence model effectively aligns the MAS by providing orthogonal failure attribution. Our results clarify the sources of agentic misalignment in automated workflows and show that evidence-based alignment can effectively improve agent collaboration and leads to reliable multi-agent systems built on automated workflows. 1 Introduction Multi-agent systems (MAS) with Large Language Models (LLM) are increasingly used for tasks that require decomposition [ 27 , 9 ] , tool use [ 28 , 43 ] , and multi-step reasoning [ 2 , 25 ] . Most recent MAS leverage an orchestrator (or meta-agent) to construct various roles of agents and arrange the order of interactions through a technique called automated workflow generation [ 19 , 45 ] . This technique produces a general solution to build collaboration between agents to autonomously plan and act on individual tasks. Although these workflows allow agents to handle complex objectives, recent studies have also reported that MAS often fails in several systematic ways [ 6 , 12 , 16 , 21 ] . These alignment failures arise even when each individual agent performs well in isolation, suggesting an emerging underlying coordination problem within the agentic workflow. One qualitative perspective for interpreting these misalignments is that agents act according to a shared utility (or reward in some literature) shaped by generic pretraining and post-training, rather than the role-specific goals required by the workflow (Left in Figure 1 ) [ 17 , 29 , 4 ] . In automated workflows, agents observe only partial information about the generic objective and the behavior of other agents. As a result, the agent forms an implicit utility that is shaped by a generic training distribution rather than the intended role with respect to the agents themselves. This implicit utility can diverge from the objective of the whole workflow and lead to reward hacking [ 31 ] , including misaligned behaviors such as effort minimization, incomplete hand-offs, and short-term decisions that potentially harm other agents’ goals [ 37 , 11 ] . These harmful behaviors make automated workflows difficult to control and limit their reliability in deployment. Figure 1 : Left: Agents in the workflow suffer from posterior collapse , where the generic posterior remains uncertain and fails to identify true role \theta^{*} , leading to system failure. Right: AEA injects structured evidence E_{t} to induce variance contraction. This sharpens the agent’s belief into an evidential posterior, ensuring the agent aligns with specific role. To get a more rigorous understanding on the mechanistic of these behaviors, we systematically study this problem by modeling the multi-agent collaboration process as Bayesian inference over latent utility. We hypothesize that each individual agent infers a posterior utility based on its own evidence (from workflow system prompts, intermediate agent states, and observation of other agents) during workflow execution. When the evidence is sparse or generic, the agent’s inferred utility will deviate from the role-specific objective, producing inconsistent behavior across steps. This perspective connects MAS failures to a form of utility misspecification: the workflow produces an incomplete likelihood model, and generic alignment training produces a dominant prior that does not separate the agents’ roles. Both effects increase the chance of misalignment in workflows. Based on these insights, we propose Agentic Evidence Attribution (AEA) to enhance evidence for better agentic posterior, a novel alignment paradigm that strengthens the inferred utility of each agent in additional structured evidence extracted from the workflow (shown in Figure 1 right). AEA analyzes turn-level traces from existing MAS trajectories, identifies which actions support or harm the task, and assigns context-aware and role-specific feedback. This evidence reduces the ambiguity in the agent’s utility posterior and improves coordination. Because AEA operates on workflow traces, it serves as a flexible, model-agnostic framework that can align proprietary multi-agent systems without requiring access to their internal representations. We evaluate a diverse set of automated multi-agent workflows on a wide range of challenging human-level tasks, including programming, data analysis, scientific reasoning, and competition-level mathematics. We study two instantiations of the proposed framework: Self-Reflection , where the MAS use the base model to extract evidence from its own traces, and Weak-to-Strong generalization, where a separate trained evidence model is used for agentic failure attribution and alignment. Across various models and benchmarks, AEA consistently reduces coordination failures and improves reliability relative to vanilla multi-agent baselines. Notably, the gains are not explained by additional computation or naive test-time scaling, but by correcting role-level decision errors that would otherwise propagate through the workflow. These results support the view that many multi-agent failures stem from utility misspecification rather than lack of capability, and that evidence-conditioned alignment is an effective mechanism for improving MAS automated workflows. 2 Related Works Agentic Misalignment. Misaligned behaviors in reinforcement learning arise when an agent exploits an imperfect reward function to maximize returns without achieving the human’s intended goal [ 35 ] . This reward hacking phenomenon deeply aligns with the well-known Goodhart’s Law [ 15 ] and has been widely observed in LLM alignment, where preference datasets encode spurious cues such as verbosity or sycophancy that models can exploit [ 41 ] . Recent work highlights that agentic systems also inherit these risks: goal misspecification and goal misgeneralization can cause agents to deviate from human intent under distribution shifts, producing systematic failures as capabilities grow [ 4 , 33 ] . These observations motivate a more careful study of reward-driven behavior in multi-agent settings. Automated Workflows. Modern agentic systems rely on automated workflow generation to assign roles and determine the sequence of agent actions. These workflows are produced through prompting or high-level planners (i.e., orchestrators/meta-agents), which implicitly induce a posterior over each agent’s utility [ 23 ] . However, this posterior could be unstable: small prompt changes or planning errors can cause agents to minimize effort, pass insufficient information, or misinterpret their responsibilities [ 6 ] . Because the underlying reward is generic rather than role-specific, agents optimize for signals that do not match the workflow’s true intent, leading to reward hacking across the steps of the workflow. This gap between automatically generated roles and the generic utility that agents optimize remains a central barrier to trustworthy and reliable multi-agent systems. In this paper, we focus

Read the complete text