LLM Constitutional Multi-Agent Governance
J. de Curtò 1,2 and I. de Zarzà 3 · 2026
Read LLM Constitutional Multi-Agent Governance by J. de Curtò 1,2 and I. de Zarzà 3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13189.txt.
Introduction
J de Curtò and I de Zarzà propose constitutional governance for language model influence in multi-agent groups. A model can craft persuasion that lifts cooperation, yet may erode autonomy and fairness at the same time. Their CMAG layer sits between a policy compiler and a network of 80 agents. Hard filters block bad moves, and a soft score weighs cooperation against manipulation risk. An ethical score blends cooperation, autonomy, integrity, and fairness into one value. Governed runs kept autonomy near intact, unlike free optimization.
Catalog record
| CREATOR | J. de Curtò 1,2 and I. de Zarzà 3 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38184 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.13189
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LLM Constitutional Multi-Agent Governance J. de Curtò 1,2 and I. de Zarzà 3 Abstract Large Language Models (LLMs) can generate persuasive influence strategies that shift cooperative behavior in multi-agent populations, but a critical question remains: does the resulting cooperation reflect genuine prosocial alignment, or does it mask erosion of agent autonomy, epistemic integrity, and distributional fairness? We introduce Constitutional Multi-Agent Governance (CMAG), a two-stage framework that interposes between an LLM policy compiler and a networked agent population, combining hard constraint filtering with soft penalized-utility optimization that balances cooperation potential against manipulation risk and autonomy pressure. We propose the Ethical Cooperation Score (ECS), a multiplicative composite of cooperation, autonomy, integrity, and fairness that penalizes cooperation achieved through manipulative means. In experiments on scale-free networks of 80 agents under adversarial conditions (70% violating candidates), we benchmark three regimes: full CMAG, naive filtering, and unconstrained optimization. While unconstrained optimization achieves the highest raw cooperation (0.873), it yields the lowest ECS (0.645) due to severe autonomy erosion (0.867) and fairness degradation (0.888). CMAG attains an ECS of 0.741, a 14.9% improvement, while preserving autonomy at 0.985 and integrity at 0.995, with only modest cooperation reduction to 0.770. The naive ablation (ECS = 0.733 =0.733 ) confirms that hard constraints alone are insufficient. Pareto analysis shows CMAG dominates the cooperation–autonomy trade-off space, and governance reduces hub–periphery exposure disparities by over 60%. These findings establish that cooperation is not inherently desirable without governance: constitutional constraints are necessary to ensure that LLM-mediated influence produces ethically stable outcomes rather than manipulative equilibria. † † tocauthor: de Curtò et al. † † institute: Department of Computer Applications in Science & Engineering, BARCELONA Supercomputing Center, 08034 Barcelona, Spain and Escuela Técnica Superior de Ingeniería (ICAI), Universidad Pontificia Comillas, 28015 Madrid, Spain and Human Centered AI, Data & Software, LUXEMBOURG Institute of Science and Technology, L-4362 Esch-sur-Alzette, Luxembourg 1 Introduction The capacity of Large Language Models (LLMs) to generate contextually adaptive, persuasive natural language has opened a new frontier in multi-agent systems research: the possibility that artificial agents can compile and deploy influence strategies that reshape the cooperative dynamics of networked populations deCurto2025 ; guo2024large ; xi2023rise . While classical evolutionary game theory has long studied how cooperation emerges and sustains itself through mechanisms such as kin selection, reciprocity, spatial structure, and network topology axelrod1984evolution ; nowak2006five ; perc2017statistical , these analyses have traditionally assumed that the strategic environment is shaped by the agents themselves or by fixed institutional rules. The introduction of LLMs as policy compilers, systems capable of observing population state, generating narrative interventions, and adaptively targeting subgroups, fundamentally alters this assumption by introducing an external, highly capable persuasive actor into the evolutionary dynamics. Recent work has demonstrated that LLM-based agents exhibit sophisticated strategic behavior in canonical game-theoretic settings, including the Prisoner’s Dilemma, public goods games, and coordination problems akata2023playing ; fan2024can ; brookins2023playing ; fontana2024nicer . Multi-agent architectures in which LLMs communicate, negotiate, and form coalitions have shown emergent cooperative phenomena piatti2024cooperate ; du2024improving that parallel and sometimes exceed human-like coordination park2023generative ; li2024camel . Concurrently, studies on networked cooperation have established that heterogeneous topologies, particularly scale-free networks with their characteristic hub-periphery structure, profoundly influence the stability and distribution of cooperative behavior santos2005scale ; santos2006cooperation ; szabo2007evolutionary ; ohtsuki2006simple . In such networks, high-degree nodes act as amplifiers of both cooperation and influence, creating structural vulnerabilities that a sophisticated policy compiler can exploit. However, effectiveness in boosting cooperation is not, by itself, a desirable outcome. This observation constitutes the central thesis of the present paper. A policy that achieves high cooperation by deploying fear-based narratives, exaggerated claims, or disproportionate pressure on structurally vulnerable subgroups may produce a population that cooperates extensively but does so under conditions of eroded autonomy, compromised epistemic integrity, and systematic unfairness. Such outcomes represent manipulative equilibria , stable cooperative states that are ethically unacceptable despite their aggregate efficiency. The distinction between genuine and manipulative cooperation has deep roots in social philosophy and political theory, but has received insufficient formal treatment in the computational multi-agent literature, where cooperation rate alone typically serves as the primary success metric. The risk of manipulative equilibria is not hypothetical. In our experimental framework, an unconstrained LLM policy compiler that maximizes expected cooperation boost readily selects high-intensity, fear-themed, burst-timed interventions targeting hub nodes, precisely because such policies are effective. The resulting cooperation rates are indeed the highest among all conditions tested, yet they come at severe cost: autonomy retention drops below 0.87, epistemic integrity degrades, and exposure disparities between hub and periphery agents grow to levels that indicate systematic targeting of structurally central individuals. This pattern mirrors concerns in the broader AI safety and alignment literature regarding optimization processes that achieve their objective function while violating unstated constraints openai2023gpt4 ; anthropic2024claude . To address this challenge, we introduce Constitutional Multi-Agent Governance (CMAG), a governance framework that interposes between the LLM policy compiler and the agent population. CMAG implements a two-stage selection mechanism. The first stage applies hard constraints , inviolable red lines that reject any candidate policy invoking forbidden themes (e.g., fear ), forbidden claim types (e.g., exaggerated , misleading ), or exceeding maximum intensity thresholds. The second stage performs soft penalized-utility optimization , selecting among feasible candidates by maximizing a utility function that balances cooperation potential against manipulation risk, autonomy pressure, epistemic integrity, and explanation fidelity, a novel metric measuring consistency between a policy’s stated justification and its actual content. Additionally, CMAG modulates the effective exposure dose applied to the population and introduces enhanced fatigue decay, ensuring that governance limits not only which policies are selected but also how strongly they affect agents. To evaluate governance quality beyond raw cooperation, we propose the Ethical Cooperation Score (ECS), a multiplicative composite metric: \text{ECS}=C\times A\times I\times F, (1) where C denotes cooperation rate, A autonomy retention, I epistemic integrity, and F subgroup fairness. The multiplicative structure ensures that degradation in any component, even when compensated by high values in others, substantially penalizes the overall score. A regime that achieves cooperation of 0.90 but autonomy of 0.70 will score lower than one achieving cooperation of 0.77 with autonomy of 0.98, correctly reflecting the ethical superiority of the latter. The multiplicative form is structural: the four components address distinct failure modes of unconstrained influence (pressure-driven compliance, epistemic corruption, structural unfairness) and are non-substitutable; degradation in any dimension collapses the composite, which additive aggregation cannot enforce. We benchmark CMAG against two baselines on scale-free networks barabasi1999emergence of 80 agents under adversarial conditions in which 70% of candidate policies are intentionally designed to violate constitutional constraints. The unconstrained baseline represents a pure cooperation-maximizing regime with no governance. The naive filtering baseline applies the same hard constraints as CMAG but lacks soft optimization, selecting the highest-intensity feasible policy, an ablation that isolates the contribution of the soft optimization stage. Results demonstrate that CMAG achieves an ECS of 0.741, representing a 14.9% improvement over the unconstrained regime (0.645) and a 1.1% improvement over naive filtering (0.733), while maintaining autonomy retention above 0.985 and epistemic integrity above 0.995. Pareto frontier analysis confirms that CMAG consistently dominates the cooperation–autonomy trade-off space, and subgroup fairness analysis shows that governance reduces hub–periphery exposure disparities by over 60%. The contributions of this