Preserving Disagreement: Architectural Heterogeneity and Coherence Validation in Multi-Agent Policy Simulation

Ariel Sela · 2026

Read Preserving Disagreement: Architectural Heterogeneity and Coherence Validation in Multi-Agent Policy Simulation by Ariel Sela (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26561.txt.

Introduction

Sela tested whether multi-agent policy talks can keep disagreement alive instead of collapsing into fake consensus. Her AI Council ran 120 talks across two policy scenarios with two fixes. Giving each value view a different mid-size model cut first-choice clustering sharply. On child welfare it fell from about 71 percent to about 46 percent, and on housing from about 46 percent to about 23 percent. Coherence checks then showed a fidelity-diversity trade-off, helping where one option ruled but hurting where options truly competed.

Catalog record

CREATORAriel Sela
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60755
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.26561

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Preserving Disagreement: Architectural Heterogeneity and Coherence Validation in Multi-Agent Policy Simulation Ariel Sela Abstract Multi-agent deliberation systems using large language models (LLMs) are increasingly proposed for policy simulation, yet they suffer from a failure mode specific to normative deliberation: artificial consensus, where evaluator agents converge on the same option regardless of their assigned value perspectives. Unlike accuracy-oriented tasks where convergence signals correctness, in policy deliberation convergence obscures the genuine trade-offs that make the output useful. We present the AI Council, a three-phase deliberation framework (structured debate, independent evaluation, coherence validation) and conduct 120 deliberations across two policy scenarios to test two interventions against this problem. First, architectural heterogeneity (assigning a different 7–9B parameter model to each value perspective) significantly reduces first-choice concentration compared to a homogeneous single-model baseline (child welfare: 70.9% → \rightarrow 46.1%, p < 0.001 p<0.001 , r = 0.58 r=0.58 ; housing: 46.0% → \rightarrow 22.9%, p < 0.001 p<0.001 , r = 0.50 r=0.50 ). This finding contrasts with accuracy-oriented multi-agent debate, where heterogeneity does not reduce convergence, suggesting that model diversity operates differently when there is no objectively correct answer. Second, coherence validation (using a frontier model to assess whether each evaluator’s reasoning is genuinely grounded in its assigned values) reveals a fidelity–diversity tradeoff : on a scenario with a dominant option, coherence validation further reduces concentration (46.1% → \rightarrow 40.8%, p = 0.004 p=0.004 ) by downweighting low-coherence majority voices, but on a scenario with genuinely competitive options, it increases concentration (22.9% → \rightarrow 26.6%, p = 0.96 p=0.96 ) by amplifying high-coherence evaluators who happen to cluster on one option. This tradeoff, where reasoning quality assessment and diversity preservation become competing objectives, may be a general property of multi-agent deliberation systems that employ any form of quality weighting, though confirmation across additional scenarios is needed. We report negative results from three failed Delphi designs, demonstrate that 8B models exhibit binary rather than graded responses to counter-arguments, and propose that the trustworthy tension rate (the fraction of value conflicts where both sides reason faithfully) provides a diagnostic measure of current small-model deliberation capabilities. Across both scenarios, roughly half of theoretical value conflicts are trustworthy, establishing a baseline for this model class. 1 Introduction The use of LLM-based agents in multi-agent deliberation has attracted growing interest as a tool for policy analysis, stakeholder simulation, and participatory design [ 4 , 8 , 15 ] . In these systems, multiple agents are assigned different perspectives or roles and asked to evaluate policy options, with the goal of surfacing the value tensions inherent in complex decisions. If the system works, it should reveal which stakeholder perspectives favor which options and why; this information is valuable precisely because it preserves disagreement rather than resolving it. In practice, however, these systems exhibit a persistent failure mode: artificial consensus. Evaluator agents converge on the same option regardless of their assigned value perspective, producing an illusion of agreement that obscures the genuine trade-offs underlying the policy question [ 20 , 18 ] . This failure is hard to detect because it mimics a desirable property, consensus, while actually representing a collapse of the deliberative process. This failure mode is specific to normative deliberation, where no objectively correct answer exists. In accuracy-oriented multi-agent debate, where agents collaborate to find a factual or mathematical answer, convergence is the goal, and recent work shows that debate forms a martingale on belief in the correct answer, providing no expected gain beyond voting [ 13 ] . Policy deliberation inverts this relationship: convergence is a failure mode, not a success criterion, because the system’s value lies in mapping where different perspectives lead, not in reaching agreement. We identify two distinct causes of artificial consensus in multi-agent LLM systems. The first is shared inductive bias: when all agents use the same underlying model, they share the same training data, RLHF preferences, and reasoning patterns. Even with different system prompts, the agents are fundamentally the same reasoner asked to wear different hats. The second is debate capture: agents assigned minority value perspectives are persuaded by the arguments of the majority during the debate phase, abandoning their assigned viewpoint in favor of the position that sounds most compelling. Recent work suggests this convergence reflects structured asymmetric persuasion dynamics rather than simple sycophantic conformity [ 3 ] , with format-dependent and model-specific patterns [ 6 ] . This paper makes three contributions. First, we demonstrate that architectural heterogeneity, using a different LLM for each value perspective, significantly reduces artificial consensus in normative multi-agent deliberation, with large effect sizes across both tested scenarios. While recent work has established that heterogeneity improves reasoning accuracy [ 5 ] and produces richer behavioral differentiation [ 9 , 17 ] , its effect on normative deliberation—where convergence is a failure mode, not a success criterion—has not been tested. Our finding is domain-specific: heterogeneous model pools have been tested in accuracy-oriented debate without reducing convergence [ 10 ] , suggesting that model diversity operates through different mechanisms when there is no correct answer to converge on. Second, we introduce a coherence validation layer that uses a frontier model to assess whether each evaluator’s reasoning is genuinely grounded in its assigned value perspective, and document a fidelity–diversity tradeoff : quality assessment and diversity preservation can become competing objectives when model capability varies across value perspectives. Third, we report negative results from three Delphi designs and the binary response pattern of 8B models to counter-arguments, providing empirical constraints on multi-agent architecture design at this model scale. The AI Council runs entirely on consumer hardware using seven locally-hosted 7–9B parameter models, with a single API call to a frontier model for coherence validation. We test it on two policy scenarios, child welfare intervention and urban housing policy, chosen to represent different structural properties (dominant option vs. genuinely competitive options). 2 Related Work Multi-agent debate and deliberation. Multi-agent debate systems have been shown to improve reasoning quality on factual and mathematical tasks [ 8 , 15 ] . ChatEval [ 4 ] uses multi-agent discussion for text evaluation, and several works explore society of mind architectures where LLM agents collaborate. However, these systems typically optimize for convergence on a correct answer, whereas our goal is the opposite: preserving legitimate disagreement when no objectively correct answer exists. Xiong et al. [ 23 ] document conformity effects in LLM-based social simulations, where agents adopt majority positions, consistent with our observation of debate capture. Huang et al. [ 13 ] prove that multi-agent debate forms a martingale on belief in the correct answer, providing no expected gain beyond independent voting for accuracy tasks. This theoretical result is complementary to our empirical finding: where their result establishes that debate adds nothing in accuracy contexts, our work shows that debate actively harms in normative contexts through capture effects, motivating the architectural interventions we test. Sycophancy and convergence dynamics. The tendency of RLHF-trained models to agree with users, known as sycophancy, is well-documented [ 19 , 21 ] . Pitre et al. [ 20 ] identify sycophancy as a core challenge in multi-agent debate specifically, finding that agents systematically converge toward shared positions. Park et al. [ 18 ] measure convergence scores exceeding 0.88 between opposing

Read the complete text