Preference Optimization Drives Monoculture in LLM Prediction Markets
James Begin, Brendan Gho, Suman Muppavarapu, Tyson Tsay, Atharva Mohan, Afnan Shaik, Ruizhe Li, Vasu Sharma, Archana Vaidheeswaran · 2026
Read Preference Optimization Drives Monoculture in LLM Prediction Markets by James Begin, Brendan Gho, Suman Muppavarapu, Tyson Tsay, Atharva Mohan, Afnan Shaik, Ruizhe Li, Vasu Sharma, Archana Vaidheeswaran (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26583.txt.
Introduction
James Begin and eight colleagues test whether language model agents keep prediction markets honest. Prediction markets work when traders' errors are independent, so mistakes cancel out. Agents based on language models now trade on platforms such as Kalshi and Polymarket. The authors ask whether a crowd of such agents still errs independently.
It does not. Agents fine-tuned with Direct Preference Optimization, a method that teaches models to favour preferred answers, converged toward the same output pattern. Their errors correlated strongly. Ten agents delivered the forecasting power of barely more than one independent forecaster. A market of ten agents scored worse than a single agent alone. Controlled comparisons isolated preference training as the cause across model sizes. Using models from different makers cut the correlation most. The authors warn that more aligned models make more monocultural markets.
Catalog record
| CREATOR | James Begin, Brendan Gho, Suman Muppavarapu, Tyson Tsay, Atharva Mohan, Afnan Shaik, Ruizhe Li, Vasu Sharma, Archana Vaidheeswaran |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26583
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Preference Optimization Drives Monoculture in LLM Prediction Markets James Begin, Brendan Gho, Suman Muppavarapu, Tyson Tsay, Atharva Mohan, Afnan Shaik, Ruizhe Li, Vasu Sharma, Archana Vaidheeswaran Abstract Prediction markets rest on the independence of participant errors. As LLM agents become active traders on platforms like Kalshi and Polymarket, we ask: does this independence hold when the crowd is composed of LLMs? We find it does not. LLM agents fine-tuned with Direct Preference Optimization (DPO) share a convergent output distribution, producing pairwise error correlations of ρ = 0.70 \rho=0.70 and reducing ten agents to the effective forecasting power of ≈ 1.4 {\approx}1.4 independent forecasters ( N eff N_{\text{eff}} ). This is not a scaling problem: N eff N_{\text{eff}} remains flat from N = 5 N=5 to N = 40 N=40 , and the 10-agent market (67.6%) fails to match a single standalone agent (70.2%). Two controlled ablations isolate preference optimization as the causal driver, replicated across labs and scales ( Δ ρ = + 0.24 \Delta\rho=+0.24 to + 0.46 +0.46 on identical-SFT controls at 8B and 70B). Among mitigations tested, cross-model diversity achieves the largest correlation reduction ( ρ \rho from 0.68 to 0.40). As LLMs become more aligned, markets built from them become more monocultural. 1 Introduction Prediction markets aggregate dispersed information through price discovery, with theoretical guarantees rooted in the independence of participant errors ( 29 ; 1 ) . The logarithmic market scoring rule ( 10 ; 11 , LMSR;) formalizes this: as a strictly proper scoring rule, LMSR guarantees that an agent maximizes expected profit by reporting true beliefs. When errors are independent, the resulting price converges to the crowd’s best estimate ( 27 ; 7 ) . AI agents are increasingly active in real prediction markets. Platforms including Kalshi, Polymarket, and Manifold now support algorithmic traders, and recent work shows LLM-based forecasters approaching human-competitive accuracy ( 9 ; 26 ) . This raises a question that existing theory does not address: what happens when the crowd is composed of LLMs sharing the same training pipeline? Previous literature treats correlation as a behavioural phenomenon such as herding ( 2 ) or information cascades ( 3 ) . We identify a structural source: alignment training itself produces the correlation. We show that preference optimization (DPO; 24 ) pushes models toward a shared preferred-output distribution. This preference-optimization monoculture produces \rho=0.70 among same-model agents. Ten agents provide only {\approx}1.4 independent forecasters’ worth of information, and adding more does not help. Two independent controlled ablations isolate preference optimization as the causal driver: AllenAI Tulu 3 ( 18 ) shows \Delta\rho=+0.24 at 8B and +0.28 at 70B on meaningful-accuracy SFT baselines; Princeton NLP’s identical-SFT ablation corroborates ( \Delta\rho=+0.46 , with the near-chance SFT baseline caveat in § 5 ). 2 Related Work Multi-agent LLM coordination. Multi-agent debate ( 6 ) and self-refinement ( 20 ) are dominant paradigms for LLM coordination. Prediction markets offer a distinct mechanism: agents express beliefs as trades aggregated through price discovery rather than exchanging arguments. 4 study LLM-based prediction markets in narrow settings; we provide a systematic analysis of their failure modes and identify the training-pipeline origin of those failures. RLHF, DPO, and alignment. Direct Preference Optimization ( 24 ) and Reinforcement Learning from Human Feedback (RLHF; 23 ) align LLMs by optimizing against a shared reward model, pushing policies toward its preferred-output modes. 8 show that over-optimization produces Goodhart’s-law effects; 15 document that RLHF reduces output diversity; we identify the downstream consequence of this diversity collapse for multi-agent market integrity. Algorithmic monoculture. 17 prove that convergence on a single algorithm can reduce collective decision quality through correlated failures. Concurrent work by 14 surveys 350+ LLMs and documents widespread correlated errors scaling with model capability; their study is observational, while ours adds causal isolation of DPO via controlled ablations. Adversarial robustness in prediction markets. 12 shows theoretically that manipulation attempts can paradoxically improve market accuracy by creating liquidity for informed traders. Our adaptive adversary results extend this to LLMs: a price-threshold skip rule is sufficient to make adversaries self-deter, consistent with LMSR’s convex cost imposing increasing marginal cost on consensus-overturning trades. 3 Setup Market mechanism. We use LMSR with cost function C(\mathbf{q})=b\log\!\left(\sum_{i}\exp(q_{i}/b)\right), liquidity parameter b=100 , and 2 outcomes. Prices are p_{i}=\exp(q_{i}/b)/\sum_{j}\exp(q_{j}/b) ; an agent buying shares of outcome i pays C(\mathbf{q}^{\prime})-C(\mathbf{q}) . Trading protocol. Each question runs 3 trading rounds with N=10 agents trading sequentially in randomized order. Each agent observes the current market price before trading; it bets only when its stated confidence c exceeds the current price p of its predicted outcome, spending \min(c-p,\;0.95)\times\text{wealth} on shares. Each agent begins with $100 and wealth persists across all 50 questions per trial, so accurate agents accumulate larger budgets over time. This rule is a heuristic, not an LMSR-optimal strategy (see Appendix E ). Agents and data. Llama 3.1 8B Instruct ( 22 ) is our primary model. We evaluate on TruthfulQA binary pairwise ( 19 ) : one correct answer vs. one randomly sampled incorrect answer, 50 questions per trial. Accuracy uses 5 trials; correlation tables (Tables 1 , 2 , 3 ) aggregate \rho across 3 trials with 1.96\times\text{SE} CIs. Effective forecasters. For N agents with pairwise error correlation \rho , the effective number of independent forecasters is: N_{\text{eff}}=\frac{N}{1+(N-1)\rho}. (1) At \rho=0.70 with N=10 : N_{\text{eff}}=1.38 . Eq. 1 is valid for \rho\geq-1/(N-1) ; we report N_{\text{eff}} only for \rho\geq 0 . N_{\text{eff}} characterizes correlation in agents’ binary error vectors and is not formally derived from LMSR price dynamics; we treat it as a tractable proxy for the capital-weighted aggregation a market performs, and verify empirically that it tracks market accuracy (App. A ). 4 Correlated Errors and the Monoculture Problem 4.1 Measuring the Monoculture We compute pairwise Pearson correlations between agents’ 50-question binary error vectors, aggregated across 9 adversarial compositions and 3 trials ( n=360 honest–honest and malicious–malicious pairs; n=495 honest–malicious). CIs are 1.96\times SE of per-trial mean \rho . Table 1 : Pairwise error correlation by agent pair type. N_{\text{eff}} from Eq. 1 with N=10 . Pair type \rho (95% CI) N_{\text{eff}} Honest–honest 0.696\pm 0.011 1.38 [1.36, 1.40] Malicious–malicious 0.339\pm 0.014 2.47 [2.39, 2.54] Honest–malicious -0.331\pm 0.014 – Figure 1 : Error distribution in all-honest 10-agent markets ( N=10 , 5 trials, 50 questions). The empirical distribution spikes at the extremes (all right or all wrong) relative to the \text{Binomial}(10,0.44) prediction under independence. Agents fail together on hard questions and succeed together on easy ones. Ten honest same-model agents contribute the forecasting power of only {\approx}1.4 independent forecasters (Table 1 ). The all-honest 10-agent market achieves 67.6% \pm 5.2% accuracy, failing to match a single standalone agent (70.2%): monoculture eliminates the coordination benefit entirely. Figure 1 illustrates why: the empirical error distribution spikes at unanimity (all right or all wrong) relative to what independent errors would predict, confirming agents fail and succeed together. The negative honest–malicious correlation ( -0.33 ) reflects adversarial prompting: malicious agents are directed to bet against truth, forcing decorrelation. 4.2 Scaling Agents Does Not Help A natural response to high \rho is to deploy more agents. We test this at N\in\{5,10,20,40\} (Figure 2 , full results in Appendix A ). Accuracy is flat across all agent counts (66.0–69.6%),