Distilling Bayesian Belief States into Language Models for Auditable Negotiation

Zongqi Cui, Baihan Lin · 2026

Read Distilling Bayesian Belief States into Language Models for Auditable Negotiation by Zongqi Cui, Baihan Lin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04507.txt.

Introduction

Zongqi Cui and Baihan Lin build a negotiation agent whose beliefs about its opponent can be inspected, rather than hidden inside a language model. A good negotiator must infer what the other side values, update those beliefs turn by turn, and act under uncertainty.

Their teacher system scores each dialogue against the six possible orderings of the opponent's priorities and updates a probability distribution over them, then chooses actions from that distribution. A smaller student model is distilled to output both its actions and its beliefs as tagged text. On a standard negotiation data set, the teacher beat prior systems and the student kept much of the belief accuracy.

Catalog record

CREATORZongqi Cui, Baihan Lin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.04507

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distilling Bayesian Belief States into Language Models for Auditable Negotiation Zongqi Cui, Baihan Lin Abstract Negotiation agents must infer what their counterpart values, update those beliefs over dialogue turns, and choose actions under uncertainty. End-to-end large language models (LLMs) can imitate negotiation dialogue, but their opponent beliefs are usually implicit and difficult to inspect. We propose BOND (Bayesian Opponent-belief Negotiation Distillation), a framework for auditable negotiation. BOND consists of an LLM-based Bayesian teacher that scores dialogue contexts against the six possible opponent priority orderings, updates a posterior over those orderings, and uses the posterior for menu-based decision making, as well as a smaller 8B student language model that emits both negotiation actions and normalized posterior beliefs as tagged text. In the CaSiNo negotiation dataset, BOND outperforms the state-of-the-art and achieves mean Brier score 0.085 over opponent-priority posteriors. The distilled student preserves much of this belief signal, achieving Brier 0.114, below the uniform six-ordering reference of 5 / 36 ≈ 0.139 5/36\approx 0.139 . Compared with a 70B structured-CoT baseline, the significantly smaller 8B student model yields substantially better elicited posterior calibration. We further showcase auditability through posterior trajectories, belief-versus-policy error decomposition, and posterior-prefix interventions. These diagnostics reveal that distillation preserves a scoreable belief report more strongly than causal belief-conditioned control, making weak belief-action coupling visible, not hidden. † † Code available at https://github.com/kaneis1/CaSiNo_negotiation-agent 1 Introduction Negotiation agents must infer what their counterpart values, update that belief over dialogue turns, and act under uncertainty. End-to-end language models can generate fluent negotiation dialogue, but their beliefs about the opponent are usually implicit: when a model accepts, rejects, or counteroffers, it is difficult to tell whether the action follows from a stable opponent model or from shallow dialogue imitation. Bayesian cognitive models provide the complementary strength: they expose priors, likelihoods, and posteriors, but usually require hand-designed likelihood functions that do not scale naturally to free-form negotiation language. We combine these two views. Our central commitment is that language supplies the likelihood, and structured inference performs the update . An LLM scores how compatible a dialogue context is with each candidate opponent priority ordering; a Bayesian module converts these scores into a posterior over hidden opponent preferences; and a menu planner uses the posterior for accept/counteroffer decisions. We then distill this Bayesian teacher into an 8B student that emits the posterior as tagged text alongside its selected intent, content, and utterance. The resulting model remains a generative negotiation agent, but its opponent belief state is externalized and can be scored at every turn. We call this framework BOND ( B ayesian O pponent-belief N egotiation D istillation). We study this framework in the CaSiNo dataset ( 5 ) , where two participants negotiate over Food, Water, and Firewood and each privately holds one of six priority orderings. Prior CaSiNo opponent modeling predicts the opponent’s final priority order from dialogue prefixes; we instead study the full posterior trajectory over all six orderings. This makes the model auditable in a stronger sense than aggregate prediction accuracy: the exposed posterior lets us distinguish wrong-belief failures from right-belief/wrong-action failures, inspect individual belief trajectories, and test whether posterior correction changes the student’s action. On 150 held-out CaSiNo dialogues, totaling 1054 turn-level predictions from the mturk_agent_1 perspective, the Bayesian teacher achieves mean Brier score 0.085 over opponent-priority posteriors. The distilled 8B student preserves much of this belief signal, achieving Brier 0.114, below the uniform six-ordering reference of 5/36\approx 0.139 . A 70B structured-CoT baseline has stronger accept/reject F1, but its elicited posterior is poorly calibrated, with Brier 0.194. Thus, the main claim is not that the student is the best negotiation policy; it is that a smaller model can expose a valid, scoreable belief interface while retaining usable decision behavior. Contributions and presentations are as following: • We formulate negotiation opponent modeling as Bayesian belief-state distillation, using an LM as a likelihood estimator over six opponent priority orderings. • We distill the Bayesian teacher into an 8B student that emits normalized posterior beliefs as tagged text, achieving Brier 0.114 versus a 0.139 uniform reference. • We demonstrate auditability through belief-policy error decomposition, posterior trajectories, and posterior-prefix intervention. • We compare against a 70B structured-CoT baseline and show that elicited posterior calibration remains worse than the student’s native posterior. • We provide ablations showing that posterior tags primarily improve inspectability, while causal belief-action coupling remains limited after supervised fine-tuning (SFT) distillation. 2 Related Work Automated negotiation is commonly decomposed into bidding, opponent modeling, and acceptance strategy ( 2 ; 3 ) . Neural dialogue work such as Deal-or-No-Deal studies negotiation as end-to-end language generation ( 8 ) , while CaSiNo adds a richer campsite scenario with natural-language strategies, private priorities, SVO, Big Five traits, and outcome annotations ( 5 ) . Prior CaSiNo opponent modeling predicts the opponent’s priority ordering from dialogue prefixes ( 4 ) . We build on this task but replace final-order prediction with a turn-level posterior over all six orderings. Bayesian cognitive models explain behavior as inference under uncertainty, making priors, likelihoods, and posteriors explicit ( 7 ; 10 ) . This is attractive for negotiation because the hidden state is concrete: the opponent’s private priority ordering. The challenge is that realistic dialogue evidence is free-form and strategic. We therefore use the LM as a likelihood-like language interpreter while keeping the posterior update explicit. Recent LLM negotiation systems use structured prompting for observation, inference, planning, and response generation ( 1 ) , and negotiation coaching systems show that LLM feedback can improve human bargaining ( 14 ) . BEDA similarly treats belief estimates as mediators of strategic dialogue acts ( 9 ) . Our contribution is to distill an explicit Bayesian posterior into a smaller LM and evaluate that posterior directly with turn-level Brier score and auditability diagnostics. 3 Methods We design a modular negotiation agent that separates language interpretation, belief revision, and action selection. The central design choice is to treat the language model as a likelihood estimator rather than as a complete black-box policy. At each turn, the agent observes a partial CaSiNo dialogue, scores how compatible the dialogue is with each possible opponent priority ordering, updates a Bayesian posterior over these orderings, and uses the posterior to choose whether to accept, reject, or propose an allocation. Under BOND framework, we then distill this Bayesian teacher into an 8B student that emits the posterior directly as tagged text, making belief auditable at every turn. 3.1 Task and Hypothesis Space We evaluate in the CaSiNo campsite-negotiation domain ( 5 ) . Each dialogue involves two participants negotiating over three item types: \mathcal{I}=\{\textsc{Food},\textsc{Water},\textsc{Firewood}\}. For each participant, the three items are assigned private priorities High, Medium, and Low, worth 5, 4, and 3 points per package, respectively. Since there are three items, the opponent’s hidden priority ordering belongs to a six-element hypothesis space: \Theta=\mathrm{Perm}(\mathcal{I}),\qquad|\Theta|=3!=6. This six-state hypothesis space is deliberately small. It matches CaSiNo’s private-priority design and makes turn-level posterior scoring unambiguous, which is useful for a first auditable-belief benchmark. We do not claim that human negotiation preferences are generally discrete or purely ordinal. Larger domains could replace \Theta with continuous priority weights over issues, structured combinatorial preferences, or particle-based posterior approximations. A belief state is therefore a

Read the complete text