Learning to Simulate Human Dialogue

Kanishk Gandhi, Agam Bhatia, Noah D. Goodman · 2026

Read Learning to Simulate Human Dialogue by Kanishk Gandhi, Agam Bhatia, Noah D. Goodman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04436.txt.

Description

Kanishk Gandhi, Agam Bhatia, and Noah D. Goodman study what it takes to predict the next line of a conversation, in a 2026 arXiv paper. Guessing what someone will say means modelling how they think, so the team compares training schemes for next-turn dialogue prediction along two axes. Whether the model may think before answering, and what it is rewarded for — a judge model's similarity scores, or the actual words people said.

The judge-based route backfires: scores from the judge climb while the model's grip on real human replies loosens. human raters pick its outputs as human-like less often, especially when the model thinks first. Training directly on the probability of observed replies improves both measures. Best of all is treating the thinking itself as a hidden variable and optimizing a derived bound, suggesting that reasoning helps only when training stays anchored to real dialogue.

Catalog record

CREATORKanishk Gandhi, Agam Bhatia, Noah D. Goodman
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04436

Browse the full library · About the Tower of Babel