Debate, Train, Evolve: Self-Evolution of Language Model Reasoning

Gaurav Srivastava, Zhenyu Bi, Meng Lu, Xuan Wang · 2025

Read Debate, Train, Evolve: Self-Evolution of Language Model Reasoning by Gaurav Srivastava, Zhenyu Bi, Meng Lu, Xuan Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15734.txt.

Introduction

Gaurav Srivastava, Zhenyu Bi, Meng Lu, and Xuan Wang let language models improve their own reasoning by debating, in a paper from 2025. More training data is getting hard to find, so gains must come from the models themselves. Their framework needs no answer key from outside.

In the method, several agents debate a problem, and a prompt style called Reflect-Critique-Refine tells them to attack and polish each other's steps. The debate traces then train a single model, which evolves over rounds. Across seven test sets and six open models, scores rose by about nine points on a hard math set. Gains of about six points on the other sets hint that the skill travels across topics.

Catalog record

CREATORGaurav Srivastava, Zhenyu Bi, Meng Lu, Xuan Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE157 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-15734

Browse the full library · About the Tower of Babel