Interactive Critique-Revision Training for Reliable Structured LLM Generation

Fei Xu Yu, Zuyuan Zhang, Mahdi Imani, Nathaniel D. Bastian, Tian Lan · 2026

Read Interactive Critique-Revision Training for Reliable Structured LLM Generation by Fei Xu Yu, Zuyuan Zhang, Mahdi Imani, Nathaniel D. Bastian, Tian Lan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08327.txt.

Description

Fei Xu Yu, Zuyuan Zhang, Mahdi Imani, Nathaniel Bastian, and coauthors train language models to produce structured outputs that auditors can check. In form filling, compliance review, and maintenance reporting, an answer must be locally right, globally consistent, and defensible against written rules, and heuristic self-debate offers no real assurance.

Their DPA-GRPO method trains a generator and a verifier as paired players. The verifier either stays silent or files a safety assurance case with a claim, an argument, and evidence; the generator then keeps or revises its output. Those paired decisions form counterfactual action groups for role-specific reinforcement updates, grounding revision in stated evidence rather than vibes.

Catalog record

CREATORFei Xu Yu, Zuyuan Zhang, Mahdi Imani, Nathaniel D. Bastian, Tian Lan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08327

Browse the full library · About the Tower of Babel